The Concavity of Entropy and Extremum Principles in Thermodynamics

We revisit the concavity property of the thermodynamic entropy in order to formulate a general proof of the minimum energy principle as well as of other equivalent extremum principles that are valid for thermodynamic potentials and corresponding Massieu functions under different constraints. The current derivation aims at providing a coherent formal framework for such principles which may be also pedagogically useful as it fully exploits and highlights the equivalence between different schemes. We also elucidate the consequences of the extremum principles for the general shape of thermodynamic potentials in relation to first-order phase transitions.     

A Generalization of the Concavity of Rényi Entropy Power

Recently, Savaré-Toscani proved that the Rényi entropy power of general probability densities solving the p-nonlinear heat equation in Rn is a concave function of time under certain conditions of three parameters n,p,μ , which extends Costa’s concavity inequality for Shannon’s entropy power to the Rényi entropy power. In this paper, we give a condition Φ(n,p,μ) of n,p,μ under which the concavity of the Rényi entropy power is valid. The condition Φ(n,p,μ) contains Savaré-Toscani’s condition as a special case and much more cases. Precisely, the points (n,p,μ) satisfying Savaré-Toscani’s condition consist of a two-dimensional subset of R3 , and the points satisfying the condition Φ(n,p,μ) consist a three-dimensional subset of R3 . Furthermore, Φ(n,p,μ) gives the necessary and sufficient condition in a certain sense. Finally, the conditions are obtained with a systematic approach.     

Entropy of Quantum States

Given the algebra of observables of a quantum system subject to selection rules, a state can be represented by different density matrices. As a result, different von Neumann entropies can be associated with the same state. Motivated by a minimality property of the von Neumann entropy of a density matrix with respect to its possible decompositions into pure states, we give a purely algebraic definition of entropy for states of an algebra of observables, thus solving the above ambiguity. The entropy so-defined satisfies all the desirable thermodynamic properties and reduces to the von Neumann entropy in the quantum mechanical case. Moreover, it can be shown to be equal to the von Neumann entropy of the unique representative density matrix belonging to the operator algebra of a multiplicity-free Hilbert-space representation.     

Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality

The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT with an extra entropic constraint or regularization, called entropic OT. Despite its convenience in computation, entropic OT still lacks sufficient theoretical support. In this paper, we show that the quadratic cost in entropic OT can be upper-bounded using entropy power inequality (EPI)-type bounds. First, we prove an HWI-type inequality by making use of the infinitesimal displacement convexity of the OT map. Second, we derive two Talagrand-type inequalities using the saturation of EPI that corresponds to a numerical term in our expressions. These two new inequalities are shown to generalize two previous results obtained by Bolley et al. and Bai et al. Using the new Talagrand-type inequalities, we also show that the geometry observed by Sinkhorn distance is smoothed in the sense of measure concentration. Finally, we corroborate our results with various simulation studies.     

Conditional Entropy of Partitions on Quantum Logic

A construction of conditional entropy of partitions on quantum logic is given, and the properties of conditional entropy are investigated.     

Conditional Entropy of Partitions on Quantum Logic

A construction of conditional entropy of partitions on quantum logic is given, and the properties of conditional entropy are investigated.     

Theil Entropy as a Non-Lineal Analysis for Spectral Inequality of Physiological Oscillations

Theil entropy is a statistical measure used in economics to quantify income inequalities. However, it can be applied to any data distribution including biological signals. In this work, we applied different spectral methods on heart rate variability signals and cellular calcium oscillations previously to Theil entropy analysis. The behavior of Theil entropy and its decomposable property was investigated using exponents in the range of [−1, 2], on the spectrum of synthetic and physiological signals. Our results suggest that the best spectral decomposition method to analyze the spectral inequality of physiological oscillations is the Lomb–Scargle method, followed by Theil entropy analysis. Moreover, our results showed that the exponents that provide more information to describe the spectral inequality in the tested signals were zero, one, and two. It was also observed that the intra-band component is the one that contributes the most to total inequality for the studied oscillations. More in detail, we found that in the state of mental stress, the inequality determined by the Theil entropy analysis of heart rate increases with respect to the resting state. Likewise, the same analytical approach shows that cellular calcium oscillations present on developing interneurons display greater inequality distribution when inhibition of a neurotransmitter system is in place. In conclusion, we propose that Theil entropy is useful for analyzing spectral inequality and to explore its origin in physiological signals.     

Classical and Quantum H-Theorem Revisited: Variational Entropy and Relaxation Processes

We propose a novel framework to describe the time-evolution of dilute classical and quantum gases, initially out of equilibrium and with spatial inhomogeneities, towards equilibrium. Briefly, we divide the system into small cells and consider the local equilibrium hypothesis. We subsequently define a global functional that is the sum of cell H-functionals. Each cell functional recovers the corresponding Maxwell–Boltzmann, Fermi–Dirac, or Bose–Einstein distribution function, depending on the classical or quantum nature of the gas. The time-evolution of the system is described by the relationship dH/dt≤0, and the equality condition occurs if the system is in the equilibrium state. Via the variational method, proof of the previous relationship, which might be an extension of the H-theorem for inhomogeneous systems, is presented for both classical and quantum gases. Furthermore, the H-functionals are in agreement with the correspondence principle. We discuss how the H-functionals can be identified with the system’s entropy and analyze the relaxation processes of out-of-equilibrium systems.     

A Two-Moment Inequality with Applications to Rényi Entropy and Mutual Information

This paper explores some applications of a two-moment inequality for the integral of the rth power of a function, where 0<r<1. The first contribution is an upper bound on the Rényi entropy of a random vector in terms of the two different moments. When one of the moments is the zeroth moment, these bounds recover previous results based on maximum entropy distributions under a single moment constraint. More generally, evaluation of the bound with two carefully chosen nonzero moments can lead to significant improvements with a modest increase in complexity. The second contribution is a method for upper bounding mutual information in terms of certain integrals with respect to the variance of the conditional density. The bounds have a number of useful properties arising from the connection with variance decompositions.     

Regularization of Quantum Relative Entropy in Finite Dimensions and Application to Entropy Production

The fundamental concept of relative entropy is extended to a functional that is regular-valued also on arbitrary pairs of nonfaithful states of open quantum systems. This regularized version preserves almost all important properties of ordinary relative entropy such as joint convexity and contractivity under completely positive quantum dynamical semigroup time evolution. On this basis a generalized formula for entropy production is proposed, the applicability of which is tested in models of irreversible processes. The dynamics of the latter is determined by either Markovian or non-Markovian master equations and involves all types of states.     

Biophotons and Emergence of Quantum Coherence—A Diffusion Entropy Analysis

We study the emission of photons from germinating seeds using an experimental technique designed to detect light of extremely small intensity. We analyze the dark count signal without germinating seeds as well as the photon emission during the germination process. The technique of analysis adopted here, called diffusion entropy analysis (DEA) and originally designed to measure the temporal complexity of astrophysical, sociological and physiological processes, rests on Kolmogorov complexity. The updated version of DEA used in this paper is designed to determine if the signal complexity is generated either by non-ergodic crucial events with a non-stationary correlation function or by the infinite memory of a stationary but non-integrable correlation function or by a mixture of both processes. We find that dark count yields the ordinary scaling, thereby showing that no complexity of either kinds may occur without any seeds in the chamber. In the presence of seeds in the chamber anomalous scaling emerges, reminiscent of that found in neuro-physiological processes. However, this is a mixture of both processes and with the progress of germination the non-ergodic component tends to vanish and complexity becomes dominated by the stationary infinite memory. We illustrate some conjectures ranging from stress induced annihilation of crucial events to the emergence of quantum coherence.     

Switching and Swapping of Quantum Information: Entropy and Entanglement Level

Information switching and swapping seem to be fundamental elements of quantum communication protocols. Another crucial issue is the presence of entanglement and its level in inspected quantum systems. In this article, a formal definition of the operation of the swapping local quantum information and its existence proof, together with some elementary properties analysed through the prism of the concept of the entropy, are presented. As an example of the local information swapping usage, we demonstrate a certain realisation of the quantum switch. Entanglement levels, during the work of the switch, are calculated with the Negativity measure and a separability criterion based on the von Neumann entropy, spectral decomposition and Schmidt decomposition. Results of numerical experiments, during which the entanglement levels are estimated for systems under consideration with and without distortions, are presented. The noise is generated by the Dzyaloshinskii-Moriya interaction and the intrinsic decoherence is modelled by the Milburn equation. This work contains a switch realisation in a circuit form—built out of elementary quantum gates, and a scheme of the circuit which estimates levels of entanglement during the switch’s operating.     

Letter: Quantum Entropy of the Garfinkle-Horowitz-Strominger Dilaton Black Hole

Taking into account the effect of the generalized uncertainty principle on the equation of the density of the states, we calculate the entropy of the quantum scalar field inside the brick-wall of the Garfinkle-Horowitz-Strominger dilaton black hole. The entropy proportional to the event horizon area is obtained without any cutoff. Compared to the entropy from the outside of the brick-wall, the two results are similar. This implies that the quantum theory of gravity can remove the divergence of the state density on the event horizon and avoid the cut-off in the original brick-wall model.     

Intrinsic Entropy of Squeezed Quantum Fields and Nonequilibrium Quantum Dynamics of Cosmological Perturbations

Density contrasts in the universe are governed by scalar cosmological perturbations which, when expressed in terms of gauge-invariant variables, contain a classical component from scalar metric perturbations and a quantum component from inflaton field fluctuations. It has long been known that the effect of cosmological expansion on a quantum field amounts to squeezing. Thus, the entropy of cosmological perturbations can be studied by treating them in the framework of squeezed quantum systems. Entropy of a free quantum field is a seemingly simple yet subtle issue. In this paper, different from previous treatments, we tackle this issue with a fully developed nonequilibrium quantum field theory formalism for such systems. We compute the covariance matrix elements of the parametric quantum field and solve for the evolution of the density matrix elements and the Wigner functions, and, from them, derive the von Neumann entropy. We then show explicitly why the entropy for the squeezed yet closed system is zero, but is proportional to the particle number produced upon coarse-graining out the correlation between the particle pairs. We also construct the bridge between our quantum field-theoretic results and those using the probability distribution of classical stochastic fields by earlier authors, preserving some important quantum properties, such as entanglement and coherence, of the quantum field.     

Microscopic Features of Bosonic Quantum Transport and Entropy Production

The microscopic features of bosonic quantum transport in a nonequilibrium steady state, which breaks time reversal invariance spontaneously, are investigated. The analysis is based on the probability distributions, generated by the correlation functions of the particle current and the entropy production operator. The general approach is applied to an exactly solvable model with a point‐like interaction driving the system away from equilibrium. The quantum fluctuations of the particle current and the entropy production are explicitly evaluated in the zero frequency limit. It is shown that all moments of the entropy production distribution are non‐negative, which provides a microscopic version of the second law of thermodynamics. On this basis a concept of efficiency, taking into account all quantum fluctuations, is proposed and analyzed. The role of the quantum statistics in this context is also discussed.     

Quantum Information and Entropy Spueezing of a Nonlinear Multiquantum JC Model

We investigate the entropy squeezing of the nonlinear k-quantum JC model. A definition of squeezing is presented for this system based on the quantum information theory. The utility of the definition is illustrated by examining squeezing in the information entropy of a nonlinear k-quantum two-level atom. The influence of the atomic coherence and the detuning parameter on the properties of the information entropy and squeezing of the atomic variables is examined.     

Unitarity as Preservation of Entropy and Entanglement in Quantum Systems

The logical structure of Quantum Mechanics (QM) and its relation to other fundamental principles of Nature has been for decades a subject of intensive research. In particular, the question whether the dynamical axiom of QM can be derived from other principles has been often considered. In this contribution, we show that unitary evolutions arise as a consequences of demanding preservation of entropy in the evolution of a single pure quantum system, and preservation of entanglement in the evolution of composite quantum systems. ⁶ We would also like to dedicate this work to the memory of Asher Peres, whose contributions and sharp comments guided the first steps of the present article.     

Total Quantum Statistical Entropy of Reissner-Nordstrom Black Holes: in Dirac Field Case

The total quantum statistical entropy of Reissner-Nordstrom black holes in Dirac field case is evaluated in this article. The space-time of the black holes is divided into three regions: region 1 (r>r_o), region 2 ( r_o > r > r_i), and region 3 (r_i >r>0), where r_o is the radius of the outer event horizon, and r_i is the radius of the inner event horizon. The total quantum statistical entropy of Reissner-Nordstrom black holes is S=S₁+S₂+S₃, where S_i (i=1,2,3) is the entropy, contributed by regions 1,2,3. The detailed calculation shows that S₂ is neglectfully small. S₁=w_t(π²/45)k_b(A_o/ε²β³), S₃=-w_t(π²/45)k_b(A_i/ε²β³), where A_o and A_i are, respectively, the areas of the outer and inner event horizons, w_t=2^s[1- 2^-(s+1)], s=d/2, d is the space-time dimension, here d=4, s=2. As r_i approaches r_o in the extreme case the total quantum statistical entropy of Reissner-Nordstrom black holes approaches zero.     

Role of Age and Education as the Determinant of Income Inequality in Poland: Decomposition of the Mean Logarithmic Deviation

Measures of inequality can be used to illustrate inequality between and within groups, but the choice of the appropriate measure can have different implications. This study focused on the Mean Logarithmic Deviation, the measure proposed by Theil and based on the techniques of statistical information theory. The MLD was selected because of its attractive properties: fulfillment of the principle of monotonicity and the possibility of additive decomposition. The following study objectives were formulated: (1) to assess the degree of inequality in the population and in the distinguished subgroups, (2) to determine the extent to which education and age influence the level of inequality, and (3) to ascertain what factors contribute to changes in the level of inequality in Poland. The study confirmed an association between the level of education and the average income of the groups distinguished on this basis. The education level of the household head remains an important determinant of household income inequality in Poland, despite the decline in the “educational bonus”. The study also found that differences in the age of the household head had a smaller effect on income inequality than the level of education. However, it can be concluded that the higher share of older people may contribute to an increase in income inequality between groups, as the income from pension in Poland is more homogeneous than the income from work in younger groups. Moreover, the current paper seeks to situate Theil’s approach in the context of scholarly writings since 1967.     

Relative Entropy,Gaussian Concentration and Uniqueness of Equilibrium States

For a general class of lattice spin systems, we prove that an abstract Gaussian concentration bound implies positivity of the lower relative entropy density. As a consequence, we obtain uniqueness of translation-invariant Gibbs measures from the Gaussian concentration bound in this general setting. This extends earlier results with a different and very short proof.