Beyond the Shannon–Khinchin formulation: The composability axiom and the universal-group entropy

The notion of entropy is ubiquitous both in natural and social sciences. In the last two decades, a considerable effort has been devoted to the study of new entropic forms, which generalize the standard Boltzmann–Gibbs (BG) entropy and could be applicable in thermodynamics, quantum mechanics and information theory. In Khinchin (1957), by extending previous ideas of Shannon (1948) and Shannon and Weaver (1949), Khinchin proposed a characterization of the BG entropy, based on four requirements, nowadays known as the Shannon–Khinchin (SK) axioms.     

Towards information theory for q-nonextensive statistics without q-deformed distributions

In this paper we extend our recent results [P. Jizba, T. Arimitsu Physica A 340 (2004) 110] on q-nonextensive statistics with non-Tsallis entropies. In particular, we combine an axiomatics of Rényi with the q-deformed version of Khinchin axioms to obtain the entropy which accounts both for systems with embedded self-similarity and q-nonextensivity. We find that this entropy can be uniquely solved in terms of a one-parameter family of information measures. The corresponding entropy maximizer is expressible via a special function known under the name of the Lambert W-function. We analyze the corresponding “high” and “low-temperature” asymptotics and make some remarks on the possible applications.     

Weakly nonextensive thermostatistics and the Ising model with long-range interactions

We introduce a new nonextensive entropic measure that grows like , where N is the size of the system under consideration. This kind of nonextensivity arises in a natural way in some N-body systems endowed with long-range interactions described by interparticle potentials. The power law (weakly nonextensive) behavior exhibited by is intermediate between (1) the linear (extensive) regime characterizing the standard Boltzmann-Gibbs entropy and (2) the exponential law (strongly nonextensive) behavior associated with the Tsallis generalized q-entropies. The functional is parametrized by the real number in such a way that the standard logarithmic entropy is recovered when . We study the mathematical properties of the new entropy, showing that the basic requirements for a well behaved entropy functional are verified, i.e., possesses the usual properties of positivity, equiprobability, concavity and irreversibility and verifies Khinchin axioms except the one related to additivity since is nonextensive. For , the entropy becomes superadditive in the thermodynamic limit. The present formalism is illustrated by a numerical study of the thermodynamic scaling laws of a ferromagnetic Ising model with long-range interactions. Received 24 May 2000     

Pathway model,superstatistics, Tsallis statistics,and a generalized measure of entropy

The pathway model of Mathai [A pathway to matrix-variate gamma and normal densities, Linear Algebra Appl. 396 (2005) 317–328] is shown to be inferable from the maximization of a certain generalized entropy measure. This entropy is a variant of the generalized entropy of order α$\alpha$, considered in Mathai and Rathie [Basic Concepts in Information Theory and Statistics: Axiomatic Foundations and Applications, Wiley Halsted, New York and Wiley Eastern, New Delhi, 1975], and it is also associated with Shannon, Boltzmann–Gibbs, Rényi, Tsallis, and Havrda–Charvát entropies. The generalized entropy measure introduced here is also shown to have interesting statistical properties and it can be given probabilistic interpretations in terms of inaccuracy measure, expected value, and information content in a scheme. Particular cases of the pathway model are shown to be Tsallis statistics [C. Tsallis, Possible generalization of Boltzmann-Gibbs statistics, J. Stat. Phys. 52 (1988) 479–487] and superstatistics introduced by Beck and Cohen [Superstatistics, Physica A 322 (2003) 267–275]. The pathway model's connection to fractional calculus is illustrated by considering a fractional reaction equation.     

Tsallis entropy measure of noise-aided information transmission in a binary channel

Noise-aided information transmission via stochastic resonance is shown and analyzed in a binary channel by means of information measures based on the Tsallis entropy. The analysis extends the classic reference of binary information transmission based on the Shannon entropy, and also parallels a recent study based on the Rényi entropy. The conditions for a maximally pronounced stochastic resonance identify optimal Tsallis measures. The study involves a correspondence between Tsallis and Rényi information measures, specially relevant to the characterization of stochastic resonance, and establishing that for such effects identical properties are shared in common by both Tsallis and Rényi measures.     

On the construction of complex networks with optimal Tsallis entropy

In this work, we first formulate the Tsallis entropy in the context of complex networks. We then propose a network construction whose topology maximizes the Tsallis entropy. The growing network model has two main ingredients: copy process and random attachment mechanism (C-R model). We show that the resulting degree distribution exactly agrees with the required degree distribution that maximizes the Tsallis entropy. We also provide another example of network model using a combination of preferential and random attachment mechanisms (P-R model) and compare it with the distribution of the Tsallis entropy. In this case, we show that by adequately identifying the exponent factor q, the degree distribution can also be written in the q-exponential form. Taken together, our findings suggest that both mechanisms, copy process and preferential attachment, play a key role for the realization of networks with maximum Tsallis entropy. Finally, we discuss the interpretation of q parameter of the Tsallis entropy in the context of complex networks.     

Combinatorial basis and non-asymptotic form of the Tsallis entropy function

Using a q-analog of Boltzmann's combinatorial basis of entropy, the non-asymptotic non-degenerate and degenerate combinatorial forms of the Tsallis entropy function are derived. The new measures – supersets of the Tsallis entropy and the non-asymptotic variant of the Shannon entropy – are functions of the probability and degeneracy of each state, the Tsallis parameter q and the number of entities N. The analysis extends the Tsallis entropy concept to systems of small numbers of entities, with implications for the permissible range of q and the role of degeneracy.     

Hidden Correlations and Entanglement in Single-Qudit States<Superscript>†</Superscript>

We discuss the notion of hidden correlations in classical and quantum indivisible systems along with such characteristics of the correlations as the mutual information and conditional information corresponding to the entropic subadditivity condition and the entropic strong subadditivity condition. We present an analog of the Bayes formula for systems without subsystems, study entropic inequality for von Neumann entropy and Tsallis entropy of the single-qudit state, and discuss the inequalities for qubit and qutrit states as an example.     

Quantum uncertainty relations of Tsallis relative α entropy coherence based on MUBs

In this paper,we discuss quantum uncertainty relations of Tsallis relative α entropy coherence for a single qubit system based on three mutually unbiased bases.For α∈[1/2,1)U(1,2],the upper and lower bounds of sums of coherence are obtained.However,the above results cannot be verified directly for any α∈(0,1/2).Hence,we only consider the special case of α=1/n+1,where n is a positive integer,and we obtain the upper and lower bounds.By comparing the upper and lower bounds,we find that the upper bound is equal to the lower bound for the special α=1/2,and the differences between the upper and the lower bounds will increase as α increases.Furthermore,we discuss the tendency of the sum of coherence,and find that it has the same tendency with respect to the different θ or φ,which is opposite to the uncertainty relations based on the Rényi entropy and Tsallis entropy.     

Inequalities for nonnegative numbers and information properties of qudit tomograms

We discuss some inequalities for N nonnegative numbers. We use these inequalities to obtain known inequalities for probability distributions and new entropic and information inequalities for quantum tomograms of qudit states. The inequalities characterize the degree of quantum correlations in addition to noncontextuality and quantum discord. We use the subadditivity and strong subadditivity conditions for qudit tomographic-probability distributions depending on the unitary-group parameters in order to derive new inequalities for Shannon, Rényi, and Tsallis entropies of spin states.     

Belavkin–Staszewski Relative Entropy,Conditional Entropy,and Mutual Information

Belavkin–Staszewski relative entropy can naturally characterize the effects of the possible noncommutativity of quantum states. In this paper, two new conditional entropy terms and four new mutual information terms are first defined by replacing quantum relative entropy with Belavkin–Staszewski relative entropy. Next, their basic properties are investigated, especially in classical-quantum settings. In particular, we show the weak concavity of the Belavkin–Staszewski conditional entropy and obtain the chain rule for the Belavkin–Staszewski mutual information. Finally, the subadditivity of the Belavkin–Staszewski relative entropy is established, i.e., the Belavkin–Staszewski relative entropy of a joint system is less than the sum of that of its corresponding subsystems with the help of some multiplicative and additive factors. Meanwhile, we also provide a certain subadditivity of the geometric Rényi relative entropy.     

From Rényi Entropy Power to Information Scan of Quantum States

In this paper, we generalize the notion of Shannon’s entropy power to the Rényi-entropy setting. With this, we propose generalizations of the de Bruijn identity, isoperimetric inequality, or Stam inequality. This framework not only allows for finding new estimation inequalities, but it also provides a convenient technical framework for the derivation of a one-parameter family of Rényi-entropy-power-based quantum-mechanical uncertainty relations. To illustrate the usefulness of the Rényi entropy power obtained, we show how the information probability distribution associated with a quantum state can be reconstructed in a process that is akin to quantum-state tomography. We illustrate the inner workings of this with the so-called “cat states”, which are of fundamental interest and practical use in schemes such as quantum metrology. Salient issues, including the extension of the notion of entropy power to Tsallis entropy and ensuing implications in estimation theory, are also briefly discussed.     

Extensive Rényi statistics from non-extensive entropy

We show that starting with either the non-extensive Tsallis entropy in Wang's formalism or the extensive Rényi entropy, it is possible to construct equilibrium non-Gibbs canonical distribution functions which satisfy the fundamental equations of thermodynamics. The statistical mechanics with Tsallis entropy does not satisfy the zeroth law of thermodynamics at dynamical and statistical independence request, whereas the extensive Rényi statistics fulfills all requirements of equilibrium thermodynamics in the microcanonical ensemble. Transformation formulas between Tsallis statistics in Wang representation and Rényi statistics are presented. The one-particle distribution function in Rényi statistics for a classical ideal gas at finite particle number has a power-law tail for large momenta.     

Radial velocities of open stellar clusters: A new solid constraint favouring Tsallis maximum entropy theory

In the present study we apply a Tsallis maximum entropy distribution law to the study of the stellar residual radial velocity in a sample of 13 stellar open clusters. From a comparison between results obtained from the analysis based on Tsallis law and on the one based on the Maxwellian law we show that the generalized Tsallis distribution fits more closely the observed distribution of the stellar residual radial velocities for these stellar clusters. We have found clear evidences that the q-parameter in the Tsallis generalized distribution depends on stellar cluster ages for clusters older than . There is also some indication that q increases with cluster galactocentric distance. The results obtained in this work represent an additional solid constraint in the stellar astrophysics favoring the Tsallis maximum entropy theory.     

Subadditivity and Strong Subadditivity Conditions for the Density Matrix of the Five-Level Atom

We obtain new quantum inequalities for von Neumann entropy of the five-level atom, which are analogs of the subadditivity condition known for bipartite quantum systems and the strong subadditivity condition known for tripartite quantum systems. We discuss the possibility to check the inequalities for the single qudit with j = 2, which can be realized as a five-level atom in the experiments with superconducting circuits. We present the strong subadditivity conditions for the finite-level atomic populations.     

Nonextensive random-matrix theory based on Kaniadakis entropy

The joint eigenvalue distributions of random-matrix ensembles are derived by applying the principle maximum entropy to the Rényi, Abe and Kaniadakis entropies. While the Rényi entropy produces essentially the same matrix-element distributions as the previously obtained expression by using the Tsallis entropy, and the Abe entropy does not lead to a closed form expression, the Kaniadakis entropy leads to a new generalized form of the Wigner surmise that describes a transition of the spacing distribution from chaos to order. This expression is compared with the corresponding expression obtained by assuming Tsallis' entropy as well as the results of a previous numerical experiment.     

Uniform Estimates on the Tsallis Entropies

By means of a probabilistic coupling technique, we establish some tight upper bounds on the variations of the Tsallis entropies in terms of the uniform distance. We treat both classical and quantum cases. The results provide some quantitative characterizations of the uniform continuity and stability properties of the Tsallis entropies. As direct consequences, we obtain the corresponding results for the Shannon entropy and the von Neumann entropy, which are stronger than the conventional ones.      

Markov entropy decomposition: a variational dual for quantum belief propagation

We present a lower bound for the free energy of a quantum many-body system at finite temperature. This lower bound is expressed as a convex optimization problem with linear constraints, and is derived using strong subadditivity of von Neumann entropy and a relaxation of the consistency condition of local density operators. The dual to this minimization problem leads to a set of quantum belief propagation equations, thus providing a firm theoretical foundation to that approach. The minimization problem is numerically tractable, and we find good agreement with quantum Monte Carlo calculations for spin-1/2 Heisenberg antiferromagnet in two dimensions. This lower bound complements other variational upper bounds. We discuss applications to Hamiltonian complexity theory and give a generalization of the structure theorem of [P. Hayden et al., Commun. Math. Phys. 246, 359 (2004).] to trees in an appendix.