Channel-Supermodular Entropies: Order Theory and an Application to Query Anonymization

This work introduces channel-supermodular entropies, a subset of quasi-concave entropies. Channel-supermodularity is a property shared by some of the most commonly used entropies in the literature, including Arimoto–Rényi conditional entropies (which include Shannon and min-entropy as special cases), k-tries entropies, and guessing entropy. Based on channel-supermodularity, new preorders for channels that strictly include degradedness and inclusion (or Shannon ordering) are defined, and these preorders are shown to provide a sufficient condition for the more-capable and capacity ordering, not only for Shannon entropy but also regarding analogous concepts for other entropy measures. The theory developed is then applied in the context of query anonymization. We introduce a greedy algorithm based on channel-supermodularity for query anonymization and prove its optimality, in terms of information leakage, for all symmetric channel-supermodular entropies.     

A note on bounded entropies

The aim of the paper is to study the link between non-additivity of some entropies and their boundedness. We propose an axiomatic construction of the entropy relying on the fact that entropy belongs to a group isomorphic to the usual additive group. This allows to show that the entropies that are additive with respect to the addition of the group for independent random variables are nonlinear transforms of the Rényi entropies, including the particular case of the Shannon entropy. As a particular example, we study as a group a bounded interval in which the addition is a generalization of the addition of velocities in special relativity. We show that Tsallis–Havrda–Charvat entropy is included in the family of entropies we define. Finally, a link is made between the approach developed in the paper and the theory of deformed logarithms.     

Uniform Estimates on the Tsallis Entropies

By means of a probabilistic coupling technique, we establish some tight upper bounds on the variations of the Tsallis entropies in terms of the uniform distance. We treat both classical and quantum cases. The results provide some quantitative characterizations of the uniform continuity and stability properties of the Tsallis entropies. As direct consequences, we obtain the corresponding results for the Shannon entropy and the von Neumann entropy, which are stronger than the conventional ones.      

General Bell-CHSH type and entropic inequalities based on quantum tomograms

Review of Bell-CHSH type and entropic inequalities in composite quantum correlated systems in the probability representation of states is presented. The upper bounds for some new Bell-CHSH type inequalities within the framework of classical probability theory and in quantum tomography are compared. Violation of Bell-CHSH type inequalities are shown explicitly using the method of averaging in tomographic picture of quantum states. Joint tomographic entropies of multiqubit systems are studied. Limitations on inequalities for tomographic entropies are obtained. A negative result of possible connection between the violation of entropic and Bell-CHSH type inequalities in multi-partite states is reported.     

Entropy computing via integration over fractal measures

We discuss the properties of invariant measures corresponding to iterated function systems (IFSs) with place-dependent probabilities and compute their Renyi entropies, generalized dimensions, and multifractal spectra. It is shown that with certain dynamical systems, one can associate the corresponding IFSs in such a way that their generalized entropies are equal. This provides a new method of computing entropy for some classical and quantum dynamical systems. Numerical techniques are based on integration over the fractal measures. (c) 2000 American Institute of Physics.     

Legendre structure of the thermostatistics theory based on the Sharma–Taneja–Mittal entropy

The statistical proprieties of complex systems can differ deeply for those of classical systems governed by Boltzmann–Gibbs entropy. In particular, the probability distribution function observed in several complex systems shows a power-law behavior in the tail which disagrees with the standard exponential behavior showed by Gibbs distribution. Recently, a two-parameter deformed family of entropies, previously introduced by Sharma, Taneja and Mittal (STM), has been reconsidered in the statistical mechanics framework. Any entropy belonging to this family admits a probability distribution function with an asymptotic power-law behavior. In the present work we investigate the Legendre structure of the thermostatistics theory based on this family of entropies. We introduce some generalized thermodynamical potentials, study their relationships with the entropy and discuss their main proprieties. Specialization of the results to some one-parameter entropies belonging to the STM family are presented.     

Tomographic probability and entropic inequalities for special functions

We discussed some aspects of the tomographic-probability representation of quantum mechanics. Using known generic inequalities for Shannon and relative entropies, we obtain some new inequalities for special functions such as Laguerre, Legendre, and two-variable Hermite polynomials.     

The entropies of liquid rare earth metals

The entropies of the liquid rare earths are explained using hypotheses about the electronic structure which closely parallel some believed to be correct for the corresponding solids.     

Some General Properties of Unified Entropies

Basic properties of the unified entropies are examined. The consideration is mainly restricted to the finite-dimensional quantum case. Bounds in terms of ensembles of quantum states are given. Both the continuity in Fannes’ sense and stability in Lesche’s sense are shown for wide ranges of parameters. In particular, uniform estimates are obtained for the quantum Rényi entropies. Stability properties in the thermodynamic limit are discussed as well. It is shown that the unified entropies enjoy both the subadditivity and triangle inequality for a certain range of parameters. Non-decreasing of all the unified entropies under projective measurements is proved.     

Influence of the External Classical Field on the Entanglement of a Two-Level Atom

The atomic and the field entropies of a two-level atom, which is additionally driven by an external classical field are investigated. Under a certain canonical transformation for the excited and ground states the system is transformed into the usual JCM. Using the equations of motion in the Heisenberg picture exact solutions for the time-dependent dynamical operators are obtained. The entanglement between atom-field system is studied by using the atomic and the field entropies. Also we use the concurrence to detect the sudden death phenomenon and the relationship between entropies and the concurrence of the entanglement are discussed. It is shown that the amount of entanglement, the atomic and the field entropies of the subsystem can be improved by controlling the external classical field.     

A general nonlinear Fokker-Planck equation and its associated entropy

A recently introduced nonlinear Fokker-Planck equation, derived directly from a master equation, comes out as a very general tool to describe phenomenologically systems presenting complex behavior, like anomalous diffusion, in the presence of external forces. Such an equation is characterized by a nonlinear diffusion term that may present, in general, two distinct powers of the probability distribution. Herein, we calculate the stationary-state distributions of this equation in some special cases, and introduce associated classes of generalized entropies in order to satisfy the H-theorem. Within this approach, the parameters associated with the transition rates of the original master-equation are related to such generalized entropies, and are shown to obey some restrictions. Some particular cases are discussed.     

Escort entropies and divergences and related canonical distribution

We discuss two families of two-parameter entropies and divergences, derived from the standard Rényi and Tsallis entropies and divergences. These divergences and entropies are found as divergences or entropies of escort distributions. Exploiting the nonnegativity of the divergences, we derive the expression of the canonical distribution associated to the new entropies and a observable given as an escort-mean value. We show that this canonical distribution extends, and smoothly connects, the results obtained in nonextensive thermodynamics for the standard and generalized mean value constraints.     

Entropy and Ergodicity of Boole-Type Transformations

We review some analytic, measure-theoretic and topological techniques for studying ergodicity and entropy of discrete dynamical systems, with a focus on Boole-type transformations and their generalizations. In particular, we present a new proof of the ergodicity of the 1-dimensional Boole map and prove that a certain 2-dimensional generalization is also ergodic. Moreover, we compute and demonstrate the equivalence of metric and topological entropies of the 1-dimensional Boole map employing “compactified”representations and well-known formulas. Several examples are included to illustrate the results. We also introduce new multidimensional Boole-type transformations invariant with respect to higher dimensional Lebesgue measures and investigate their ergodicity and metric and topological entropies.     

Some Properties of the kth-partial Rényi Entropy

The kth-partial Rényi entropies for both classical and quantum cases are defined and some properties of them are given. Also, we study the stability of kth-partial Rényi entropy for two states which satisfy majorization condition.     

Thermodynamic properties of ternary alloys from Monte Carlo simulations

Methods are presented for obtaining both the integral and partial molar energies, entropies and free energies of the components in rigid ternary substitutional alloy systems from the one Monte Carlo simulation. Tests of the methods for some model systems are presented and discussed.     

On the way towards a generalized entropy maximization procedure

We propose a generalized entropy maximization procedure, which takes into account the generalized averaging procedures and information gain definitions underlying the generalized entropies. This novel generalized procedure is then applied to Rényi and Tsallis entropies. The generalized entropy maximization procedure for Rényi entropies results in the exponential stationary distribution asymptotically for q∈(0,1] in contrast to the stationary distribution of the inverse power law obtained through the ordinary entropy maximization procedure. Another result of the generalized entropy maximization procedure is that one can naturally obtain all the possible stationary distributions associated with the Tsallis entropies by employing either ordinary or q-generalized Fourier transforms in the averaging procedure.     

Two-Parameter Entropies in Extended Parastatistics of Nonextensive Systems

Russian Physics Journal - General expressions are given for entropies from which one-parameter and two-parameter entropies for quantum nonextensive systems follow in extended parastatistics.     

Manipulating many-body quantum states via single-photon resonance

For an atomic Bose-Hubbard dimer quantum control via multiphoton processes have been investigated widely. We here explore how to manipulate the many-body quantum states via single-photon resonance by treating the periodic driving as a weak perturbation. The transition probabilities up to second-order approximation are given as functions of the driving parameters, which are considerable only for the single-photon resonance case. Due to some transition matrix elements vanishing, the first-order quantum transition obeys a selection rule. The non-forbidden transitions involve states of different entanglement entropies and all (part) of the forbidden transitions relate to the entropy balances between two states for odd (even) number of particles. The results provide a new route for manipulating many-body quantum states and entanglement entropies, and controlling the atomic tunnelings of the Bose-Hubbard dimer.     

Bell-type inequalities and tomographic entropies of multiqudit states

Tomographic entropies of multiqudit systems are studied. A comparison of Shannon and von Neumann entropic inequalities with analogous inequalities for tomographic entropies is presented. An attempt to associate the violation of these and Bell-type inequalities of multipartite states is done within the framework of tomographic probability theory.     

Uncertainty relations expressed by Shannon-like entropies

Besides the well-known Shannon entropy, there is a set of Shannon-like entropies which have applications in statistical and quantum physics. These entropies are functions of certain parameters and converge toward Shannon entropy when these parameters approach the value 1. We describe briefly the most important Shannon-like entropies and present their graphical representations. Their graphs look almost identical, though by superimposing them it appears that they are distinct and characteristic of each Shannon-like entropy. We try to formulate the alternative entropic uncertainty relations by means of the Shannon-like entropies and show that all of them equally well express the uncertainty principle of quantum physics.