Kernel Estimation of Cumulative Residual Tsallis Entropy and Its Dynamic Version under ρ-Mixing Dependent Data

Tsallis introduced a non-logarithmic generalization of Shannon entropy, namely Tsallis entropy, which is non-extensive. Sati and Gupta proposed cumulative residual information based on this non-extensive entropy measure, namely cumulative residual Tsallis entropy (CRTE), and its dynamic version, namely dynamic cumulative residual Tsallis entropy (DCRTE). In the present paper, we propose non-parametric kernel type estimators for CRTE and DCRTE where the considered observations exhibit an ρ-mixing dependence condition. Asymptotic properties of the estimators were established under suitable regularity conditions. A numerical evaluation of the proposed estimator is exhibited and a Monte Carlo simulation study was carried out.     

Stochastic Properties of Fractional Generalized Cumulative Residual Entropy and Its Extensions

The fractional generalized cumulative residual entropy (FGCRE) has been introduced recently as a novel uncertainty measure which can be compared with the fractional Shannon entropy. Various properties of the FGCRE have been studied in the literature. In this paper, further results for this measure are obtained. The results include new representations of the FGCRE and a derivation of some bounds for it. We conduct a number of stochastic comparisons using this measure and detect the connections it has with some well-known stochastic orders and other reliability measures. We also show that the FGCRE is the Bayesian risk of a mean residual lifetime (MRL) under a suitable prior distribution function. A normalized version of the FGCRE is considered and its properties and connections with the Lorenz curve ordering are studied. The dynamic version of the measure is considered in the context of the residual lifetime and appropriate aging paths.     

Cumulative Residual q-Fisher Information and Jensen-Cumulative Residual χ2 Divergence Measures

In this work, we define cumulative residual q-Fisher (CRQF) information measures for the survival function (SF) of the underlying random variables as well as for the model parameter. We also propose q-hazard rate (QHR) function via q-logarithmic function as a new extension of hazard rate function. We show that CRQF information measure can be expressed in terms of the QHR function. We define further generalized cumulative residual χ2 divergence measures between two SFs. We then examine the cumulative residual q-Fisher information for two well-known mixture models, and the corresponding results reveal some interesting connections between the cumulative residual q-Fisher information and the generalized cumulative residual χ2 divergence measures. Further, we define Jensen-cumulative residual χ2 (JCR-χ2) measure and a parametric version of the Jensen-cumulative residual Fisher information measure and then discuss their properties and inter-connections. Finally, for illustrative purposes, we examine a real example of image processing and provide some numerical results in terms of the CRQF information measure.     

Alternative Entropy Measures and Generalized Khinchin–Shannon Inequalities

The Khinchin–Shannon generalized inequalities for entropy measures in Information Theory, are a paradigm which can be used to test the Synergy of the distributions of probabilities of occurrence in physical systems. The rich algebraic structure associated with the introduction of escort probabilities seems to be essential for deriving these inequalities for the two-parameter Sharma–Mittal set of entropy measures. We also emphasize the derivation of these inequalities for the special cases of one-parameter Havrda–Charvat’s, Rényi’s and Landsberg–Vedral’s entropy measures.     

Inference for a Kavya–Manoharan Inverse Length Biased Exponential Distribution under Progressive-Stress Model Based on Progressive Type-II Censoring

In this article, a new one parameter survival model is proposed using the Kavya–Manoharan (KM) transformation family and the inverse length biased exponential (ILBE) distribution. Statistical properties are obtained: quantiles, moments, incomplete moments and moment generating function. Different types of entropies such as Rényi entropy, Tsallis entropy, Havrda and Charvat entropy and Arimoto entropy are computed. Different measures of extropy such as extropy, cumulative residual extropy and the negative cumulative residual extropy are computed. When the lifetime of the item under use is assumed to follow the Kavya–Manoharan inverse length biased exponential (KMILBE) distribution, the progressive-stress accelerated life tests are considered. Some estimating approaches, such as the maximum likelihood, maximum product of spacing, least squares, and weighted least square estimations, are taken into account while using progressive type-II censoring. Furthermore, interval estimation is accomplished by determining the parameters’ approximate confidence intervals. The performance of the estimation approaches is investigated using Monte Carlo simulation. The relevance and flexibility of the model are demonstrated using two real datasets. The distribution is very flexible, and it outperforms many known distributions such as the inverse length biased, the inverse Lindley model, the Lindley, the inverse exponential, the sine inverse exponential and the sine inverse Rayleigh model.     

Some Further Results on the Fractional Cumulative Entropy

In this paper, the fractional cumulative entropy is considered to get its further properties and also its developments to dynamic cases. The measure is used to characterize a family of symmetric distributions and also another location family of distributions. The links between the fractional cumulative entropy and the classical differential entropy and some reliability quantities are also unveiled. In addition, the connection the measure has with the standard deviation is also found. We provide some examples to establish the variability property of this measure.     

Sufficient Conditions of the Same State Order Induced by Coherence

In this paper, we study coherence-induced state ordering with Tsallis relative entropy of coherence, relative entropy of coherence and l₁ norm of coherence, and give the sufficient conditions of the same state order induced by above coherence measures. First, we show that the above measures give the same ordering for single-qubit states in some special cases. Second, we consider some special states in a d-dimensional quantum system. We show that the above measures generate the same ordering for these special states. Finally, we discuss dynamics of coherence-induced state ordering under Markovian channels. We find amplitude damping channel changes the coherence-induced ordering even though for single-qubit states with fixed mixedness.     

On the α-q-Mutual Information and the α-q-Capacities

The measures of information transfer which correspond to non-additive entropies have intensively been studied in previous decades. The majority of the work includes the ones belonging to the Sharma–Mittal entropy class, such as the Rényi, the Tsallis, the Landsberg–Vedral and the Gaussian entropies. All of the considerations follow the same approach, mimicking some of the various and mutually equivalent definitions of Shannon information measures, and the information transfer is quantified by an appropriately defined measure of mutual information, while the maximal information transfer is considered as a generalized channel capacity. However, all of the previous approaches fail to satisfy at least one of the ineluctable properties which a measure of (maximal) information transfer should satisfy, leading to counterintuitive conclusions and predicting nonphysical behavior even in the case of very simple communication channels. This paper fills the gap by proposing two parameter measures named the α-q-mutual information and the α-q-capacity. In addition to standard Shannon approaches, special cases of these measures include the α-mutual information and the α-capacity, which are well established in the information theory literature as measures of additive Rényi information transfer, while the cases of the Tsallis, the Landsberg–Vedral and the Gaussian entropies can also be accessed by special choices of the parameters α and q. It is shown that, unlike the previous definition, the α-q-mutual information and the α-q-capacity satisfy the set of properties, which are stated as axioms, by which they reduce to zero in the case of totally destructive channels and to the (maximal) input Sharma–Mittal entropy in the case of perfect transmission, which is consistent with the maximum likelihood detection error. In addition, they are non-negative and less than or equal to the input and the output Sharma–Mittal entropies, in general. Thus, unlike the previous approaches, the proposed (maximal) information transfer measures do not manifest nonphysical behaviors such as sub-capacitance or super-capacitance, which could qualify them as appropriate measures of the Sharma–Mittal information transfer.     

Refined Young Inequality and Its Application to Divergences

We give bounds on the difference between the weighted arithmetic mean and the weighted geometric mean. These imply refined Young inequalities and the reverses of the Young inequality. We also studied some properties on the difference between the weighted arithmetic mean and the weighted geometric mean. Applying the newly obtained inequalities, we show some results on the Tsallis divergence, the Rényi divergence, the Jeffreys–Tsallis divergence and the Jensen–Shannon–Tsallis divergence.     

Pathway model,superstatistics, Tsallis statistics,and a generalized measure of entropy

The pathway model of Mathai [A pathway to matrix-variate gamma and normal densities, Linear Algebra Appl. 396 (2005) 317–328] is shown to be inferable from the maximization of a certain generalized entropy measure. This entropy is a variant of the generalized entropy of order α$\alpha$, considered in Mathai and Rathie [Basic Concepts in Information Theory and Statistics: Axiomatic Foundations and Applications, Wiley Halsted, New York and Wiley Eastern, New Delhi, 1975], and it is also associated with Shannon, Boltzmann–Gibbs, Rényi, Tsallis, and Havrda–Charvát entropies. The generalized entropy measure introduced here is also shown to have interesting statistical properties and it can be given probabilistic interpretations in terms of inaccuracy measure, expected value, and information content in a scheme. Particular cases of the pathway model are shown to be Tsallis statistics [C. Tsallis, Possible generalization of Boltzmann-Gibbs statistics, J. Stat. Phys. 52 (1988) 479–487] and superstatistics introduced by Beck and Cohen [Superstatistics, Physica A 322 (2003) 267–275]. The pathway model's connection to fractional calculus is illustrated by considering a fractional reaction equation.     

Discrete Versions of Jensen–Fisher,Fisher and Bayes–Fisher Information Measures of Finite Mixture Distributions

In this work, we first consider the discrete version of Fisher information measure and then propose Jensen–Fisher information, to develop some associated results. Next, we consider Fisher information and Bayes–Fisher information measures for mixing parameter vector of a finite mixture probability mass function and establish some results. We provide some connections between these measures with some known informational measures such as chi-square divergence, Shannon entropy, Kullback–Leibler, Jeffreys and Jensen–Shannon divergences.     

A Two-Parameter Fractional Tsallis Decision Tree

Decision trees are decision support data mining tools that create, as the name suggests, a tree-like model. The classical C4.5 decision tree, based on the Shannon entropy, is a simple algorithm to calculate the gain ratio and then split the attributes based on this entropy measure. Tsallis and Renyi entropies (instead of Shannon) can be employed to generate a decision tree with better results. In practice, the entropic index parameter of these entropies is tuned to outperform the classical decision trees. However, this process is carried out by testing a range of values for a given database, which is time-consuming and unfeasible for massive data. This paper introduces a decision tree based on a two-parameter fractional Tsallis entropy. We propose a constructionist approach to the representation of databases as complex networks that enable us an efficient computation of the parameters of this entropy using the box-covering algorithm and renormalization of the complex network. The experimental results support the conclusion that the two-parameter fractional Tsallis entropy is a more sensitive measure than parametric Renyi, Tsallis, and Gini index precedents for a decision tree classifier.     

On generalized distributions and pathways

The scalar version of the pathway model of Mathai [A.M. Mathai, Linear Alg. Appl. 396 (2005) 317] is shown to be associated with a large number of probability models used in physics. Different families of densities are listed here, which are all connected through the pathway parameter α, generating a distributional pathway. The idea is to switch from one functional form to another through this parameter and it is shown that one can proceed from the generalized type-1 beta family to generalized type-2 beta family to generalized gamma family. It is also shown that the pathway model is available by maximizing a generalized measure of entropy, leading to an entropic pathway, covering the particularly interesting cases of Tsallis statistics [C. Tsallis, J. Stat. Phys. 52 (1988) 479] and superstatistics [C. Beck, E.G.D. Cohen, Physica A 322 (2003) 267].     

On Conditional Tsallis Entropy

There is no generally accepted definition for conditional Tsallis entropy. The standard definition of (unconditional) Tsallis entropy depends on a parameter α that converges to the Shannon entropy as α approaches 1. In this paper, we describe three proposed definitions of conditional Tsallis entropy suggested in the literature—their properties are studied and their values, as a function of α, are compared. We also consider another natural proposal for conditional Tsallis entropy and compare it with the existing ones. Lastly, we present an online tool to compute the four conditional Tsallis entropies, given the probability distributions and the value of the parameter α.     

The Information Loss of a Stochastic Map

We provide a stochastic extension of the Baez–Fritz–Leinster characterization of the Shannon information loss associated with a measure-preserving function. This recovers the conditional entropy and a closely related information-theoretic measure that we call conditional information loss. Although not functorial, these information measures are semi-functorial, a concept we introduce that is definable in any Markov category. We also introduce the notion of an entropic Bayes’ rule for information measures, and we provide a characterization of conditional entropy in terms of this rule.     

Distributivity and deformation of the reals from Tsallis entropy

We propose a one-parameter family R_q of deformations of the reals, which is motivated by the generalized additivity of the Tsallis entropy. We introduce a generalized multiplication which is distributive with respect to the generalized addition of the Tsallis entropy. These operations establish a one-parameter family of field isomorphisms τ_q between R and R_q through which an absolute value on R_q is introduced. This turns out to be a quasisymmetric map, whose metric and measure-theoretical implications are pointed out.     

Radial velocities of open stellar clusters: A new solid constraint favouring Tsallis maximum entropy theory

In the present study we apply a Tsallis maximum entropy distribution law to the study of the stellar residual radial velocity in a sample of 13 stellar open clusters. From a comparison between results obtained from the analysis based on Tsallis law and on the one based on the Maxwellian law we show that the generalized Tsallis distribution fits more closely the observed distribution of the stellar residual radial velocities for these stellar clusters. We have found clear evidences that the q-parameter in the Tsallis generalized distribution depends on stellar cluster ages for clusters older than . There is also some indication that q increases with cluster galactocentric distance. The results obtained in this work represent an additional solid constraint in the stellar astrophysics favoring the Tsallis maximum entropy theory.     

From Rényi Entropy Power to Information Scan of Quantum States

In this paper, we generalize the notion of Shannon’s entropy power to the Rényi-entropy setting. With this, we propose generalizations of the de Bruijn identity, isoperimetric inequality, or Stam inequality. This framework not only allows for finding new estimation inequalities, but it also provides a convenient technical framework for the derivation of a one-parameter family of Rényi-entropy-power-based quantum-mechanical uncertainty relations. To illustrate the usefulness of the Rényi entropy power obtained, we show how the information probability distribution associated with a quantum state can be reconstructed in a process that is akin to quantum-state tomography. We illustrate the inner workings of this with the so-called “cat states”, which are of fundamental interest and practical use in schemes such as quantum metrology. Salient issues, including the extension of the notion of entropy power to Tsallis entropy and ensuing implications in estimation theory, are also briefly discussed.     

Stochastic and Self-Organisation Patterns in a 17-Year PM10 Time Series in Athens,Greece

This paper utilises statistical and entropy methods for the investigation of a 17-year PM₁₀ time series recorded from five stations in Athens, Greece, in order to delineate existing stochastic and self-organisation trends. Stochastic patterns are analysed via lumping and sliding, in windows of various lengths. Decreasing trends are found between Windows 1 and 3500–4000, for all stations. Self-organisation is studied through Boltzmann and Tsallis entropy via sliding and symbolic dynamics in selected parts. Several values are below −2 (Boltzmann entropy) and 1.18 (Tsallis entropy) over the Boltzmann constant. A published method is utilised to locate areas for which the PM₁₀ system is out of stochastic behaviour and, simultaneously, exhibits critical self-organised tendencies. Sixty-six two-month windows are found for various dates. From these, nine are common to at least three different stations. Combining previous publications, two areas are non-stochastic and exhibit, simultaneously, fractal, long-memory and self-organisation patterns through a combination of 15 different fractal and SOC analysis techniques. In these areas, block-entropy (range 0.650–2.924) is significantly lower compared to the remaining areas of non-stochastic but self-organisation trends. It is the first time to utilise entropy analysis for PM₁₀ series and, importantly, in combination with results from previously published fractal methods.Data Set License: license under which the dataset is made available (CC0, CC-BY, CC-BY-SA, CC-BY-NC, etc.)     

Non-Equilibrium Entropy and Irreversibility in Generalized Stochastic Loewner Evolution from an Information-Theoretic Perspective

In this study, we theoretically investigated a generalized stochastic Loewner evolution (SLE) driven by reversible Langevin dynamics in the context of non-equilibrium statistical mechanics. Using the ability of Loewner evolution, which enables encoding of non-equilibrium systems into equilibrium systems, we formulated the encoding mechanism of the SLE by Gibbs entropy-based information-theoretic approaches to discuss its advantages as a means to better describe non-equilibrium systems. After deriving entropy production and flux for the 2D trajectories of the generalized SLE curves, we reformulated the system’s entropic properties in terms of the Kullback–Leibler (KL) divergence. We demonstrate that this operation leads to alternative expressions of the Jarzynski equality and the second law of thermodynamics, which are consistent with the previously suggested theory of information thermodynamics. The irreversibility of the 2D trajectories is similarly discussed by decomposing the entropy into additive and non-additive parts. We numerically verified the non-equilibrium property of our model by simulating the long-time behavior of the entropic measure suggested by our formulation, referred to as the relative Loewner entropy.