Defining statistical relative complexity measure: Application to diversity in atoms

A statistical relative complexity measure, based on the Kullback-Leibler distance measure defining the relative information and the Carbó quantum similarity index defining the relative disequilibrium is proposed. It is shown that with the specific choice of prior density corresponding to the atom at the beginning of the subshell, this measure reveals the diversity of atoms as the subshells are filled across the periodic table. Numerical tests are reported using the non-relativistic Hartree-Fock as well as the relativistic Dirac-Fock density for all atoms in the periodic table.     

Entropy,Fisher Information and Variance with Frost-Musulin Potenial

This study presents the Shannon and Renyi information entropy for both position and momentum space and the Fisher information for the position-dependent mass Schrödinger equation with the Frost-Musulin potential. The analysis of the quantum mechanical probability has been obtained via the Fisher information. The variance information of this potential is equally computed. This controls both the chemical properties and physical properties of some of the molecular systems. We have observed the behaviour of the Shannon entropy. Renyi entropy, Fisher information and variance with the quantum number n respectively.     

A comparison of the Shannon and Kullback information measures

Two widely used information measures are compared. It is shown that the Kullback measure, unlike the Shannon measure, provides the basis for a consistent theory of information which extends to continuous sample spaces and to nonconstant prior distributions. It is shown that the Kullback measure is a generalization of the Shannon measure, and that the Kullback measure has more reasonable additivity properties than does the Shannon measure. The results lend support to Jaynes's entropy maximization procedure.     

Fisher information description of the classical-quantal transition

We investigate the classical limit of the dynamics of a semiclassical system that represents the interaction between matter and a given field. The concept of Fisher Information measure (F) on using as a quantifier of the process, we find that it adequately describes the transition, detecting the most salient details of the changeover. Used in conjunction with other possible information quantifiers, such as the Normalized Shannon Entropy (H) and the Statistical Complexity (C) by recourse to appropriate planar representations like the Fisher Entropy (F×H) and Fisher Complexity (F×C) planes, one obtains a better visualization of the transition than that provided by just one quantifier by itself. In the evaluation of these Information Theory quantifiers, we used the Bandt and Pompe methodology for the obtention of the corresponding probability distribution.     

Information-theoretical complexity for the hydrogenic abstraction reaction

In this work, we have investigated the complexity of the hydrogenic abstraction reaction by means of information functionals such as disequilibrium (D), exponential entropy (L), Fisher information (I), power entropy (J) and joint information-theoretic measures, i.e. the I–D, D–L and I–J planes and the Fisher–Shannon and López–Mancini–Calbet (LMC) shape complexities. The analysis of the information-theoretical functionals of the one-particle density was computed in position (r) and momentum (p) space. The analysis revealed that all of the chemically significant regions can be identified from the information functionals and most of the information-theoretical planes, i.e. the reactant/product regions (R/P), the transition state (TS), including those that are not present in the energy profile such as the bond cleavage energy region (BCER), and the bond breaking/forming regions (B–B/F). The analysis of the complexities shows that, in position as well as in the joint space, the energy profile of the abstraction reaction bears the same information-theoretical features as the LMC and FS measures. We discuss why most of the chemical features of interest, namely the BCER and B–B/F, are lost in the energy profile and that they are only revealed when particular information-theoretical aspects of localizability (L or J), uniformity (D) and disorder (I) are considered.     

Fisher Information and Complexity Measure of Generalized Morse Potential Model

The spreading of the quantum-mechanical probability distribution density of the three-dimensional system is quantitatively determined by means of the local information-theoretic quantity of the Shannon information and information energy in both position and momentum spaces. The complexity measure which is equivalent to Cramer-Rao uncertainty product is determined. We have obtained the information content stored, the concentration of quantum system and complexity measure numerically for n=0, 1, 2 and 3 respectively.     

Information dynamics: temporal behavior of uncertainty measures

We carry out a systematic study of uncertainty measures that are generic to dynamical processes of varied origins, provided they induce suitable continuous probability distributions. The major technical tools are the information theory methods and inequalities satisfied by Fisher and Shannon information measures. We focus on the compatibility of these inequalities with the prescribed (deterministic, random or quantum) temporal behavior of pertinent probability densities.      

Rigorous properties and uncertainty-like relationships on product-complexity measures: Application to atomic systems

Most of research on complexities and the corresponding conclusions have been obtained by numerically quantifying their values, and little attention has been paid to their theoretical properties and the exact meaning within an statistical framework, valid for any arbitrary n-dimensional distribution. In the present work, different product-complexities, constructed as a product of two relevant information quantities associated to the concepts of uncertainty and localization are investigated. Different results on product-complexities, such as rigorous bounds, uncertainty-like inequalities, relationships among themselves and also statistical interpretations are given. For the sake of completeness, some of these analytical results on product-complexities are numerically checked for the one-particle densities of atomic systems in both conjugated spaces.     

Some Information Measures Properties of the GOS-Concomitants from the FGM Family

In this paper we recall, extend and compute some information measures for the concomitants of the generalized order statistics (GOS) from the Farlie–Gumbel–Morgenstern (FGM) family. We focus on two types of information measures: some related to Shannon entropy, and some related to Tsallis entropy. Among the information measures considered are residual and past entropies which are important in a reliability context.     

Informational analysis of seismic sequences by applying the Fisher Information Measure and the Shannon entropy: An application to the 2004–2010 seismicity of Aswan area (Egypt)

The interevent-time (IET) and interevent-distance (IED) series of seismic events occurred at Aswan area (Egypt) from 2004 to 2010 were investigated by means of the Fisher Information Measure and the Shannon entropy. The analysis was performed varying the depth and the magnitude thresholds. The results point out to an increase of level of organization and order with the decrease of magnitude threshold and the increase of depth threshold for the IET series, while the IED series are characterized by a level of uncertainty approximately constant with the threshold magnitude. The complexity measure, calculated as the product of the Fisher Information Measure and the Shannon entropy power, presents very similar pattern for both the types of seismic series, indicating an increasing complexity with the decrease of the threshold magnitude and the increase of the threshold depth.     

Analysis of dynamics in magnetotelluric data by using the Fisher-Shannon method

The Fisher-Shannon information (FS) plane, defined by the Fisher information measure and the Shannon entropy power, is used to investigate the complex dynamics of magnetotelluric data of three stations in Taiwan. In the FS plane the electric and magnetic components are significantly separated, characterized by different degrees of order. Further investigation shows that signals measured in areas with very high level of seismic activity are well discriminated.     

Onicescu information energy in terms of Shannon entropy and Fisher information densities

Following recent studies concerning the use of information theory in electronic structure theory of atomic and molecular systems, an analytical relationship between Onicescu information energy and densities of Shannon entropy and the two forms of the Fisher information has been presented. The established proof must be viewed in the light of the exponentially decaying nature of the asymptotic density of atoms and molecules.     

Shakespeare and other English Renaissance authors as characterized by Information Theory complexity quantifiers

We introduce novel Information Theory quantifiers in a computational linguistic study that involves a large corpus of English Renaissance literature. The 185 texts studied (136 plays and 49 poems in total), with first editions that range from 1580 to 1640, form a representative set of its period. Our data set includes 30 texts unquestionably attributed to Shakespeare; in addition we also included A Lover’s Complaint, a poem which generally appears in Shakespeare collected editions but whose authorship is currently in dispute. Our statistical complexity quantifiers combine the power of Jensen-Shannon’s divergence with the entropy variations as computed from a probability distribution function of the observed word use frequencies. Our results show, among other things, that for a given entropy poems display higher complexity than plays, that Shakespeare’s work falls into two distinct clusters in entropy, and that his work is remarkable for its homogeneity and for its closeness to overall means.     

Comparison of information-theoretic products and inequalities for the lowest bound and unbound electronic states of H2+ based on exact calculation

A study of information-theoretic properties of molecular bond on the example of the ground (bound) $1s{\sigma }_g$ and the lowest excited (unbound) $2p{\sigma }_u$ states of H${}_2^{+}$ was conducted. Data about general information-theoretic measures, information products (Cramér-Rao, Fisher-Shannon information, and LMC complexity) and their inequalities in position and momentum spaces as a function of internuclear distance $R=0.2$–20 a.u. were obtained by an exact numerical calculation of the wave function. A systematic correlation between these information products was established. It was found that LMC complexity is most sensitive and detailed among these information products. A clear correlation between accuracy of determination of energy and information products in the simplest LCAO model compared to results of the exact calculation was observed.     

The Fisher information measure and Shannon entropy for particulate matter measurements

We investigated the dynamics of particulate matter data, recorded in Tito, a small industrial area of southern Italy. The analysis of these signals was performed using the Fisher information measure (FIM), which is a powerful tool for investigating complex and nonstationary signals, and the Shannon entropy, which is a well-known tool for investigating the degree of disorder in dynamical systems. Our results point to an increase of disorder and complexity from fine to coarse particulates.     

Correlation and entanglement of a three-level atom inside a dissipative cavity

We discuss the correlation and entanglement of a three-level atom with a single-mode quantized field in a coherent state inside a phase-damped cavity. We analyze the influence of dissipation on the quantum and classical entropy. It has been shown that the quantum, classical and nonextensive entropy are sensitive to any change in the initial state setting of the atom and the quantized field. The relation between the long lived entanglement and dissipation is observed. On the other hand, a short disentanglement can be generated through special values of the atomic motion parameter.     

Maximum Shannon Entropy, Minimum Fisher Information, and an Elementary Game

We formulate an elementary statistical game which captures the essence of some fundamental quantum experiments such as photon polarization and spin measurement. We explore and compare the significance of the principle of maximum Shannon entropy and the principle of minimum Fisher information in solving such a game. The solution based on the principle of minimum Fisher information coincides with the solution based on an invariance principle, and provides an informational explanation of Malus' law for photon polarization. There is no solution based on the principle of maximum Shannon entropy. The result demonstrates the merits of Fisher information, and the demerits of Shannon entropy, in treating some fundamental quantum problems. It also provides a quantitative example in support of a general philosophy: Nature intends to hide Fisher information, while obeying some simple rules.