An inequality connecting entropy distance,Fisher Information and large deviations

In this paper we introduce a new generalisation of the relative Fisher Information for Markov jump processes on a finite or countable state space, and prove an inequality which connects this object with the relative entropy and a large deviation rate functional. In addition to possessing various favourable properties, we show that this generalised Fisher Information converges to the classical Fisher Information in an appropriate limit. We then use this generalised Fisher Information and the aforementioned inequality to qualitatively study coarse-graining problems for jump processes on discrete spaces.     

An Improved Composite Multiscale Fuzzy Entropy for Feature Extraction of MI-EEG

Motor Imagery Electroencephalography (MI-EEG) has shown good prospects in neurorehabilitation, and the entropy-based nonlinear dynamic methods have been successfully applied to feature extraction of MI-EEG. Especially based on Multiscale Fuzzy Entropy (MFE), the fuzzy entropies of the τ coarse-grained sequences in τ scale are calculated and averaged to develop the Composite MFE (CMFE) with more feature information. However, the coarse-grained process fails to match the nonstationary characteristic of MI-EEG by a mean filtering algorithm. In this paper, CMFE is improved by assigning the different weight factors to the different sample points in the coarse-grained process, i.e., using the weighted mean filters instead of the original mean filters, which is conductive to signal filtering and feature extraction, and the resulting personalized Weighted CMFE (WCMFE) is more suitable to represent the nonstationary MI-EEG for different subjects. All the WCMFEs of multi-channel MI-EEG are fused in serial to construct the feature vector, which is evaluated by a back-propagation neural network. Based on a public dataset, extensive experiments are conducted, yielding a relatively higher classification accuracy by WCMFE, and the statistical significance is examined by two-sample t-test. The results suggest that WCMFE is superior to the other entropy-based and traditional feature extraction methods.     

Space-Time Directional Lyapunov Exponents for Cellular Automata

Space-time directional Lyapunov exponents are introduced. They describe the maximal velocity of propagation to the right or to the left of fronts of perturbations in a frame moving with a given velocity. The continuity of these exponents as function of the velocity and an inequality relating them to the directional entropy is proved.     

A possible counterexample to well posedness of entropy solutions and to Godunov scheme convergence

A particular case of initial data for the two-dimensional Euler equations is studied numerically. The results show that the Godunov method does not always converge to the physical solution, at least not on feasible grids. Moreover, they suggest that entropy solutions (in the weak entropy inequality sense) are not well posed.

     

(Anti-)de Sitter Black Hole Entropy and Generalized Uncertainty Principle

We generalize the method that is used to study corrections to Cardy-Verlinde formula due to generalized uncertainty principle and discuss corrections to Cardy-Verlinde formula due to generalized uncertainty principle in (anti)-de Sitter space. Because in de Sitter black hole spacetime the radiation temperature of the black hole horizon is different from the one of the cosmological horizon, this spacetime is a thermodynamical non-equilibrium spacetime.     

Maximum Shannon Entropy, Minimum Fisher Information, and an Elementary Game

We formulate an elementary statistical game which captures the essence of some fundamental quantum experiments such as photon polarization and spin measurement. We explore and compare the significance of the principle of maximum Shannon entropy and the principle of minimum Fisher information in solving such a game. The solution based on the principle of minimum Fisher information coincides with the solution based on an invariance principle, and provides an informational explanation of Malus' law for photon polarization. There is no solution based on the principle of maximum Shannon entropy. The result demonstrates the merits of Fisher information, and the demerits of Shannon entropy, in treating some fundamental quantum problems. It also provides a quantitative example in support of a general philosophy: Nature intends to hide Fisher information, while obeying some simple rules.     

Entropy for frame bundle systems and Grassmann bundle systems induced by a diffeomorphism

A Liao hyperbolic diffeomorphism has equal measure entropy and topological entropy to that of its induced systems on frame bundles and Grassmann bundles. This solves a problem Liao posed in 1996 for Liao hyperbolic diffeomorphisms.     

Differential Entropy and Dynamics of Uncertainty

We analyze the functioning of Gibbs-type entropy functionals in the time domain, with emphasis on Shannon and Kullback-Leibler entropies of time-dependent continuous probability distributions. The Shannon entropy validity is extended to probability distributions inferred from L ²(R ⁿ ) quantum wave packets. In contrast to the von Neumann entropy which simply vanishes on pure states, the differential entropy quantifies the degree of probability (de)localization and its time development. The associated dynamics of the Fisher information functional quantifies nontrivial power transfer processes in the mean, both in dissipative and quantum mechanical cases. PACS NUMBERS: 05.45.+b, 02.50.-r, 03.65.Ta, 03.67.-a     

Multidimensional transonic shocks and free boundary problems for nonlinear equations of mixed type

We establish the existence and stability of multidimensional transonic shocks for the Euler equations for steady potential compressible fluids. The Euler equations, consisting of the conservation law of mass and the Bernoulli law for the velocity, can be written as a second-order, nonlinear equation of mixed elliptic-hyperbolic type for the velocity potential. The transonic shock problem can be formulated into the following free boundary problem: The free boundary is the location of the transonic shock which divides the two regions of smooth flow, and the equation is hyperbolic in the upstream region where the smooth perturbed flow is supersonic. We develop a nonlinear approach to deal with such a free boundary problem in order to solve the transonic shock problem. Our results indicate that there exists a unique solution of the free boundary problem such that the equation is always elliptic in the downstream region and the free boundary is smooth, provided that the hyperbolic phase is close to a uniform flow. We prove that the free boundary is stable under the steady perturbation of the hyperbolic phase. We also establish the existence and stability of multidimensional transonic shocks near spherical or circular transonic shocks.