Some Information Geometric Aspects of Cyber Security by Face Recognition

Secure user access to devices and datasets is widely enabled by fingerprint or face recognition. Organization of the necessarily large secure digital object datasets, with objects having content that may consist of images, text, video or audio, involves efficient classification and feature retrieval processing. This usually will require multidimensional methods applicable to data that is represented through a family of probability distributions. Then information geometry is an appropriate context in which to provide for such analytic work, whether with maximum likelihood fitted distributions or empirical frequency distributions. The important provision is of a natural geometric measure structure on families of probability distributions by representing them as Riemannian manifolds. Then the distributions are points lying in this geometrical manifold, different features can be identified and dissimilarities computed, so that neighbourhoods of objects nearby a given example object can be constructed. This can reveal clustering and projections onto smaller eigen-subspaces which can make comparisons easier to interpret. Geodesic distances can be used as a natural dissimilarity metric applied over data described by probability distributions. Exploring this property, we propose a new face recognition method which scores dissimilarities between face images by multiplying geodesic distance approximations between 3-variate RGB Gaussians representative of colour face images, and also obtaining joint probabilities. The experimental results show that this new method is more successful in recognition rates than published comparative state-of-the-art methods.     

Information Length Analysis of Linear Autonomous Stochastic Processes

When studying the behaviour of complex dynamical systems, a statistical formulation can provide useful insights. In particular, information geometry is a promising tool for this purpose. In this paper, we investigate the information length for n-dimensional linear autonomous stochastic processes, providing a basic theoretical framework that can be applied to a large set of problems in engineering and physics. A specific application is made to a harmonically bound particle system with the natural oscillation frequency ω, subject to a damping γ and a Gaussian white-noise. We explore how the information length depends on ω and γ, elucidating the role of critical damping γ=2ω in information geometry. Furthermore, in the long time limit, we show that the information length reflects the linear geometry associated with the Gaussian statistics in a linear stochastic process.     

Volatility Dynamics of Non-Linear Volatile Time Series and Analysis of Information Flow: Evidence from Cryptocurrency Data

This paper aims to empirically examine long memory and bi-directional information flow between estimated volatilities of highly volatile time series datasets of five cryptocurrencies. We propose the employment of Garman and Klass (GK), Parkinson’s, Rogers and Satchell (RS), and Garman and Klass-Yang and Zhang (GK-YZ), and Open-High-Low-Close (OHLC) volatility estimators to estimate cryptocurrencies’ volatilities. The study applies methods such as mutual information, transfer entropy (TE), effective transfer entropy (ETE), and Rényi transfer entropy (RTE) to quantify the information flow between estimated volatilities. Additionally, Hurst exponent computations examine the existence of long memory in log returns and OHLC volatilities based on simple R/S, corrected R/S, empirical, corrected empirical, and theoretical methods. Our results confirm the long-run dependence and non-linear behavior of all cryptocurrency’s log returns and volatilities. In our analysis, TE and ETE estimates are statistically significant for all OHLC estimates. We report the highest information flow from BTC to LTC volatility (RS). Similarly, BNB and XRP share the most prominent information flow between volatilities estimated by GK, Parkinson’s, and GK-YZ. The study presents the practicable addition of OHLC volatility estimators for quantifying the information flow and provides an additional choice to compare with other volatility estimators, such as stochastic volatility models.     

Dynamics of Information Flow between the Chinese A-Share Market and the U.S. Stock Market: From the 2008 Crisis to the COVID-19 Pandemic Period

The relationship between the Chinese market and the US market is widely concerned by researchers and investors. This paper uses transfer entropy and local random permutation (LRP) surrogates to detect the information flow dynamics between two markets. We provide a detailed analysis of the relationship between the two markets using long-term daily and weekly data. Calculations show that there is an asymmetric information flow between the two markets, in which the US market significantly affects the Chinese market. Dynamic analysis based on weekly data shows that the information flow evolves, and includes three significant periods between 2004 and 2021. We also used daily data to analyze the dynamics of information flow in detail over the three periods and found that changes in the intensity of information flow were accompanied by major events affecting the market, such as the 2008 financial crisis and the COVID-19 pandemic period. In particular, we analyzed the impact of the S&P500 index on different industry indices in the Chinese market and found that the dynamics of information flow exhibit multiple patterns. This study reveals the complex information flow between two markets from the perspective of nonlinear dynamics, thereby helping to analyze the impact of major events and providing quantitative analysis tools for investment practice.     

Dynamics of Information Entropies of Atom-Field Entangled States Generated via the Jaynes-Cummings Model

In this paper we have studied the dynamical evolution of Shannon information entropies in position and momentum spaces for two classes of(nonstationary)atom-field entangled states,which are obtained via the JaynesCummings model and its generalization.We have focused on the interaction between two-and(1)-type three-level atoms with the single-mode quantized held.The three-dimensional plots of entropy densities in position and momentum spaces are presented versus corresponding coordinates and time,numerically.It is observed that for particular values of the parameters of the systems,the entropy squeezing in position space occurs.Finally,we have shown that the well-known BBM(Beckner,Bialynicki-Birola and Mycielsky)inequality,which is a stronger statement of the Heisenberg uncertainty relation,is properly satisfied.     

Revealing the Dynamics of Neural Information Processing with Multivariate Information Decomposition

The varied cognitive abilities and rich adaptive behaviors enabled by the animal nervous system are often described in terms of information processing. This framing raises the issue of how biological neural circuits actually process information, and some of the most fundamental outstanding questions in neuroscience center on understanding the mechanisms of neural information processing. Classical information theory has long been understood to be a natural framework within which information processing can be understood, and recent advances in the field of multivariate information theory offer new insights into the structure of computation in complex systems. In this review, we provide an introduction to the conceptual and practical issues associated with using multivariate information theory to analyze information processing in neural circuits, as well as discussing recent empirical work in this vein. Specifically, we provide an accessible introduction to the partial information decomposition (PID) framework. PID reveals redundant, unique, and synergistic modes by which neurons integrate information from multiple sources. We focus particularly on the synergistic mode, which quantifies the “higher-order” information carried in the patterns of multiple inputs and is not reducible to input from any single source. Recent work in a variety of model systems has revealed that synergistic dynamics are ubiquitous in neural circuitry and show reliable structure–function relationships, emerging disproportionately in neuronal rich clubs, downstream of recurrent connectivity, and in the convergence of correlated activity. We draw on the existing literature on higher-order information dynamics in neuronal networks to illustrate the insights that have been gained by taking an information decomposition perspective on neural activity. Finally, we briefly discuss future promising directions for information decomposition approaches to neuroscience, such as work on behaving animals, multi-target generalizations of PID, and time-resolved local analyses.     

Information Entropy Squeezing for a Atom in Mode-Mode Competition System

The entropy squeezing properties for a two-level atom interacting with a two-mode field via two different competing transitions are investigated from a quantum information point of view. The influences of the initial state of the system and the relative coupling strength between the atom and the field on the atomic information entropy squeezing are discussed. Our results show that the squeezed direction and the frequency of the information entropy squeezing can be controlled by choosing the phase of the atom dipole and the relative competing strength of atom-field, respectively. We find that, under the same condition, no atomic variance squeezing is predicted from the HUR while optimal entropy squeezing is obtained from the EUR, so the quantum information entropy is a remarkable precision measure for the atomic squeezing in the considered system.     

Neural Dynamics under Active Inference: Plausibility and Efficiency of Information Processing

Active inference is a normative framework for explaining behaviour under the free energy principle—a theory of self-organisation originating in neuroscience. It specifies neuronal dynamics for state-estimation in terms of a descent on (variational) free energy—a measure of the fit between an internal (generative) model and sensory observations. The free energy gradient is a prediction error—plausibly encoded in the average membrane potentials of neuronal populations. Conversely, the expected probability of a state can be expressed in terms of neuronal firing rates. We show that this is consistent with current models of neuronal dynamics and establish face validity by synthesising plausible electrophysiological responses. We then show that these neuronal dynamics approximate natural gradient descent, a well-known optimisation algorithm from information geometry that follows the steepest descent of the objective in information space. We compare the information length of belief updating in both schemes, a measure of the distance travelled in information space that has a direct interpretation in terms of metabolic cost. We show that neural dynamics under active inference are metabolically efficient and suggest that neural representations in biological agents may evolve by approximating steepest descent in information space towards the point of optimal inference.     

Information Entropy Squeezing for a Atom in Mode-Mode Competition System

The entropy squeezing properties for a two-level atom interacting with a two-mode field via two different competing transitions are investigated from a quantum information point of view. The influences of the initial state of the system and the relative coupling strength between the atom and the field on the atomic information entropy squeezing are discussed. Our results show that the squeezed direction and the frequency of the information entropy squeezing can be controlled by choosing the phase of the atom dipole and the relative competing strength of atom-field, respectively. We find that, under the same condition, no atomic variance squeezing is predicted from the HUR while optimal entropy squeezing is obtained from the EUR, so the quantum information entropy is a remarkable precision measure for the atomic squeezing in the considered system.     

基于信息理论的采样成像系统匹配设计

把信息论应用于采样成像系统中，用互信息量评价图像捕捉部分的性能，做出基于信息论的系统评价仿真曲线，提出基于信息论的系统优化设计的指标。根据仿真结果，给出光学成像系统与CCD阵列探测器的宏观匹配特性与最佳匹配条件。图像捕捉实验结果证明了理论分析和仿真结论的正确性。     

Area Entropy and Quantized Mass of Black Holes from Information Theory

In this paper, we present a derivation of the black hole area entropy with the relationship between entropy and information. The curved space of a black hole allows objects to be imaged in the same way as camera lenses. The maximal information that a black hole can gain is limited by both the Compton wavelength of the object and the diameter of the black hole. When an object falls into a black hole, its information disappears due to the no-hair theorem, and the entropy of the black hole increases correspondingly. The area entropy of a black hole can thus be obtained, which indicates that the Bekenstein–Hawking entropy is information entropy rather than thermodynamic entropy. The quantum corrections of black hole entropy are also obtained according to the limit of Compton wavelength of the captured particles, which makes the mass of a black hole naturally quantized. Our work provides an information-theoretic perspective for understanding the nature of black hole entropy.     

Assessment of Cardiorespiratory Interactions during Apneic Events in Sleep via Fuzzy Kernel Measures of Information Dynamics

Apnea and other breathing-related disorders have been linked to the development of hypertension or impairments of the cardiovascular, cognitive or metabolic systems. The combined assessment of multiple physiological signals acquired during sleep is of fundamental importance for providing additional insights about breathing disorder events and the associated impairments. In this work, we apply information-theoretic measures to describe the joint dynamics of cardiorespiratory physiological processes in a large group of patients reporting repeated episodes of hypopneas, apneas (central, obstructive, mixed) and respiratory effort related arousals (RERAs). We analyze the heart period as the target process and the airflow amplitude as the driver, computing the predictive information, the information storage, the information transfer, the internal information and the cross information, using a fuzzy kernel entropy estimator. The analyses were performed comparing the information measures among segments during, immediately before and after the respiratory event and with control segments. Results highlight a general tendency to decrease of predictive information and information storage of heart period, as well as of cross information and information transfer from respiration to heart period, during the breathing disordered events. The information-theoretic measures also vary according to the breathing disorder, and significant changes of information transfer can be detected during RERAs, suggesting that the latter could represent a risk factor for developing cardiovascular diseases. These findings reflect the impact of different sleep breathing disorders on respiratory sinus arrhythmia, suggesting overall higher complexity of the cardiac dynamics and weaker cardiorespiratory interactions which may have physiological and clinical relevance.     

Information Geometry of the Exponential Family of Distributions with Progressive Type-II Censoring

In geometry and topology, a family of probability distributions can be analyzed as the points on a manifold, known as statistical manifold, with intrinsic coordinates corresponding to the parameters of the distribution. Consider the exponential family of distributions with progressive Type-II censoring as the manifold of a statistical model, we use the information geometry methods to investigate the geometric quantities such as the tangent space, the Fisher metric tensors, the affine connection and the α-connection of the manifold. As an application of the geometric quantities, the asymptotic expansions of the posterior density function and the posterior Bayesian predictive density function of the manifold are discussed. The results show that the asymptotic expansions are related to the coefficients of the α-connections and metric tensors, and the predictive density function is the estimated density function in an asymptotic sense. The main results are illustrated by considering the Rayleigh distribution.     

相空间中脑电近似熵和信息熵的计算

提出一种基于相空间重构脑电信号来计算脑电近似熵和信息熵的新方法．实验计算结果表明,癫痫患者脑电和正常人脑电的近似熵和信息熵随相空间嵌入维数的变化有明显的不同．     

Verification of Information Thermodynamics in a Trapped Ion System

Information thermodynamics has developed rapidly over past years, and the trapped ions, as a controllable quantum system, have demonstrated feasibility to experimentally verify the theoretical predictions in the information thermodynamics. Here, we address some representative theories of information thermodynamics, such as the quantum Landauer principle, information equality based on the two-point measurement, information-theoretical bound of irreversibility, and speed limit restrained by the entropy production of system, and review their experimental demonstration in the trapped ion system. In these schemes, the typical physical processes, such as the entropy flow, energy transfer, and information flow, build the connection between thermodynamic processes and information variation. We then elucidate the concrete quantum control strategies to simulate these processes by using quantum operators and the decay paths in the trapped-ion system. Based on them, some significantly dynamical processes in the trapped ion system to realize the newly proposed information-thermodynamic models is reviewed. Although only some latest experimental results of information thermodynamics with a single trapped-ion quantum system are reviewed here, we expect to find more exploration in the future with more ions involved in the experimental systems.     

Information Measure in Terms of the Hazard Function and Its Estimate

It is well-known that some information measures, including Fisher information and entropy, can be represented in terms of the hazard function. In this paper, we provide the representations of more information measures, including quantal Fisher information and quantal Kullback-leibler information, in terms of the hazard function and reverse hazard function. We provide some estimators of the quantal KL information, which include the Anderson-Darling test statistic, and compare their performances.     

小波包熵的复杂体系近红外光谱信息提取

有用信息提取是复杂体系近红外检测的重点和难点之一。由于复杂体系光谱中存在各种噪声、基线漂移、谱带重叠及复杂背景的干扰,常规方法不能准确地从光谱中获得有用信息。为此,将小波包变换(DWPT)和信息熵理论相结合--小波包熵(EWPIE)提取复杂体系光谱中的有用信息。思路是采用小波包变换对光谱信号进行多频带分解,根据有用信号与噪声的频带分布特点,基于信息熵理论滤除干扰的频率分量,采用正交校正法(OSC)剔除与被测组分无关的信息,然后对处理后的频率分量进行重构,从而实现复杂体系有用信息的准确提取。通过对复杂体系光谱数据建立多元校正模型来验证该方法的效果。采用牛奶的近红外光谱数据,以牛奶中脂肪和蛋白质浓度为研究对象,建立了偏最小二乘法(PLS)模型。结果显示,牛奶中脂肪和蛋白质的预测均方根误差(RMSEP)分别为0.132%和0.121%,与单纯的DWPT和OSC相比,EWPIE能够有效地提取有用信息,避免了无用信息的干扰,明显提高了模型的预测精度,对复杂体系的准确检测具有一定的理论意义和实际应用价值。     

Characterizing Topics in Social Media Using Dynamics of Conversation

Online social media provides massive open-ended platforms for users of a wide variety of backgrounds, interests, and beliefs to interact and debate, facilitating countless discussions across a myriad of subjects. With numerous unique voices being lent to the ever-growing information stream, it is essential to consider how the types of conversations that result from a social media post represent the post itself. We hypothesize that the biases and predispositions of users cause them to react to different topics in different ways not necessarily entirely intended by the sender. In this paper, we introduce a set of unique features that capture patterns of discourse, allowing us to empirically explore the relationship between a topic and the conversations it induces. Utilizing “microscopic” trends to describe “macroscopic” phenomena, we set a paradigm for analyzing information dissemination through the user reactions that arise from a topic, eliminating the need to analyze the involved text of the discussions. Using a Reddit dataset, we find that our features not only enable classifiers to accurately distinguish between content genre, but also can identify more subtle semantic differences in content under a single topic as well as isolating outliers whose subject matter is substantially different from the norm.