相空间中脑电近似熵和信息熵的计算

提出一种基于相空间重构脑电信号来计算脑电近似熵和信息熵的新方法．实验计算结果表明,癫痫患者脑电和正常人脑电的近似熵和信息熵随相空间嵌入维数的变化有明显的不同．     

Construction and Application of Functional Brain Network Based on Entropy

Functional brain network (FBN) is an intuitive expression of the dynamic neural activity interaction between different neurons, neuron clusters, or cerebral cortex regions. It can characterize the brain network topology and dynamic properties. The method of building an FBN to characterize the features of the brain network accurately and effectively is a challenging subject. Entropy can effectively describe the complexity, non-linearity, and uncertainty of electroencephalogram (EEG) signals. As a relatively new research direction, the research of the FBN construction method based on EEG data of fatigue driving has broad prospects. Therefore, it is of great significance to study the entropy-based FBN construction. We focus on selecting appropriate entropy features to characterize EEG signals and construct an FBN. On the real data set of fatigue driving, FBN models based on different entropies are constructed to identify the state of fatigue driving. Through analyzing network measurement indicators, the experiment shows that the FBN model based on fuzzy entropy can achieve excellent classification recognition rate and good classification stability. In addition, when compared with the other model based on the same data set, our model could obtain a higher accuracy and more stable classification results even if the length of the intercepted EEG signal is different.     

On Quantization Errors in Approximate and Sample Entropy

Approximate and sample entropies are acclaimed tools for quantifying the regularity and unpredictability of time series. This paper analyses the causes of their inconsistencies. It is shown that the major problem is a coarse quantization of matching probabilities, causing a large error between their estimated and true values. Error distribution is symmetric, so in sample entropy, where matching probabilities are directly summed, errors cancel each other. In approximate entropy, errors are accumulating, as sums involve logarithms of matching probabilities. Increasing the time series length increases the number of quantization levels, and errors in entropy disappear both in approximate and in sample entropies. The distribution of time series also affects the errors. If it is asymmetric, the matching probabilities are asymmetric as well, so the matching probability errors cease to be mutually canceled and cause a persistent entropy error. Despite the accepted opinion, the influence of self-matching is marginal as it just shifts the error distribution along the error axis by the matching probability quant. Artificial lengthening the time series by interpolation, on the other hand, induces large error as interpolated samples are statistically dependent and destroy the level of unpredictability that is inherent to the original signal.     

Multi-Scale Permutation Entropy: A Potential Measure for the Impact of Sleep Medication on Brain Dynamics of Patients with Insomnia

Insomnia is a common sleep disorder that is closely associated with the occurrence and deterioration of cardiovascular disease, depression and other diseases. The evaluation of pharmacological treatments for insomnia brings significant clinical implications. In this study, a total of 20 patients with mild insomnia and 75 healthy subjects as controls (HC) were included to explore alterations of electroencephalogram (EEG) complexity associated with insomnia and its pharmacological treatment by using multi-scale permutation entropy (MPE). All participants were recorded for two nights of polysomnography (PSG). The patients with mild insomnia received a placebo on the first night (Placebo) and temazepam on the second night (Temazepam), while the HCs had no sleep-related medication intake for either night. EEG recordings from each night were extracted and analyzed using MPE. The results showed that MPE decreased significantly from pre-lights-off to the period during sleep transition and then to the period after sleep onset, and also during the deepening of sleep stage in the HC group. Furthermore, results from the insomnia subjects showed that MPE values were significantly lower for the Temazepam night compared to MPE values for the Placebo night. Moreover, MPE values for the Temazepam night showed no correlation with age or gender. Our results indicated that EEG complexity, measured by MPE, may be utilized as an alternative approach to measure the impact of sleep medication on brain dynamics.     

A Comparative Study of Functional Connectivity Measures for Brain Network Analysis in the Context of AD Detection with EEG

This work addresses brain network analysis considering different clinical severity stages of cognitive dysfunction, based on resting-state electroencephalography (EEG). We use a cohort acquired in real-life clinical conditions, which contains EEG data of subjective cognitive impairment (SCI) patients, mild cognitive impairment (MCI) patients, and Alzheimer’s disease (AD) patients. We propose to exploit an epoch-based entropy measure to quantify the connectivity links in the networks. This entropy measure relies on a refined statistical modeling of EEG signals with Hidden Markov Models, which allow a better estimation of the spatiotemporal characteristics of EEG signals. We also propose to conduct a comparative study by considering three other measures largely used in the literature: phase lag index, coherence, and mutual information. We calculated such measures at different frequency bands and computed different local graph parameters considering different proportional threshold values for a binary network analysis. After applying a feature selection procedure to determine the most relevant features for classification performance with a linear Support Vector Machine algorithm, our study demonstrates the effectiveness of the statistical entropy measure for analyzing the brain network in patients with different stages of cognitive dysfunction.     

Entropy Could Quantify Brain Activation Induced by Mechanical Impedance-Restrained Active Arm Motion: A Functional NIRS Study

Brain activation has been used to understand brain-level events associated with cognitive tasks or physical tasks. As a quantitative measure for brain activation, we propose entropy in place of signal amplitude and beta value, which are widely used, but sometimes criticized for their limitations and shortcomings as such measures. To investigate the relevance of our proposition, we provided 22 subjects with physical stimuli through elbow extension-flexion motions by using our exoskeleton robot, measured brain activation in terms of entropy, signal amplitude, and beta value; and compared entropy with the other two. The results show that entropy is superior, in that its change appeared in limited, well established, motor areas, while signal amplitude and beta value changes appeared in a widespread fashion, contradicting the modularity theory. Entropy can predict increase in brain activation with task duration, while the other two cannot. When stimuli shifted from the rest state to the task state, entropy exhibited a similar increase as the other two did. Although entropy showed only a part of the phenomenon induced by task strength, it showed superiority by showing a decrease in brain activation that the other two did not show. Moreover, entropy was capable of identifying the physiologically important location.     

Increased Entropic Brain Dynamics during DeepDream-Induced Altered Perceptual Phenomenology

In recent years, the use of psychedelic drugs to study brain dynamics has flourished due to the unique opportunity they offer to investigate the neural mechanisms of conscious perception. Unfortunately, there are many difficulties to conduct experiments on pharmacologically-induced hallucinations, especially regarding ethical and legal issues. In addition, it is difficult to isolate the neural effects of psychedelic states from other physiological effects elicited by the drug ingestion. Here, we used the DeepDream algorithm to create visual stimuli that mimic the perception of hallucinatory states. Participants were first exposed to a regular video, followed by its modified version, while recording electroencephalography (EEG). Results showed that the frontal region’s activity was characterized by a higher entropy and lower complexity during the modified video, with respect to the regular one, at different time scales. Moreover, we found an increased undirected connectivity and a greater level of entropy in functional connectivity networks elicited by the modified video. These findings suggest that DeepDream and psychedelic drugs induced similar altered brain patterns and demonstrate the potential of adopting this method to study altered perceptual phenomenology in neuroimaging research.     

Fault Diagnosis of Power Transformer Based on Time-Shift Multiscale Bubble Entropy and Stochastic Configuration Network

In order to accurately diagnose the fault type of power transformer, this paper proposes a transformer fault diagnosis method based on the combination of time-shift multiscale bubble entropy (TSMBE) and stochastic configuration network (SCN). Firstly, bubble entropy is introduced to overcome the shortcomings of traditional entropy models that rely too heavily on hyperparameters. Secondly, on the basis of bubble entropy, a tool for measuring signal complexity, TSMBE, is proposed. Then, the TSMBE of the transformer vibration signal is extracted as a fault feature. Finally, the fault feature is inputted into the stochastic configuration network model to achieve an accurate identification of different transformer state signals. The proposed method was applied to real power transformer fault cases, and the research results showed that TSMBE-SCN achieved 99.01%, 99.1%, 99.11%, 99.11%, 99.14% and 99.02% of the diagnostic rates under different folding numbers, respectively, compared with conventional diagnostic models MBE-SCN, TSMSE-SCN, MSE-SCN, TSMDE-SCN and MDE-SCN. This comparison shows that TSMBE-SCN has a strong competitive advantage, which verifies that the proposed method has a good diagnostic effect. This study provides a new method for power transformer fault diagnosis, which has good reference value.     

Entropy and Network Centralities as Intelligent Tools for the Investigation of Terrorist Organizations

In recent years, law enforcement authorities have increasingly used mathematical tools to support criminal investigations, such as those related to terrorism. In this work, two relevant questions are discussed: “How can the different roles of members of a terrorist organization be recognized?” and “are there early signs of impending terrorist acts?” These questions are addressed using the tools of entropy and network theory, more specifically centralities (degree, betweenness, clustering) and their entropies. These tools were applied to data (physical contacts) of four real terrorist networks from different countries. The different roles of the members are clearly recognized from the values of the selected centralities. An early sign of impending terrorist acts is the evolutionary pattern of the values of the entropies of the selected centralities. These results have been confirmed in all four terrorist networks. The conclusion is expected to be useful to law enforcement authorities to identify the roles of the members of terrorist organizations as the members with high centrality and to anticipate when a terrorist attack is imminent, by observing the evolution of the entropies of the centralities.     

The Systematic Bias of Entropy Calculation in the Multi-Scale Entropy Algorithm

Entropy indicates irregularity or randomness of a dynamic system. Over the decades, entropy calculated at different scales of the system through subsampling or coarse graining has been used as a surrogate measure of system complexity. One popular multi-scale entropy analysis is the multi-scale sample entropy (MSE), which calculates entropy through the sample entropy (SampEn) formula at each time scale. SampEn is defined by the “logarithmic likelihood” that a small section (within a window of a length m) of the data “matches” with other sections will still “match” the others if the section window length increases by one. “Match” is defined by a threshold of r times standard deviation of the entire time series. A problem of current MSE algorithm is that SampEn calculations at different scales are based on the same matching threshold defined by the original time series but data standard deviation actually changes with the subsampling scales. Using a fixed threshold will automatically introduce systematic bias to the calculation results. The purpose of this paper is to mathematically present this systematic bias and to provide methods for correcting it. Our work will help the large MSE user community avoiding introducing the bias to their multi-scale SampEn calculation results.     

A Survey of Information Entropy Metrics for Complex Networks

Information entropy metrics have been applied to a wide range of problems that were abstracted as complex networks. This growing body of research is scattered in multiple disciplines, which makes it difficult to identify available metrics and understand the context in which they are applicable. In this work, a narrative literature review of information entropy metrics for complex networks is conducted following the PRISMA guidelines. Existing entropy metrics are classified according to three different criteria: whether the metric provides a property of the graph or a graph component (such as the nodes), the chosen probability distribution, and the types of complex networks to which the metrics are applicable. Consequently, this work identifies the areas in need for further development aiming to guide future research efforts.     

Using Entropy to Evaluate the Impact of Monetary Policy Shocks on Financial Networks

We analyze the changes in the financial network built using the Dow Jones Industrial Average components following monetary policy shocks. Monetary policy shocks are measured through unexpected changes in the federal funds rate in the United States. We determine the changes in the financial networks using singular value decomposition entropy and von Neumann entropy. The results indicate that unexpected positive shocks in monetary policy shocks lead to lower entropy. The results are robust to varying the window size used to construct financial networks, though they also depend on the type of entropy used.     

Time Dependence of Entropy Flux and Entropy Production of a Dissipative Dynamical System Driven by Non-Gaussian Noise

A stochastic dissipative dynamical system driven by non-Gaussian noise is investigated. A general approximate Fokker-Planck equation of the system is derived through a path-integral approach. Based on the definition of Shannon＇s information entropy, the exact time dependence of entropy flux and entropy production of the system is calculated both in the absence and in the presence of non-equilibrium constraint. The present calculation can be used to interpret the interplay of the dissipative constant and non-Gaussian noise on the entropy flux and entropy production.     

单个守恒型方程熵耗散格式中熵耗散函数的构造

对于一维单个守恒律方程,文[8]设计了一种非线性守恒型差分格式.此格式为二阶Godunov型的,用的是分片线性重构(reconstruction),重构函数的斜率是根据熵耗散得到的.格式满足熵条件.与传统的守恒格式不同的是此格式在计算过程中不仅用到了数值解还用到了数值熵.在此格式中一个所谓的熵耗散函数起到了很重要的作用,它在每一个网格的计算中耗散熵,以保证格式满足熵条件.文[8]中设计的熵耗散函数比较复杂,并且不是很完善.故数值地分析了在格式的构造中为何应给熵以一定的耗散,及应耗散多少.并且给出了一个新的以数值解的二阶差分作为基本模块的熵耗散函数.最后给出了相应的数值算例.     

Brain Dynamics Altered by Photic Stimulation in Patients with Alzheimer’s Disease and Mild Cognitive Impairment

Individuals with mild cognitive impairment (MCI) are at high risk of developing Alzheimer’s disease (AD). Repetitive photic stimulation (PS) is commonly used in routine electroencephalogram (EEG) examinations for rapid assessment of perceptual functioning. This study aimed to evaluate neural oscillatory responses and nonlinear brain dynamics under the effects of PS in patients with mild AD, moderate AD, severe AD, and MCI, as well as healthy elderly controls (HC). EEG power ratios during PS were estimated as an index of oscillatory responses. Multiscale sample entropy (MSE) was estimated as an index of brain dynamics before, during, and after PS. During PS, EEG harmonic responses were lower and MSE values were higher in the AD subgroups than in HC and MCI groups. PS-induced changes in EEG complexity were less pronounced in the AD subgroups than in HC and MCI groups. Brain dynamics revealed a “transitional change” between MCI and Mild AD. Our findings suggest a deficiency in brain adaptability in AD patients, which hinders their ability to adapt to repetitive perceptual stimulation. This study highlights the importance of combining spectral and nonlinear dynamical analysis when seeking to unravel perceptual functioning and brain adaptability in the various stages of neurodegenerative diseases.     

Microcanonical and Canonical Ensembles for fMRI Brain Networks in Alzheimer’s Disease

This paper seeks to advance the state-of-the-art in analysing fMRI data to detect onset of Alzheimer’s disease and identify stages in the disease progression. We employ methods of network neuroscience to represent correlation across fMRI data arrays, and introduce novel techniques for network construction and analysis. In network construction, we vary thresholds in establishing BOLD time series correlation between nodes, yielding variations in topological and other network characteristics. For network analysis, we employ methods developed for modelling statistical ensembles of virtual particles in thermal systems. The microcanonical ensemble and the canonical ensemble are analogous to two different fMRI network representations. In the former case, there is zero variance in the number of edges in each network, while in the latter case the set of networks have a variance in the number of edges. Ensemble methods describe the macroscopic properties of a network by considering the underlying microscopic characterisations which are in turn closely related to the degree configuration and network entropy. When applied to fMRI data in populations of Alzheimer’s patients and controls, our methods demonstrated levels of sensitivity adequate for clinical purposes in both identifying brain regions undergoing pathological changes and in revealing the dynamics of such changes.     

关于光学实验中望远镜与光杠杆的调节探讨

在关于望远镜的光杠杆调节中通常只给出了对光杠杆及望远镜的上下位置的调节,而忽视了望远镜和光杠杆的左右调节。给出了望远镜和光杠杆的调节中左右位置的调节原理和调节操作方法,从而使望远镜和光杠杆的调节更具有目的性,使实验进行的更加快速和准确。     

Regularization of Quantum Relative Entropy in Finite Dimensions and Application to Entropy Production

The fundamental concept of relative entropy is extended to a functional that is regular-valued also on arbitrary pairs of nonfaithful states of open quantum systems. This regularized version preserves almost all important properties of ordinary relative entropy such as joint convexity and contractivity under completely positive quantum dynamical semigroup time evolution. On this basis a generalized formula for entropy production is proposed, the applicability of which is tested in models of irreversible processes. The dynamics of the latter is determined by either Markovian or non-Markovian master equations and involves all types of states.     

Optical Implementation of Entropy Network Mapped from Binary Feature Tree

An entropy network mapped from a binary feature tree is described and compared with the Hamming net. Implementation of the entropy network includes extracting features from an input and making the decision according to these features. The feature extraction in the first layer of the entropy network is implemented by an optical method. Optical implementation with an incoherent shadow casting correlation system is proposed, and experimental demonstrations are given. The processing capability of the proposed optical system is discussed.     

Identifying Important Nodes in Complex Networks Based on Node Propagation Entropy

In recent years, the identification of the essential nodes in complex networks has attracted significant attention because of their theoretical and practical significance in many applications, such as preventing and controlling epidemic diseases and discovering essential proteins. Several importance measures have been proposed from diverse perspectives to identify crucial nodes more accurately. In this paper, we propose a novel importance metric called node propagation entropy, which uses a combination of the clustering coefficients of nodes and the influence of the first- and second-order neighbor numbers on node importance to identify essential nodes from an entropy perspective while considering the local and global information of the network. Furthermore, the susceptible–infected–removed and susceptible–infected–removed–susceptible epidemic models along with the Kendall coefficient are used to reveal the relevant correlations among the various importance measures. The results of experiments conducted on several real networks from different domains show that the proposed metric is more accurate and stable in identifying significant nodes than many existing techniques, including degree centrality, betweenness centrality, closeness centrality, eigenvector centrality, and H-index.