A Generalized Measure of Cumulative Residual Entropy

In this work, we introduce a generalized measure of cumulative residual entropy and study its properties. We show that several existing measures of entropy, such as cumulative residual entropy, weighted cumulative residual entropy and cumulative residual Tsallis entropy, are all special cases of this generalized cumulative residual entropy. We also propose a measure of generalized cumulative entropy, which includes cumulative entropy, weighted cumulative entropy and cumulative Tsallis entropy as special cases. We discuss a generating function approach, using which we derive different entropy measures. We provide residual and cumulative versions of Sharma–Taneja–Mittal entropy and obtain them as special cases this generalized measure of entropy. Finally, using the newly introduced entropy measures, we establish some relationships between entropy and extropy measures.     

一个二次多项式混沌系统的均匀化及其熵分析

利用已有理论给出了一个二次多项式混沌系统,证明了该系统与Tent映射拓扑共轭,给出了该混沌系统的概率密度函数;并根据此概率密度函数,得到了轨道均匀分布的反三角函数映射;对均匀化前后的混沌系统在不同参数下产生序列的信息熵、Kolmogorov熵、离散熵的特性进行了分析,结果显示均匀化后产生的混沌序列混沌程度不改变且具有更好的均匀性.     

一种基于单元信息熵的目标匹配改进算法

为解决图像信息熵无法有效进行图像匹配的问题,将图像单元信息熵和投影特征相结合,定义了图像单元信息熵,并提出了一种基于单元投影信息熵的图像匹配方法.在单元信息熵的基础上,在各个单元格内进行单元信息熵投影计算,然后按照一定的测度进行计算,从而实现图像的匹配.采用网格分层的搜索算法,加快搜索速度,提高其工程实用性.实验证明:该算法具有良好的抗几何失真能力和抗辐射失真的能力,以及很好的抗噪声干扰的能力,可以准确的进行目标匹配.     

Double Feature Extraction Method of Ship-Radiated Noise Signal Based on Slope Entropy and Permutation Entropy

In order to accurately identify various types of ships and develop coastal defenses, a single feature extraction method based on slope entropy (SlEn) and a double feature extraction method based on SlEn combined with permutation entropy (SlEn&PE) are proposed. Firstly, SlEn is used for the feature extraction of ship-radiated noise signal (SNS) compared with permutation entropy (PE), dispersion entropy (DE), fluctuation dispersion entropy (FDE), and reverse dispersion entropy (RDE), so that the effectiveness of SlEn is verified, and SlEn has the highest recognition rate calculated by the k-Nearest Neighbor (KNN) algorithm. Secondly, SlEn is combined with PE, DE, FDE, and RDE, respectively, to extract the feature of SNS for a higher recognition rate, and SlEn&PE has the highest recognition rate after the calculation of the KNN algorithm. Lastly, the recognition rates of SlEn and SlEn&PE are compared, and the recognition rates of SlEn&PE are higher than SlEn by 4.22%. Therefore, the double feature extraction method proposed in this paper is more effective in the application of ship type recognition.     

信息熵、玻尔兹曼熵以及克劳修斯熵之间的关系--兼论玻尔兹曼熵和克劳修斯熵是否等价

论述了信息熵、玻尔兹曼熵以及克劳修斯熵之间的关系;由不涉及具体系统的方法从玻尔兹曼关系、信息熵推导出了克劳修斯熵的表达式;指出玻尔兹曼熵与克劳修斯熵不是等价关系,而是玻尔兹曼熵包含克劳修斯熵,信息熵又包含玻尔兹曼熵。     

熵的一种通俗教法

熵如力、能量和动量一样是物理学中一个重要概念,若能用一种通俗易懂的方法设计熵的教学,对文科物理的教学有重要意义.为此本文提出了一种通俗的熵的教法,这一教法不需要学生学习热力学第二定律也可以建立熵的概念.具体教学设计如下:通过日常生活例子引入熵的概念(也就是玻尔兹曼熵),设计两个例子让学生会计算熵,通过具体问题的讨论让学生充分理解熵的意义,通过一个实例由玻尔兹曼熵引入克劳修斯熵公式,设计一个演示实验强化教学效果,将熵与环境保护联系起来融入人文情怀,最后还强调了熵计算的不同层次.教学设计完全采用基于问题学习(PBL)的教学模式.     

A Shannon–Tsallis transformation

Via a first-order linear differential equation, we determine a general link between two different solutions of the MaxEnt variational problem, namely, the ones that correspond to using either Shannon’s or Tsallis’ entropies in the concomitant variational problem. It is shown that the two variations lead to equivalent solutions that have different appearances but contain the same information. These solutions are linked by our transformation. However, the so-called collision entropy (Tsallis’ one with q=2$q=2$) does not have a Shannon counterpart.     

奇偶相干态的Wehrl熵和Shannon熵

研究了奇、偶相干态的Ｗｅｈｒｌ熵和Ｓｈａｎｎｏｎ熵，结果表明，其Ｗｅｈｒｌ熵随总噪声的增加而增大，并趋向同一个常数。Ｓｈａｎｎｏｎ熵随力学量起伏的减小而减小，且这两种态的Ｓｈａｎｎｏｎ熵均可小于相干态的Ｓｈａｎｎｏｎ熵，但这时并不与压缩效应的出现相对应，因而Ｓｈａｎｎｏｎ熵不能成为压缩存在的判据。     

Classical and Quantum H-Theorem Revisited: Variational Entropy and Relaxation Processes

We propose a novel framework to describe the time-evolution of dilute classical and quantum gases, initially out of equilibrium and with spatial inhomogeneities, towards equilibrium. Briefly, we divide the system into small cells and consider the local equilibrium hypothesis. We subsequently define a global functional that is the sum of cell H-functionals. Each cell functional recovers the corresponding Maxwell–Boltzmann, Fermi–Dirac, or Bose–Einstein distribution function, depending on the classical or quantum nature of the gas. The time-evolution of the system is described by the relationship dH/dt≤0, and the equality condition occurs if the system is in the equilibrium state. Via the variational method, proof of the previous relationship, which might be an extension of the H-theorem for inhomogeneous systems, is presented for both classical and quantum gases. Furthermore, the H-functionals are in agreement with the correspondence principle. We discuss how the H-functionals can be identified with the system’s entropy and analyze the relaxation processes of out-of-equilibrium systems.     

Entanglement in a system of two two-level atoms interacting with a single-mode field

We investigate the entanglement in a system of two coupling atoms interacting with a single-mode field by means of quantum information entropy theory. The quantum entanglement between the two atoms and the coherent field is discussed by using the quantum reduced entropy, and the entanglement between the two coupling atoms is also investigated by using the quantum relative entropy. In addition, the influences of the atomic dipole--dipole interaction intensity and the average photon number of the coherent field on the degree of the entanglement is examined. The results show that the evolution of the degree of entanglement between the two atoms and the field is just opposite to that of the degree of entanglement between the two atoms. And the properties of the quantum entanglement in the system rely on the atomic dipole--dipole interaction and the average photon number of the coherent field.     

单个守恒型方程熵耗散格式中熵耗散函数的构造

对于一维单个守恒律方程,文[8]设计了一种非线性守恒型差分格式.此格式为二阶Godunov型的,用的是分片线性重构(reconstruction),重构函数的斜率是根据熵耗散得到的.格式满足熵条件.与传统的守恒格式不同的是此格式在计算过程中不仅用到了数值解还用到了数值熵.在此格式中一个所谓的熵耗散函数起到了很重要的作用,它在每一个网格的计算中耗散熵,以保证格式满足熵条件.文[8]中设计的熵耗散函数比较复杂,并且不是很完善.故数值地分析了在格式的构造中为何应给熵以一定的耗散,及应耗散多少.并且给出了一个新的以数值解的二阶差分作为基本模块的熵耗散函数.最后给出了相应的数值算例.     

Influence of Transfer Entropy in the Short-Term Prediction of Financial Time Series Using an ∊-Machine

Predicting the values of a financial time series is mainly a function of its price history, which depends on several factors, internal and external. With this history, it is possible to build an ∊-machine for predicting the financial time series. This work proposes considering the influence of a financial series through the transfer of entropy when the values of the other financial series are known. A method is proposed that considers the transfer of entropy for breaking the ties that occur when calculating the prediction with the ∊-machine. This analysis is carried out using data from six financial series: two American, the S&P 500 and the Nasdaq; two Asian, the Hang Seng and the Nikkei 225; and two European, the CAC 40 and the DAX. This work shows that it is possible to influence the prediction of the closing value of a series if the value of the influencing series is known. This work showed that the series that transfer the most information through entropy transfer are the American S&P 500 and Nasdaq, followed by the European DAX and CAC 40, and finally the Asian Nikkei 225 and Hang Seng.     

Time dependence of entropy flux and entropy production for a dynamical system driven by noises with coloured cross-correlation

This paper shows the Fokker--Planck equation of a dynamical system driven by coloured cross-correlated white noises in the absence and presence of a small external force. Based on the Fokker--Planck equation and the definition of Shannon's information entropy, the time dependence of entropy flux and entropy production can be calculated. The present results can be used to explain the extremal behaviour of time dependence of entropy flux and entropy production in view of the dissipative parameter γ of the system, coloured cross-correlation time \tau and coloured cross-correlation strength \la.     

Time Dependence of Entropy Flux and Entropy Production of a Dissipative Dynamical System Driven by Non-Gaussian Noise

A stochastic dissipative dynamical system driven by non-Gaussian noise is investigated. A general approximate Fokker-Planck equation of the system is derived through a path-integral approach. Based on the definition of Shannon＇s information entropy, the exact time dependence of entropy flux and entropy production of the system is calculated both in the absence and in the presence of non-equilibrium constraint. The present calculation can be used to interpret the interplay of the dissipative constant and non-Gaussian noise on the entropy flux and entropy production.     

Topological permutation entropy

Permutation entropy quantifies the diversity of possible ordering of the successively observed values a random or deterministic system can take, just as Shannon entropy quantifies the diversity of the values themselves. When the observable or state variable has a natural order relation, making permutation entropy possible to compute, then the asymptotic rate of growth in permutation entropy with word length forms an alternative means of describing the intrinsic entropy rate of a source. Herein, extending a previous result on metric entropy rate, we show that the topological permutation entropy rate for expansive maps equals the conventional topological entropy rate familiar from symbolic dynamics. This result is not limited to one-dimensional maps.     

The Systematic Bias of Entropy Calculation in the Multi-Scale Entropy Algorithm

Entropy indicates irregularity or randomness of a dynamic system. Over the decades, entropy calculated at different scales of the system through subsampling or coarse graining has been used as a surrogate measure of system complexity. One popular multi-scale entropy analysis is the multi-scale sample entropy (MSE), which calculates entropy through the sample entropy (SampEn) formula at each time scale. SampEn is defined by the “logarithmic likelihood” that a small section (within a window of a length m) of the data “matches” with other sections will still “match” the others if the section window length increases by one. “Match” is defined by a threshold of r times standard deviation of the entire time series. A problem of current MSE algorithm is that SampEn calculations at different scales are based on the same matching threshold defined by the original time series but data standard deviation actually changes with the subsampling scales. Using a fixed threshold will automatically introduce systematic bias to the calculation results. The purpose of this paper is to mathematically present this systematic bias and to provide methods for correcting it. Our work will help the large MSE user community avoiding introducing the bias to their multi-scale SampEn calculation results.     

Bosonic and Fermionic Entropy of (2 1)-Dimensional Charged Black Hole

From resolving Klein-Gordon equation and Dirac equation in (2 1)-dimensional charged black hole spacetime and using ‘t Hooft‘s boundary condition and “quasi-periodic“ boundary condition in the thin film brick wall model of black hole, which is introduced by LIU Weng-Biao and ZHAO Zheng, we obtain the bosonic and fermionic entropy of (2 1)-dimensional charged black hole, and find that the bosonic entropy is three times of fermionic entropy.     

Correlation and entanglement of a three-level atom inside a dissipative cavity

We discuss the correlation and entanglement of a three-level atom with a single-mode quantized field in a coherent state inside a phase-damped cavity. We analyze the influence of dissipation on the quantum and classical entropy. It has been shown that the quantum, classical and nonextensive entropy are sensitive to any change in the initial state setting of the atom and the quantized field. The relation between the long lived entanglement and dissipation is observed. On the other hand, a short disentanglement can be generated through special values of the atomic motion parameter.     

Information Between Quantum Systems via POVMs

The concepts of conditional entropy and information between subsystems of a composite quantum system are generalized to include arbitrary indirect measurements (POVMs). Some properties of those quantities differ from those of their classical counterparts; certain equalities and inequalities of classical information theory may be violated. PACS: 03.67.-a.     

两种熵测度在量化射击运动员短时心率变异性信号复杂度上的一致性

利用两种基于熵的非线性复杂度测度：近似熵和样本熵,研究了专业射击运动员两种不同状态下(休息和练习赛)心率变异性信号的复杂度.计算结果表明：射击运动员休息时其心率变异性信号的熵值大于射击比赛时信号的熵值,这意味着运动员一旦进行射击比赛时,其心率变异性信号复杂度降低了,心跳变得更为规则了.为了更好地应用这两种基于熵的方法,进一步分析了算法中的两个重要影响因素：矢量匹配容差r和序列长度N对算法性能的影响.分析结果表明：只要参数选择在合适的范围内,近似熵和样本熵都能够正确地区分出两种不 关键词： 近似熵 样本熵 复杂度 射击