熵的一种通俗教法

熵如力、能量和动量一样是物理学中一个重要概念,若能用一种通俗易懂的方法设计熵的教学,对文科物理的教学有重要意义.为此本文提出了一种通俗的熵的教法,这一教法不需要学生学习热力学第二定律也可以建立熵的概念.具体教学设计如下:通过日常生活例子引入熵的概念(也就是玻尔兹曼熵),设计两个例子让学生会计算熵,通过具体问题的讨论让学生充分理解熵的意义,通过一个实例由玻尔兹曼熵引入克劳修斯熵公式,设计一个演示实验强化教学效果,将熵与环境保护联系起来融入人文情怀,最后还强调了熵计算的不同层次.教学设计完全采用基于问题学习(PBL)的教学模式.     

Entropy balance in distributed reversible Gray-Scott model

A practical way to calculate the entropy change in the distributed media composed of reversible Gray-Scott model is demonstrated. The entropy change is given as the sum of the entropy production and the divergence of entropy flow. The divergence of entropy is calculated based on the chemical potential of steady state. It becomes evident that: (i) the entropy change for the emergence of dissipative structures in the open system can be positive or negative, (ii) most of the entropy produced inside the system is thrown out to the environment when dissipative structures are developing, (iii) the entropy production and the divergence of entropy flow balance completely, when the system shows static steady states, (iv) the entropy change behaves as if it is the time derivative of the entropy production. Prior to these calculations of entropy balance, the features of emergent patterns in the two-dimensional system are examined in terms of entropy production solely. The results imply that the entropy production can be an index for us to discriminate spatial patterns, but is not a global thermodynamic potential for the evolution of dissipative structures.     

Quantum transmission processes and their entropies

In classical information theory, one of the most important theorems are the coding theorems, which were discussed by calculating the mean entropy and the mean mutual entropy defined by the classical dynamical entropy (Kolmogorov-Sinai). The quantum dynamical entropy was first studied by Emch [13] and Connes-Stormer [11]. After that, several approaches for introducing the quantum dynamical entropy are done [10, 3, 8, 39, 15, 44, 9, 27, 28, 2, 19, 45]. The efficiency of information transmission for the quantum processes is investigated by using the von Neumann entropy [22] and the Ohya mutual entropy [24]. These entropies were extended to S- mixing entropy by Ohya [26, 27] in general quantum systems. The mean entropy and the mean mutual entropy for the quantum dynamical systems were introduced based on the S- mixing entropy. In this paper, we discuss the efficiency of information transmission to calculate the mean mutual entropy with respect to the modulated initial states and the connected channel for the quantum dynamical systems.     

The criteria for selecting a method for unfolding neutron spectra based on the information entropy theory

To further expand the application of an artificial neural network in the field of neutron spectrometry, the criteria for choosing between an artificial neural network and the maximum entropy method for the purpose of unfolding neutron spectra was presented. The counts of the Bonner spheres for IAEA neutron spectra were used as a database, and the artificial neural network and the maximum entropy method were used to unfold neutron spectra; the mean squares of the spectra were defined as the differences between the desired and unfolded spectra. After the information entropy of each spectrum was calculated using information entropy theory, the relationship between the mean squares of the spectra and the information entropy was acquired. Useful information from the information entropy guided the selection of unfolding methods. Due to the importance of the information entropy, the method for predicting the information entropy using the Bonner spheres' counts was established. The criteria based on the information entropy theory can be used to choose between the artificial neural network and the maximum entropy method unfolding methods. The application of an artificial neural network to unfold neutron spectra was expanded.     

A Novel Blind Signal Detector Based on the Entropy of the Power Spectrum Subband Energy Ratio

In this paper, we present a novel blind signal detector based on the entropy of the power spectrum subband energy ratio (PSER), the detection performance of which is significantly better than that of the classical energy detector. This detector is a full power spectrum detection method, and does not require the noise variance or prior information about the signal to be detected. According to the analysis of the statistical characteristics of the power spectrum subband energy ratio, this paper proposes concepts such as interval probability, interval entropy, sample entropy, joint interval entropy, PSER entropy, and sample entropy variance. Based on the multinomial distribution, in this paper the formulas for calculating the PSER entropy and the variance of sample entropy in the case of pure noise are derived. Based on the mixture multinomial distribution, the formulas for calculating the PSER entropy and the variance of sample entropy in the case of the signals mixed with noise are also derived. Under the constant false alarm strategy, the detector based on the entropy of the power spectrum subband energy ratio is derived. The experimental results for the primary signal detection are consistent with the theoretical calculation results, which proves that the detection method is correct.     

Entropy and information characteristics of qubit states

Shannon entropy, Rényi entropy, and Tsallis entropy are discussed for the tomographic probability distributions of qubit states. Relative entropy and its properties are considered for the tomographic probability distribution describing the states of multi-spin systems. New inequalities for Hermite polynomials are obtained.     

Entropy, entropy flux and entropy rate of granular materials

The aim of this work is to analyze the entropy, entropy flux and entropy rate of granular materials within the frameworks of the Boltzmann equation and continuum thermodynamics. It is shown that the entropy inequality for a granular gas that follows from the Boltzmann equation differs from the one of a simple fluid due to the presence of a term which can be identified as the entropy density rate. From the knowledge of a non-equilibrium distribution function-valid for processes closed to equilibrium-it is obtained that the entropy density rate is proportional to the internal energy density rate divided by the temperature, while the entropy flux is equal to the heat flux vector divided by the temperature. A thermodynamic theory of a granular material is also developed whose objective is the determination of the basic fields of mass density, momentum density and internal energy density. The constitutive laws are restricted by the principle of material frame indifference and by the entropy principle. Through the exploitation of the entropy principle with Lagrange multipliers, it is shown that the results obtained from the kinetic theory for granular gases concerning the entropy density rate and entropy flux are valid in general for processes close to equilibrium of granular materials, where linearized constitutive equations hold.     

Zero Entropy Systems

This paper introduces the notion of entropy dimension to measure the complexity of zero entropy dynamical systems, including the probabilistic and the topological versions. These notions are isomorphism invariants for measure-preserving transformation and continuity. We discuss basic propositions for entropy dimension and construct some examples to show that the topological entropy dimension attains any value between 0 and 1. This paper also gives a symbolic subspace to achieve zero topological entropy, but with full entropy dimension.     

Connecting electronic entropy to empirically accessible electronic properties in high temperature systems

A quantitative theoretical model connecting the thermopower and electronic entropy of molten systems is proposed, the validity of which is tested for semiconductors and metallic materials. The model accurately provides the entropy of mixing for molten semiconductors, as shown for the representative system Te–Tl. Predictions of the electronic entropy of fusion for compounds are in agreement with available data and offer a novel means to identify the correct electrical conductivity model when Hall measurements are not available. Electronic entropy for molten semiconductor and metallic systems is shown to reflect order in the molten and solid state. The model proves accurate at predicting the electronic state entropy contribution to the electronic entropy of mixing.     

Analysis of complex time series using refined composite multiscale entropy

Multiscale entropy (MSE) is an effective algorithm for measuring the complexity of a time series that has been applied in many fields successfully. However, MSE may yield an inaccurate estimation of entropy or induce undefined entropy because the coarse-graining procedure reduces the length of a time series considerably at large scales. Composite multiscale entropy (CMSE) was recently proposed to improve the accuracy of MSE, but it does not resolve undefined entropy. Here we propose a refined composite multiscale entropy (RCMSE) to improve CMSE. For short time series analyses, we demonstrate that RCMSE increases the accuracy of entropy estimation and reduces the probability of inducing undefined entropy.     

Use and Abuse of Entropy in Biology: A Case for Caliber

Here, I discuss entropy and its use as a tool in fields of biology such as bioenergetics, ecology, and evolutionary biology. Statistical entropy concepts including Shannon’s diversity, configurational entropy, and informational entropy are discussed in connection to their use in describing the diversity, heterogeneity, and spatial patterning of biological systems. The use of entropy as a measure of biological complexity is also discussed, and I explore the extension of thermodynamic entropy principles to open, nonequilibrium systems operating in finite time. I conclude with suggestions for use of caliber, a metric similar to entropy but for time-dependent trajectories rather than static distributions, and propose the complementary notion of path information.     

Entropy of the FRW cosmology based on the brick wall method

The brick wall method in calculations of the entropy of black holes can be applied to the FRW cosmology in order to study the statistical entropy. An appropriate cutoff satisfying the covariant entropy bound can be chosen so that the entropy has a definite bound. Among the entropy for each of cosmological eras, the vacuum energy-dominated era turns out to give the maximal entropy which is in fact compatible with assumptions from the brick wall method.     

Entropy of generalized Gaussian optical fields

We consider two definitions of entropy: thermodynamic entropy and signal entropy. We compare their value for the class of generalized Gaussian fields. The first definition is well adapted to monomode stationary fields, while the second one is bounded only for multimode fields. We prove that these two notions are definitely different, for example, the real Gaussian field has a maximum signal entropy and a minimum thermodynamic entropy (among the Gaussian fields).     

Topological permutation entropy

Permutation entropy quantifies the diversity of possible ordering of the successively observed values a random or deterministic system can take, just as Shannon entropy quantifies the diversity of the values themselves. When the observable or state variable has a natural order relation, making permutation entropy possible to compute, then the asymptotic rate of growth in permutation entropy with word length forms an alternative means of describing the intrinsic entropy rate of a source. Herein, extending a previous result on metric entropy rate, we show that the topological permutation entropy rate for expansive maps equals the conventional topological entropy rate familiar from symbolic dynamics. This result is not limited to one-dimensional maps.     

Single atom entropy squeezing for two two-level atoms interacting with a binomial field

In this paper we consider a system of two two-level atoms interacting with a binomial field in an ideal cavity. We investigate the time evolution of the single atom entropy squeezing, atomic inversion and the linear entropy for the present system. Furthermore, the relationship between the entropy squeezing and the entanglement is investigated. It is shown that the amounts of the nonclassical effects exhibited in the entropy squeezing are dependent on the different initial conditions. The entropy squeezing can give information on the corresponding linear entropy.     

On Quantum Entropy

Quantum physics, despite its intrinsically probabilistic nature, lacks a definition of entropy fully accounting for the randomness of a quantum state. For example, von Neumann entropy quantifies only the incomplete specification of a quantum state and does not quantify the probabilistic distribution of its observables; it trivially vanishes for pure quantum states. We propose a quantum entropy that quantifies the randomness of a pure quantum state via a conjugate pair of observables/operators forming the quantum phase space. The entropy is dimensionless, it is a relativistic scalar, it is invariant under canonical transformations and under CPT transformations, and its minimum has been established by the entropic uncertainty principle. We expand the entropy to also include mixed states. We show that the entropy is monotonically increasing during a time evolution of coherent states under a Dirac Hamiltonian. However, in a mathematical scenario, when two fermions come closer to each other, each evolving as a coherent state, the total system’s entropy oscillates due to the increasing spatial entanglement. We hypothesize an entropy law governing physical systems whereby the entropy of a closed system never decreases, implying a time arrow for particle physics. We then explore the possibility that as the oscillations of the entropy must by the law be barred in quantum physics, potential entropy oscillations trigger annihilation and creation of particles.     

Time Dependence of Joint Entropy of Oscillating Quantum Systems

The time dependent entropy (or Leipnik’s entropy) of harmonic and damped harmonic oscillator systems is studied by using time dependent wave function obtained by the Feynman path integral method. The Leipnik entropy and its envelope change as a function of time, angular frequency and damping factor. Our results for simple harmonic oscillator are in agreement with the literature. However, the joint entropy of damped harmonic oscillator shows remarkable discontinuity with time for certain values of damping factor. The envelope of the joint entropy curve increases with time monotonically. These results show the general properties of the envelope of the joint entropy curve for quantum systems.     

Information entropy of a dynamical system driven by quasimonochromatic noise

This paper shows the Fokker-Planck equation of a dynamical system driven by quasimonochromatic noise. Based on the Fokker-Planck equation and the definition of Shannon's information entropy, the exact time dependence of entropy flux and entropy production for the system is calculated. The relationship between the properties of quasimonochromatic noise and dissipative parameter and their effects on entropy flux and entropy production are discussed.     

信息熵、玻尔兹曼熵以及克劳修斯熵之间的关系--兼论玻尔兹曼熵和克劳修斯熵是否等价

论述了信息熵、玻尔兹曼熵以及克劳修斯熵之间的关系;由不涉及具体系统的方法从玻尔兹曼关系、信息熵推导出了克劳修斯熵的表达式;指出玻尔兹曼熵与克劳修斯熵不是等价关系,而是玻尔兹曼熵包含克劳修斯熵,信息熵又包含玻尔兹曼熵。     

Generalized thermostatistics based on the Sharma-Mittal entropy and escort mean values

A generalized thermostatistics is developed for an entropy measure introduced by Sharma and Mittal. A maximum-entropy scheme involving the maximization of the Sharma and Mittal entropy under appropriate constraints expressed as escort mean values is advanced. Maximum-entropy distributions exhibiting a power law behavior in the asymptotic limit are obtained. Thus, results previously derived for the Renyi entropy and the Tsallis entropy are generalized. In addition, it is shown that for almost deterministic systems among all possible composable entropies with kernels that are described by power laws the Sharma-Mittal entropy is the only entropy measure that gives rise to a thermostatistics based on escort mean values and admitting of a partition function. Received 27 June 2002 Published online 31 December 2002