Rényi Entropy and Free Energy

The Rényi entropy is a generalization of the usual concept of entropy which depends on a parameter q. In fact, Rényi entropy is closely related to free energy. Suppose we start with a system in thermal equilibrium and then suddenly divide the temperature by q. Then the maximum amount of work the system can perform as it moves to equilibrium at the new temperature divided by the change in temperature equals the system’s Rényi entropy in its original state. This result applies to both classical and quantum systems. Mathematically, we can express this result as follows: the Rényi entropy of a system in thermal equilibrium is without the ‘q−1-derivative’ of its free energy with respect to the temperature. This shows that Rényi entropy is a q-deformation of the usual concept of entropy.     

High Dimensional Atomic States of Hydrogenic Type: Heisenberg-like and Entropic Uncertainty Measures

High dimensional atomic states play a relevant role in a broad range of quantum fields, ranging from atomic and molecular physics to quantum technologies. The D-dimensional hydrogenic system (i.e., a negatively-charged particle moving around a positively charged core under a Coulomb-like potential) is the main prototype of the physics of multidimensional quantum systems. In this work, we review the leading terms of the Heisenberg-like (radial expectation values) and entropy-like (Rényi, Shannon) uncertainty measures of this system at the limit of high D. They are given in a simple compact way in terms of the space dimensionality, the Coulomb strength and the state’s hyperquantum numbers. The associated multidimensional position–momentum uncertainty relations are also revised and compared with those of other relevant systems.     

Short-Term Effect of Percutaneous Coronary Intervention on Heart Rate Variability in Patients with Coronary Artery Disease

Myocardial ischemia in patients with coronary artery disease (CAD) leads to imbalanced autonomic control that increases the risk of morbidity and mortality. To systematically examine how autonomic function responds to percutaneous coronary intervention (PCI) treatment, we analyzed data of 27 CAD patients who had admitted for PCI in this pilot study. For each patient, five-minute resting electrocardiogram (ECG) signals were collected before and after the PCI procedure. The time intervals between ECG collection and PCI were both within 24 h. To assess autonomic function, normal sinus RR intervals were extracted and were analyzed quantitatively using traditional linear time- and frequency-domain measures [i.e., standard deviation of the normal-normal intervals (SDNN), the root mean square of successive differences (RMSSD), powers of low frequency (LF) and high frequency (HF) components, LF/HF] and nonlinear entropy measures [i.e., sample entropy (SampEn), distribution entropy (DistEn), and conditional entropy (CE)], as well as graphical metrics derived from Poincaré plot [i.e., Porta’s index (PI), Guzik’s index (GI), slope index (SI) and area index (AI)]. Results showed that after PCI, AI and PI decreased significantly (p < 0.002 and 0.015, respectively) with effect sizes of 0.88 and 0.70 as measured by Cohen’s d static. These changes were independent of sex. The results suggest that graphical AI and PI metrics derived from Poincaré plot of short-term ECG may be potential for sensing the beneficial effect of PCI on cardiovascular autonomic control. Further studies with bigger sample sizes are warranted to verify these observations.     

Robust Test Statistics Based on Restricted Minimum Rényi’s Pseudodistance Estimators

The Rao’s score, Wald and likelihood ratio tests are the most common procedures for testing hypotheses in parametric models. None of the three test statistics is uniformly superior to the other two in relation with the power function, and moreover, they are first-order equivalent and asymptotically optimal. Conversely, these three classical tests present serious robustness problems, as they are based on the maximum likelihood estimator, which is highly non-robust. To overcome this drawback, some test statistics have been introduced in the literature based on robust estimators, such as robust generalized Wald-type and Rao-type tests based on minimum divergence estimators. In this paper, restricted minimum Rényi’s pseudodistance estimators are defined, and their asymptotic distribution and influence function are derived. Further, robust Rao-type and divergence-based tests based on minimum Rényi’s pseudodistance and restricted minimum Rényi’s pseudodistance estimators are considered, and the asymptotic properties of the new families of tests statistics are obtained. Finally, the robustness of the proposed estimators and test statistics is empirically examined through a simulation study, and illustrative applications in real-life data are analyzed.     

Alternative Entropy Measures and Generalized Khinchin–Shannon Inequalities

The Khinchin–Shannon generalized inequalities for entropy measures in Information Theory, are a paradigm which can be used to test the Synergy of the distributions of probabilities of occurrence in physical systems. The rich algebraic structure associated with the introduction of escort probabilities seems to be essential for deriving these inequalities for the two-parameter Sharma–Mittal set of entropy measures. We also emphasize the derivation of these inequalities for the special cases of one-parameter Havrda–Charvat’s, Rényi’s and Landsberg–Vedral’s entropy measures.     

Formulation of Time-Fractional Electrodynamics Based on Riemann-Silberstein Vector

In this paper, the formulation of time-fractional (TF) electrodynamics is derived based on the Riemann-Silberstein (RS) vector. With the use of this vector and fractional-order derivatives, one can write TF Maxwell’s equations in a compact form, which allows for modelling of energy dissipation and dynamics of electromagnetic systems with memory. Therefore, we formulate TF Maxwell’s equations using the RS vector and analyse their properties from the point of view of classical electrodynamics, i.e., energy and momentum conservation, reciprocity, causality. Afterwards, we derive classical solutions for wave-propagation problems, assuming helical, spherical, and cylindrical symmetries of solutions. The results are supported by numerical simulations and their analysis. Discussion of relations between the TF Schrödinger equation and TF electrodynamics is included as well.     

Action and Entropy in Heat Engines: An Action Revision of the Carnot Cycle

Despite the remarkable success of Carnot’s heat engine cycle in founding the discipline of thermodynamics two centuries ago, false viewpoints of his use of the caloric theory in the cycle linger, limiting his legacy. An action revision of the Carnot cycle can correct this, showing that the heat flow powering external mechanical work is compensated internally with configurational changes in the thermodynamic or Gibbs potential of the working fluid, differing in each stage of the cycle quantified by Carnot as caloric. Action (@) is a property of state having the same physical dimensions as angular momentum (mrv = mr²ω). However, this property is scalar rather than vectorial, including a dimensionless phase angle (@ = mr²ωδφ). We have recently confirmed with atmospheric gases that their entropy is a logarithmic function of the relative vibrational, rotational, and translational action ratios with Planck’s quantum of action ħ. The Carnot principle shows that the maximum rate of work (puissance motrice) possible from the reversible cycle is controlled by the difference in temperature of the hot source and the cold sink: the colder the better. This temperature difference between the source and the sink also controls the isothermal variations of the Gibbs potential of the working fluid, which Carnot identified as reversible temperature-dependent but unequal caloric exchanges. Importantly, the engine’s inertia ensures that heat from work performed adiabatically in the expansion phase is all restored to the working fluid during the adiabatic recompression, less the net work performed. This allows both the energy and the thermodynamic potential to return to the same values at the beginning of each cycle, which is a point strongly emphasized by Carnot. Our action revision equates Carnot’s calorique, or the non-sensible heat later described by Clausius as ‘work-heat’, exclusively to negative Gibbs energy (−G) or quantum field energy. This action field complements the sensible energy or vis-viva heat as molecular kinetic motion, and its recognition should have significance for designing more efficient heat engines or better understanding of the heat engine powering the Earth’s climates.     

Towards Unification of General Relativity and Quantum Theory: Dendrogram Representation of the Event-Universe

Following Smolin, we proceed to unification of general relativity and quantum theory by operating solely with events, i.e., without appealing to physical systems and space-time. The universe is modelled as a dendrogram (finite tree) expressing the hierarchic relations between events. This is the observational (epistemic) model; the ontic model is based on p-adic numbers (infinite trees). Hence, we use novel mathematics: not only space-time but even real numbers are not in use. Here, the p-adic space (which is zero-dimensional) serves as the base for the holographic image of the universe. In this way our theory is connected with p-adic physics; in particular, p-adic string theory and complex disordered systems (p-adic representation of the Parisi matrix for spin glasses). Our Dendrogramic-Holographic (DH) theory matches perfectly with the Mach’s principle and Brans–Dicke theory. We found a surprising informational interrelation between the fundamental constants, h, c, G, and their DH analogues, h(D), c(D), G(D). DH theory is part of Wheeler’s project on the information restructuring of physics. It is also a step towards the Unified Field theory. The universal potential V is nonlocal, but this is relational DH nonlocality. V can be coupled to the Bohm quantum potential by moving to the real representation. This coupling enhances the role of the Bohm potential.     

Order-Stability in Complex Biological,Social, and AI-Systems from Quantum Information Theory

This paper is our attempt, on the basis of physical theory, to bring more clarification on the question “What is life?” formulated in the well-known book of Schrödinger in 1944. According to Schrödinger, the main distinguishing feature of a biosystem’s functioning is the ability to preserve its order structure or, in mathematical terms, to prevent increasing of entropy. However, Schrödinger’s analysis shows that the classical theory is not able to adequately describe the order-stability in a biosystem. Schrödinger also appealed to the ambiguous notion of negative entropy. We apply quantum theory. As is well-known, behaviour of the quantum von Neumann entropy crucially differs from behaviour of classical entropy. We consider a complex biosystem S composed of many subsystems, say proteins, cells, or neural networks in the brain, that is, S=(Si). We study the following problem: whether the compound system S can maintain “global order” in the situation of an increase of local disorder and if S can preserve the low entropy while other Si increase their entropies (may be essentially). We show that the entropy of a system as a whole can be constant, while the entropies of its parts rising. For classical systems, this is impossible, because the entropy of S cannot be less than the entropy of its subsystem Si. And if a subsystems’s entropy increases, then a system’s entropy should also increase, by at least the same amount. However, within the quantum information theory, the answer is positive. The significant role is played by the entanglement of a subsystems’ states. In the absence of entanglement, the increasing of local disorder implies an increasing disorder in the compound system S (as in the classical regime). In this note, we proceed within a quantum-like approach to mathematical modeling of information processing by biosystems—respecting the quantum laws need not be based on genuine quantum physical processes in biosystems. Recently, such modeling found numerous applications in molecular biology, genetics, evolution theory, cognition, psychology and decision making. The quantum-like model of order stability can be applied not only in biology, but also in social science and artificial intelligence.     

Survival of Virus Particles in Water Droplets: Hydrophobic Forces and Landauer’s Principle

Many small biological objects, such as viruses, survive in a water environment and cannot remain active in dry air without condensation of water vapor. From a physical point of view, these objects belong to the mesoscale, where small thermal fluctuations with the characteristic kinetic energy of k_BT (where k_B is the Boltzmann’s constant and T is the absolute temperature) play a significant role. The self-assembly of viruses, including protein folding and the formation of a protein capsid and lipid bilayer membrane, is controlled by hydrophobic forces (i.e., the repulsing forces between hydrophobic particles and regions of molecules) in a water environment. Hydrophobic forces are entropic, and they are driven by a system’s tendency to attain the maximum disordered state. On the other hand, in information systems, entropic forces are responsible for erasing information, if the energy barrier between two states of a switch is on the order of k_BT, which is referred to as Landauer’s principle. We treated hydrophobic interactions responsible for the self-assembly of viruses as an information-processing mechanism. We further showed a similarity of these submicron-scale processes with the self-assembly in colloidal crystals, droplet clusters, and liquid marbles.     

A Dynamic Autocatalytic Network Model of Therapeutic Change

Psychotherapy involves the modification of a client’s worldview to reduce distress and enhance well-being. We take a human dynamical systems approach to modeling this process, using Reflexively Autocatalytic foodset-derived (RAF) networks. RAFs have been used to model the self-organization of adaptive networks associated with the origin and early evolution of both biological life, as well as the evolution and development of the kind of cognitive structure necessary for cultural evolution. The RAF approach is applicable in these seemingly disparate cases because it provides a theoretical framework for formally describing under what conditions systems composed of elements that interact and ‘catalyze’ the formation of new elements collectively become integrated wholes. In our application, the elements are mental representations, and the whole is a conceptual network. The initial components—referred to as foodset items—are mental representations that are innate, or were acquired through social learning or individual learning (of pre-existing information). The new elements—referred to as foodset-derived items—are mental representations that result from creative thought (resulting in new information). In clinical psychology, a client’s distress may be due to, or exacerbated by, one or more beliefs that diminish self-esteem. Such beliefs may be formed and sustained through distorted thinking, and the tendency to interpret ambiguous events as confirmation of these beliefs. We view psychotherapy as a creative collaborative process between therapist and client, in which the output is not an artwork or invention but a more well-adapted worldview and approach to life on the part of the client. In this paper, we model a hypothetical albeit representative example of the formation and dissolution of such beliefs over the course of a therapist–client interaction using RAF networks. We show how the therapist is able to elicit this worldview from the client and create a conceptualization of the client’s concerns. We then formally demonstrate four distinct ways in which the therapist is able to facilitate change in the client’s worldview: (1) challenging the client’s negative interpretations of events, (2) providing direct evidence that runs contrary to and counteracts the client’s distressing beliefs, (3) using self-disclosure to provide examples of strategies one can use to diffuse a negative conclusion, and (4) reinforcing the client’s attempts to assimilate such strategies into their own ways of thinking. We then discuss the implications of such an approach to expanding our knowledge of the development of mental health concerns and the trajectory of the therapeutic change.     

Spherical-Symmetry and Spin Effects on the Uncertainty Measures of Multidimensional Quantum Systems with Central Potentials

The spreading of the stationary states of the multidimensional single-particle systems with a central potential is quantified by means of Heisenberg-like measures (radial and logarithmic expectation values) and entropy-like quantities (Fisher, Shannon, Rényi) of position and momentum probability densities. Since the potential is assumed to be analytically unknown, these dispersion and information-theoretical measures are given by means of inequality-type relations which are explicitly shown to depend on dimensionality and state’s angular hyperquantum numbers. The spherical-symmetry and spin effects on these spreading properties are obtained by use of various integral inequalities (Daubechies–Thakkar, Lieb–Thirring, Redheffer–Weyl, ...) and a variational approach based on the extremization of entropy-like measures. Emphasis is placed on the uncertainty relations, upon which the essential reason of the probabilistic theory of quantum systems relies.     

From Rényi Entropy Power to Information Scan of Quantum States

In this paper, we generalize the notion of Shannon’s entropy power to the Rényi-entropy setting. With this, we propose generalizations of the de Bruijn identity, isoperimetric inequality, or Stam inequality. This framework not only allows for finding new estimation inequalities, but it also provides a convenient technical framework for the derivation of a one-parameter family of Rényi-entropy-power-based quantum-mechanical uncertainty relations. To illustrate the usefulness of the Rényi entropy power obtained, we show how the information probability distribution associated with a quantum state can be reconstructed in a process that is akin to quantum-state tomography. We illustrate the inner workings of this with the so-called “cat states”, which are of fundamental interest and practical use in schemes such as quantum metrology. Salient issues, including the extension of the notion of entropy power to Tsallis entropy and ensuing implications in estimation theory, are also briefly discussed.     

Wigner’s Friend Scenarios and the Internal Consistency of Standard Quantum Mechanics

Wigner’s friend scenarios involve an Observer, or Observers, measuring a Friend, or Friends, who themselves make quantum measurements. In recent discussions, it has been suggested that quantum mechanics may not always be able to provide a consistent account of a situation involving two Observers and two Friends. We investigate this problem by invoking the basic rules of quantum mechanics as outlined by Feynman in the well-known “Feynman Lectures on Physics”. We show here that these “Feynman rules” constrain the a priori assumptions which can be made in generalised Wigner’s friend scenarios, because the existence of the probabilities of interest ultimately depends on the availability of physical evidence (material records) of the system’s past. With these constraints obeyed, a non-ambiguous and consistent account of all measurement outcomes is obtained for all agents, taking part in various Wigner’s Friend scenarios.     

A Generalization of the Concavity of Rényi Entropy Power

Recently, Savaré-Toscani proved that the Rényi entropy power of general probability densities solving the p-nonlinear heat equation in Rn is a concave function of time under certain conditions of three parameters n,p,μ , which extends Costa’s concavity inequality for Shannon’s entropy power to the Rényi entropy power. In this paper, we give a condition Φ(n,p,μ) of n,p,μ under which the concavity of the Rényi entropy power is valid. The condition Φ(n,p,μ) contains Savaré-Toscani’s condition as a special case and much more cases. Precisely, the points (n,p,μ) satisfying Savaré-Toscani’s condition consist of a two-dimensional subset of R3 , and the points satisfying the condition Φ(n,p,μ) consist a three-dimensional subset of R3 . Furthermore, Φ(n,p,μ) gives the necessary and sufficient condition in a certain sense. Finally, the conditions are obtained with a systematic approach.     

Explicit time-reversible orbit integration in Particle In Cell codes with static homogeneous magnetic field

A new explicit time-reversible orbit integrator for the equations of motion in a static homogeneous magnetic field – called Cyclotronic integrator – is presented. Like Spreiter and Walter’s Taylor expansion algorithm, for sufficiently weak electric field gradients this second order method does not require a fine resolution of the Larmor motion; it has however the essential advantage of being symplectic, hence time-reversible. The Cyclotronic integrator is only subject to a linear stability constraint (ΩΔt < π, Ω being the Larmor angular frequency), and is therefore particularly suitable to electrostatic Particle In Cell codes with uniform magnetic field where Ω is larger than any other characteristic frequency, yet a resolution of the particles’ gyromotion is required. Application examples and a detailed comparison with the well-known (time-reversible) Boris algorithm are presented; it is in particular shown that implementation of the Cyclotronic integrator in the kinetic codes SCEPTIC and Democritus can reduce the cost of orbit integration by up to a factor of ten.     

Numerical irreversibility in self-gravitating small N-body systems, II: Influence of instability affected by softening parameters

We investigate the fundamental characteristics of numerical irreversibility appearing in self-gravitating small N-body systems by means of a molecular dynamics method from the viewpoint of time-reversible dynamics. We reconsider a closed spherical system consisting of 250 point-particles interacting through the Plummer softened potential. To investigate the characteristics of numerical irreversibility, we examine the influence of the instability affected by the softening parameter for the softened potential (the instability considered here is the instability of a dynamical system in chaos theory, e.g., a separation rate of the distance between two nearby trajectories in phase space or speed space). To this end, under the restriction of constant initial energy, the softening parameter for the Plummer softened potential is varied from 0.005R to 0.050R, where R is the radius of the spherical container. We first confirm that the size of the softening parameter, i.e., the deviation of the potential from a pure gravitational potential, influences the virial ratio, the density, the pressure on the spherical container, etc., during an early stage of the relaxation process. Through a time-reversible simulation based on a velocity inversion technique, we demonstrate that numerical irreversibility due to round-off errors appears more rapidly with decreasing softening parameter. This means that the higher the instability of the system or the higher the separation rate of the distance between two nearby trajectories, the earlier the memory of the initial conditions is lost. We show that the memory loss time , when the simulated trajectory completely forgets its initial conditions, increases approximately linearly with the timescale of the chaotic system, i.e., the Lyapunov time t_λ. In a small self-gravitating system, propagation of numerical irreversibility or loss of reversibility depends on both the energy state of the system and the instability affected by the softening parameter.     

Anisotropic Diffusion in Driven Convection Arrays

We numerically investigate the transport of a Brownian colloidal particle in a square array of planar counter-rotating convection rolls at high Péclet numbers. We show that an external force produces huge excess peaks of the particle’s diffusion constant with a height that depends on the force orientation and intensity. In sharp contrast, the particle’s mobility is isotropic and force independent. We relate such a nonlinear response of the system to the advection properties of the laminar flow in the suspension fluid.     

On Rényi Permutation Entropy

Among various modifications of the permutation entropy defined as the Shannon entropy of the ordinal pattern distribution underlying a system, a variant based on Rényi entropies was considered in a few papers. This paper discusses the relatively new concept of Rényi permutation entropies in dependence of non-negative real number q parameterizing the family of Rényi entropies and providing the Shannon entropy for q=1. Its relationship to Kolmogorov–Sinai entropy and, for q=2, to the recently introduced symbolic correlation integral are touched.     

Probability Representation of Quantum States

The review of new formulation of conventional quantum mechanics where the quantum states are identified with probability distributions is presented. The invertible map of density operators and wave functions onto the probability distributions describing the quantum states in quantum mechanics is constructed both for systems with continuous variables and systems with discrete variables by using the Born’s rule and recently suggested method of dequantizer–quantizer operators. Examples of discussed probability representations of qubits (spin-1/2, two-level atoms), harmonic oscillator and free particle are studied in detail. Schrödinger and von Neumann equations, as well as equations for the evolution of open systems, are written in the form of linear classical–like equations for the probability distributions determining the quantum system states. Relations to phase–space representation of quantum states (Wigner functions) with quantum tomography and classical mechanics are elucidated.