Mathematical Formalism of Nonequilibrium Thermodynamics for Nonlinear Chemical Reaction Systems with General Rate Law

This paper studies a mathematical formalism of nonequilibrium thermodynamics for chemical reaction models with N species, M reactions, and general rate law. We establish a mathematical basis for J. W. Gibbs’ macroscopic chemical thermodynamics under G. N. Lewis’ kinetic law of entire equilibrium (detailed balance in nonlinear chemical kinetics). In doing so, the equilibrium thermodynamics is then naturally generalized to nonequilibrium settings without detailed balance. The kinetic models are represented by a Markovian jumping process. A generalized macroscopic chemical free energy function and its associated balance equation with nonnegative source and sink are the major discoveries. The proof is based on the large deviation principle of this type of Markov processes. A general fluctuation dissipation theorem for stochastic reaction kinetics is also proved. The mathematical theory illustrates how a novel macroscopic dynamic law can emerges from the mesoscopic kinetics in a multi-scale system.     

Process with delta-correlated cumulants

In a recent paper¹) a differential equation was studied which involves a stochastic process having the property that all its cumulants are delta-correlated. It is here shown that such processes consist of a random sequence of delta functions with random coefficients. As a consequence the solutions of the differential equation are Markov processes, whose master equation can be constructed. From it closed equations for the successive moments may be obtained, and the auto-correlation is determined, in agreement with the results of reference 1. Some generalizations are given in Appendices B and C.     

Quantum stochastic processes

We first define a class of processes which we call regular quantum Markov processes. We next prove some basic results concerning such processes. A method is given for constructing quantum Markov processes using transition amplitude kernels. Finally we show that the Feynman path integral formalism can be clarified by approximating it with a quantum stochastic process.     

An equation for the characteristic function of a Markov process and its application to a Langevin process

For Markov processes a “curtailed characteristic function” is defined. It obeys an equation similar to the master equation. Its solution provides the characteristic function of the process. By applying it to the radioactive decay process the stochastic properties of the corresponding Langevin force are determined.     

Stochastic Processes and Mean Field Systems Defined by Nonlinear Markov Chains: An Illustration for a Model of Evolutionary Population Dynamics

In physics, there is a growing interest in studying stochastic processes described by evolution equations such as nonlinear master equations and nonlinear Fokker–Planck equations that define the so-called nonlinear Markov processes and are nonlinear with respect to probability densities. In this context, however, relatively little is known about nonlinear Markov processes defined by nonlinear Markov chains. In the present work, we demonstrate explicitly how the nonlinear Markov chain approach can be carried out by addressing a model for evolutionary population dynamics. In line with the nonlinear Markov chain approach, we derive a measure that tells us how attractive it is for a biological entity to evolve towards a particular biological type. Likewise, a measure for the noise level of the evolutionary process is obtained. Both measures are found to be implicitly time dependent. Finally, a simulation scheme for the many-body system corresponding to the Markov chain model is discussed.     

Multiscale Analysis for Interacting Particles: Relaxation Systems and Scalar Conservation Laws

We investigate the derivation of semilinear relaxation systems and scalar conservation laws from a class of stochastic interacting particle systems. These systems are Markov jump processes set on a lattice, they satisfy detailed mass balance (but not detailed balance of momentum), and are equipped with multiple scalings. Using a combination of correlation function methods with compactness and convergence properties of semidiscrete relaxation schemes we prove that, at a mesoscopic scale, the interacting particle system gives rise to a semilinear hyperbolic system of relaxation type, while at a macroscopic scale it yields a scalar conservation law. Rates of convergence are obtained in both scalings.     

Langevin description of markovian integro-differential master equations

For a given master equation of a discontinuous irreversible Markov process, we present the derivation of stochastically equivalent Langevin equations in which the noise is either multiplicative white generalized Poisson noise or a spectrum of multiplicative white Poisson noise. In order to achieve this goal, we introduce two new stochastic integrals of the Ito type, which provide the corresponding interpretation of the Langevin equations. The relationship with other definitions for stochastic integrals is discussed. The results are elucidated by two examples of integro-master equations describing nonlinear relaxation.     

Theory of external two-state Markov noise in the presence of internal fluctuations

A theory is presented to take into account internal fluctuations in the study of stochastically driven systems. Internal fluctuations are modeled by a master equation in which external noise is introduced. External noise is modeled by a two-state Markov process. A unified theory of internal and external fluctuations is described in terms of an effective integrodifferential master equation or its equivalent generating function representation. Two examples for which exact analytical results can be obtained are presented. A discussion of the white noise limit of the theory is also given.     

Nonlinear relaxation and fluctuations of damped quantum systems

The paper reexamines the treatment of irreversible quantum systems by master equations. Shortcomings of the conventional theory of quantum Markov processes pointed out by Talkner are analyzed. It is shown that a frequently used quantum regression hypothesis is not correct, in general. A new generalized master equation determining the relaxation to equilibrium is derived by means of time-dependent projection operator techniques. It is shown that this master equation also determines the time evolution of equilibrium correlations and response functions. The Markovian approximation is discussed, and a new type of Markovian limit, the Brownian motion limit, is introduced besides the weak coupling limit. The shortcomings of the conventional approach are resolved by deriving new formulae for the time evolution of the correlation and response functions of a quantum Markov process. The symmetries of the process are emphasized, and it is shown how the fluctuation-dissipation theorem and the detailed balance symmetry emerge from the master equation approach.     

Kinetics of crystalline configurations: I. General theory; Kinetics of homogeneous short range order

A simple and exact way of coarse graining the master equation for a Markov process in configuration space is shown to exist. The coarse grained master equation is applied to the Ising model of a homogeneous binary interstitial alloy and to a “magnetic” Ising model. Using an approximation analogous to the quasi-chemical approximation, for both models the macroscopic rate equations for the establishment of short range order and the Fokker-Planck equation governing the fluctuations are derived.     

Nonequilibrium phase transitions in chemical reactions

The far from equilibrium steady states of a simple nonlinear chemical system are analyzed. A standard macroscopic analysis shows that the nonlinearity introduces an instability which causes a transition analogous to a thermodynamic second-order phase transition. Fluctuations are introduced into this model through a stochastic master equation approach. The solution of this master equation in the steady state reveals that the system goes into a more ordered state above the transition point. An analogy is drawn with the nonequilibrium phase transition occurring in the laser at threshold.Supported by a New Zealand U.G.C. Postgraduate Scholarship.     

Microscopic preparation and macroscopic motion of a Brownian particle

We study the effect of a non-equilibrium state of the bath on the macroscopic motion of a Brownian particle (B.p.) in a linear chain. The macroscopic motion is described by a stochastic process which is non-Markovian and nonstationary due to the initial non-equilibrium of the bath. We derive generalized Langevin equations for this proces. We solve them explicitely for the case of a free B.p. and discuss the resulting mean values. A Markov approximation is valid only in the long time region, non-Markovian transients cannot be neglected. In the long time region the non-equilibrium state of the bath has the same effect as a modified macroscopic initial condition for the B.p.     

Quantum Flows as Markovian Limit of Emission,Absorption and Scattering Interactions

We consider a Markovian approximation, of weak coupling type, to an open system perturbation involving emission, absorption and scattering by reservoir quanta. The result is the general form for a quantum stochastic flow driven by creation, annihilation and gauge processes. A weak matrix limit is established for the convergence of the interaction-picture unitary to a unitary, adapted quantum stochastic process and of the Heisenberg dynamics to the corresponding quantum stochastic flow: the convergence strategy is similar to the quantum functional central limits introduced by Accardi, Frigerio and Lu [1]. The principal terms in the Dyson series expansions are identified and re-summed after the limit to obtain explicit quantum stochastic differential equations with renormalized coefficients. An extension of the Pulé inequalities [2] allows uniform estimates for the Dyson series expansion for both the unitary operator and the Heisenberg evolution to be obtained.     

A convergence proof for Bird's direct simulation Monte Carlo method for the Boltzmann equation

Bird's direct simulation Monte Carlo method for the Boltzmann equation is considered. The limit (as the number of particles tends to infinity) of the random empirical measures associated with the Bird algorithm is shown to be a deterministic measure-valued function satisfying an equation close (in a certain sense) to the Boltzmann equation. A Markov jump process is introduced, which is related to Bird's collision simulation procedure via a random time transformation. Convergence is established for the Markov process and the random time transformation. These results, together with some general properties concerning the convergence of random measures, make it possible to characterize the limiting behavior of the Bird algorithm.     

A relation between non-Markov and Markov processes

With the aid of a transformation technique, it is shown that some memory effects in the non-Markov processes can be eliminated. In other words, some non-Markov processes are rewritten in a form obtained by the random walk process; the Markov process. To this end, two model processes which have some memory or correlation in the random walk process are introduced. An explanation of the memory in the processes is given.     

The construction of an Ito model for geoelectrical signals

The Ito stochastic differential equation governs the one-dimensional diffusive Markov process. Geoelectrical signals measured in seismic areas can be considered as the result of competitive and collective interactions among system elements. The Ito equation may constitute a good macroscopic model of such a phenomenon in which microscopic interactions are adequately averaged. The present study shows how to construct an Ito model for a geoelectrical time series measured in a seismic area of southern Italy. Our results reveal that the Ito model describes the whole time series quite well, but it performs better when one considers fragments of the data set with lower variability range (absent or rare large fluctuations). Our findings show that generally detrended geoelectrical time series can be considered as approximations of Markov diffusion processes.     

Motion by curvature by scaling nonlocal evolution equations

We prove convergence to a motion by mean curvature by scaling diffusively a nonlinear, nonlocal evolution equation. This equation was introduced earlier to describe the macroscopic behavior of a ferromagnetic spin system with Kac interaction which evolves with Glauber dynamics. The convergence is proven in any time interval in which the limiting motion is regular.     

Convergence from Boltzmann to Landau Processes with Soft Potential and Particle Approximations

Our aim in this paper is to show how a probabilistic interpretation of the Boltzmann and Landau equations gives a microscopic understanding of these equations. We firstly associate stochastic jump processes with the Boltzmann equations we consider. Then we renormalize these equations following asymptotics which make prevail the grazing collisions, and prove the convergence of the associated Boltzmann jump processes to a diffusion process related to the Landau equation. The convergence is pathwise and also implies a convergence at the level of the partial differential equations. The best feature of this approach is the microscopic understanding of the transition between the Boltzmann and the Landau equations, by an accumulation of very small jumps. We deduce from this interpretation an approximation result for a solution of the Landau equation via colliding stochastic particle systems. This result leads to a Monte-Carlo algorithm for the simulation of solutions by a conservative particle method which enables to observe the transition from Boltzmann to Landau equations. Numerical results are given.