Self-Duality of Markov Processes and Intertwining Functions

We present a theorem which elucidates the connection between self-duality of Markov processes and representation theory of Lie algebras. In particular, we identify sufficient conditions such that the intertwining function between two representations of a certain Lie algebra is the self-duality function of a (Markov) operator. In concrete terms, the two representations are associated to two operators in interwining relation. The self-dual operator, which arise from an appropriate symmetric linear combination of them, is the generator of a Markov process. The theorem is applied to a series of examples, including Markov processes with a discrete state space (e.g. interacting particle systems) and Markov processes with continuous state space (e.g. diffusion processes). In the examples we use explicit representations of Lie algebras that are unitarily equivalent. As a consequence, in the discrete setting self-duality functions are given by orthogonal polynomials whereas in the continuous context they are Bessel functions.     

Completing the missing data in markov symmetric stable time series

Optimal algorithms for completing the missing data in Markov symmetric stable time series are proposed. We consider the cases where the data missing is caused by either a mechanism that is independent of the series values or a random censoring from below. The completing does not distort the probability properties of the series. Voronezh State University, Voronezh, Russia. Translated from Izvestiya Vysshikh Uchebnykh Zavedenii, Radiofizika, Vol. 43, No. 4, pp. 365–368, April. 2000.     

Linear response and fluctuation theorems for nonstationary stochastic processes

Linear response theory is developed for nonstationary Markov processes. A generalized fluctuation theorem is derived which relates the response function to a correlation of fluctuations of the unperturbed nonstationary process. It is shown that it reduces to an ordinary fluctuation theorem relating the response function to the two-point correlation between fluctuations of state variables in the case of a Gaussian distribution function. The results are illustrated by explicit calculation for the class of nonstationary linear Fokker-Planck processes.Supported by Schweizerischer Nationalfonds.     

Duality in Interacting Particle Systems and Boson Representation

In the context of Markov processes, we show a new scheme to derive dual processes and a duality function based on a boson representation. This scheme is applicable to a case in which a generator is expressed by boson creation and annihilation operators. For some stochastic processes, duality relations have been known, which connect continuous time Markov processes with discrete state space and those with continuous state space. We clarify that using a generating function approach and the Doi-Peliti method, a birth-death process (or discrete random walk model) is naturally connected to a differential equation with continuous variables, which would be interpreted as a dual Markov process. The key point in the derivation is to use bosonic coherent states as a bra state, instead of a conventional projection state. As examples, we apply the scheme to a simple birth-coagulation process and a Brownian momentum process. The generator of the Brownian momentum process is written by elements of the SU(1,1) algebra, and using a boson realization of SU(1,1) we show that the same scheme is available.     

Nonlinear Markov processes

Some elementary properties and examples of Markov processes are reviewed. It is shown that the definition of the Markov property naturally leads to a classification of Markov processes into linear and nonlinear ones.     

A Gallavotti–Cohen-Type Symmetry in the Large Deviation Functional for Stochastic Dynamics

We extend the work of Kurchan on the Gallavotti–Cohen fluctuation theorem, which yields a symmetry property of the large deviation function, to general Markov processes. These include jump processes describing the evolution of stochastic lattice gases driven in the bulk or through particle reservoirs, general diffusive processes in physical and/or velocity space, as well as Hamiltonian systems with stochastic boundary conditions. For dynamics satisfying local detailed balance we establish a link between the average of the action functional in the fluctuation theorem and the macroscopic entropy production. This gives, in the linear regime, an alternative derivation of the Green–Kubo formula and the Onsager reciprocity relations. In the nonlinear regime consequences of the new symmetry are harder to come by and the large deviation functional difficult to compute. For the asymmetric simple exclusion process the latter is determined explicitly using the Bethe ansatz in the limit of large N.     

An equation for the characteristic function of a Markov process and its application to a Langevin process

For Markov processes a “curtailed characteristic function” is defined. It obeys an equation similar to the master equation. Its solution provides the characteristic function of the process. By applying it to the radioactive decay process the stochastic properties of the corresponding Langevin force are determined.     

Chaos from nonlinear Markov processes: Why the whole is different from the sum of its parts

Nonlinear Markov processes have been frequently used to address bifurcations and multistability in equilibrium and non-equilibrium many-body systems. However, our understanding of the range of phenomena produced by nonlinear Markov processes is still in its infancy. We demonstrate that in addition to bifurcations and multistability nonlinear Markov processes can exhibit another key phenomena well known in the realm of nonlinear physics: chaos. It is argued that chaotically evolving process probabilities are a generic feature of many-body systems exhibiting nonlinear Markov processes even if the isolated subsystems do not exhibit chaos. That is, when considering a nonlinear Markov process as an entity of its own type, then the nonlinear Markov process in general is qualitatively different from its constituent subprocesses, which reflects that the many-body system as a whole is different from the sum of its parts.     

Linear filtering of nonstationary stochastic Gaussian noise power

Optimum linear filtering of the variance of stationary Gaussian noise is extended to the case where the noise variance is a function of an unobservable Markov control process. Discrete observations are examined. Tomsk State University. Translated from Izvestiya Vysshikh Uchebnykh Zavedenii, Fizika, No. 4, pp. 3–7, April, 1999.     

Probability characteristics of the absolute maximum of generalized rayleigh stochastic process

We obtain the limiting laws of distribution of the absolute maximum of the generalized Rayleigh random process. Using the methods of statistical modeling, we show that the asymptotic approximations are in good agreement with the actual distributions over a wide range of parameters of the random process. Voronezh State University, Voronezh, Russia. Translated from Izvestiya Vysshikh Uchebnykh Zavedenii, Radiofizika, Vol. 42, No. 12, pp. 1213–1222, September 1999.     

Alternative interpretations of power-law distributions found in nature

We investigate two inherently different classes of probability density functions (pdfs) that share the common property of power law tails: the α-stable Le?vy process and the linear Markov diffusion process with additive and multiplicative Gaussian noise. Dynamical processes described by these distributions cannot be uniquely identified as belonging to one or the other class either by diverging variance due to power-law tails in the pdf or by the possible existence of skew. However, there are distinguishing features that may be found in sufficiently well sampled time series. We examine these features and discuss how they may guide the development of proper approximations to equations of motion underlying dynamical systems. An additional result of this research was the identification of a variable describing the relative importance of the multiplicative and independent additive noise forcing in our linear Markov process. The distribution of this variable is generally skewed, depending on the level of correlation between the additive and multiplicative noise.     

Nonlinear Markov Semigroups and Interacting Lévy Type Processes

Semigroups of positivity preserving linear operators on measures of a measurable space X describe the evolutions of probability distributions of Markov processes on X. Their dual semigroups of positivity preserving linear operators on the space of measurable bounded functions B(X) on X describe the evolutions of averages over the trajectories of these Markov processes. In this paper we introduce and study the general class of semigroups of non-linear positivity preserving transformations on measures that is non-linear Markov or Feller semigroups. An explicit structure of generators of such groups is given in case when X is the Euclidean space R ^d (or more generally, a manifold) showing how these semigroups arise from the general kinetic equations of statistical mechanics and evolutionary biology that describe the dynamic law of large numbers for Markov models of interacting particles. Well posedness results for these equations are given together with applications to interacting particles: dynamic law of large numbers and central limit theorem, the latter being new already for the standard coagulation-fragmentation models.     

Linear power filtration of nonsteady, doubly-stochastic, Gaussian noise

Optimal linear filtration of the dispersion of a nonsteady Gaussian noise, the dispersion of which is a function of an unobservable Markov control process, is considered. Discrete and continuous, first-order, autoregression models are considered, and a limiting transition is made. Tomsk State University. Translated from Izvestiya Vysshikh Uchebnykh Zavedenii, Fizika, No. 4, pp. 15–22, April, 1998.     

Stochastic Processes and Mean Field Systems Defined by Nonlinear Markov Chains: An Illustration for a Model of Evolutionary Population Dynamics

In physics, there is a growing interest in studying stochastic processes described by evolution equations such as nonlinear master equations and nonlinear Fokker–Planck equations that define the so-called nonlinear Markov processes and are nonlinear with respect to probability densities. In this context, however, relatively little is known about nonlinear Markov processes defined by nonlinear Markov chains. In the present work, we demonstrate explicitly how the nonlinear Markov chain approach can be carried out by addressing a model for evolutionary population dynamics. In line with the nonlinear Markov chain approach, we derive a measure that tells us how attractive it is for a biological entity to evolve towards a particular biological type. Likewise, a measure for the noise level of the evolutionary process is obtained. Both measures are found to be implicitly time dependent. Finally, a simulation scheme for the many-body system corresponding to the Markov chain model is discussed.     

A comment on the paper “Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations” by T.D. Frank

The purpose of this comment is to correct mistaken assumptions and claims made in the paper “Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations” by T. D. Frank [T.D. Frank, Stochastic feedback, non-linear families of Markov processes, and nonlinear Fokker-Planck equations, Physica A 331 (2004) 391]. Our comment centers on the claims of a “non-linear Markov process” and a “non-linear Fokker-Planck equation.” First, memory in transition densities is misidentified as a Markov process. Second, the paper assumes that one can derive a Fokker-Planck equation from a Chapman-Kolmogorov equation, but no proof was offered that a Chapman-Kolmogorov equation exists for the memory-dependent processes considered. A “non-linear Markov process” is claimed on the basis of a non-linear diffusion pde for a 1-point probability density. We show that, regardless of which initial value problem one may solve for the 1-point density, the resulting stochastic process, defined necessarily by the conditional probabilities (the transition probabilities), is either an ordinary linearly generated Markovian one, or else is a linearly generated non-Markovian process with memory. We provide explicit examples of diffusion coefficients that reflect both the Markovian and the memory-dependent cases. So there is neither a “non-linear Markov process”, nor a “non-linear Fokker-Planck equation” for a conditional probability density. The confusion rampant in the literature arises in part from labeling a non-linear diffusion equation for a 1-point probability density as “non-linear Fokker-Planck,” whereas neither a 1-point density nor an equation of motion for a 1-point density can define a stochastic process. In a closely related context, we point out that Borland misidentified a translation invariant 1-point probability density derived from a non-linear diffusion equation as a conditional probability density. Finally, in the Appendix A we present the theory of Fokker-Planck pdes and Chapman-Kolmogorov equations for stochastic processes with finite memory.     

Fluctuation symmetry in a two-state Markov model

We show that the scaled cumulant generating and large deviation function, associated to a two-state Markov process involving two processes, obey a symmetry relation reminiscent of the fluctuation theorem, independent from any conditions on the transition rates. The Legendre transform leading from the scaled cumulant generating function to the large deviation function is performed in an ingenious way, avoiding the sign problem associated to taking a square root. Applications to the theory of random walks and to the stochastic thermodynamics for a quantum dot are presented.     

A relation between non-Markov and Markov processes

With the aid of a transformation technique, it is shown that some memory effects in the non-Markov processes can be eliminated. In other words, some non-Markov processes are rewritten in a form obtained by the random walk process; the Markov process. To this end, two model processes which have some memory or correlation in the random walk process are introduced. An explanation of the memory in the processes is given.     

Quantum stochastic processes

We first define a class of processes which we call regular quantum Markov processes. We next prove some basic results concerning such processes. A method is given for constructing quantum Markov processes using transition amplitude kernels. Finally we show that the Feynman path integral formalism can be clarified by approximating it with a quantum stochastic process.