On the mixing property and the ergodic principle for nonhomogeneous Markov chains

We study different types of limit behavior of infinite dimension discrete time nonhomogeneous Markov chains. We show that the geometric structure of the set of those Markov chains which have asymptotically stationary density depends on the considered topologies. We generalize and correct some results from Ganikhodjaev et al. (2006) [3].     

Subgeometric rates of convergence of f-ergodic strong Markov processes

We provide a condition in terms of a supermartingale property for a functional of the Markov process, which implies (a) f$f$-ergodicity of strong Markov processes at a subgeometric rate, and (b) a moderate deviation principle for an integral (bounded) functional. An equivalent condition in terms of a drift inequality on the extended generator is also given. Results related to (f,r)$(f,r)$-regularity of the process, of some skeleton chains and of the resolvent chain are also derived. Applications to specific processes are considered, including elliptic stochastic differential equations, Langevin diffusions, hypoelliptic stochastic damping Hamiltonian systems and storage models.     

Imprecise Markov chains with absorption

We consider convergence of Markov chains with uncertain parameters, known as imprecise Markov chains, which contain an absorbing state. We prove that under conditioning on non-absorption the imprecise conditional probabilities converge independently of the initial imprecise probability distribution if some regularity conditions are assumed. This is a generalisation of a known result from the classical theory of Markov chains by Darroch and Seneta [6].     

A classification of invariant distributions and convergence of imprecise Markov chains

We analyse the structure of imprecise Markov chains and study their convergence by means of accessibility relations. We first identify the sets of states, so-called minimal permanent classes, that are the minimal sets capable of containing and preserving the whole probability mass of the chain. These classes generalise the essential classes known from the classical theory. We then define a class of extremal imprecise invariant distributions and show that they are uniquely determined by the values of the upper probability on minimal permanent classes. Moreover, we give conditions for unique convergence to these extremal invariant distributions.     

New perturbation bounds for denumerable Markov chains

This paper is devoted to perturbation analysis of denumerable Markov chains. Bounds are provided for the deviation between the stationary distribution of the perturbed and nominal chain, where the bounds are given by the weighted supremum norm. In addition, bounds for the perturbed stationary probabilities are established. Furthermore, bounds on the norm of the asymptotic decomposition of the perturbed stationary distribution are provided, where the bounds are expressed in terms of the norm of the ergodicity coefficient, or the norm of a special residual matrix. Refinements of our bounds for Doeblin Markov chains are considered as well. Our results are illustrated with a number of examples.     

Periodic points classify a family of Markov shifts

Ledrappier introduced the following type of space of doubly indexed sequences over a finite abelian group G,

     

Transition matrices for well-conditioned Markov chains

Let T∈R^n×n be an irreducible stochastic matrix with stationary distribution vector π. Set A = I − T, and define the quantity , where A_j, j = 1, … , n, are the (n − 1) × (n − 1) principal submatrices of A obtained by deleting the jth row and column of A. Results of Cho and Meyer, and of Kirkland show that κ₃ provides a sensitive measure of the conditioning of π under perturbation of T. Moreover, it is known that .In this paper, we investigate the class of irreducible stochastic matrices T of order n such that , for such matrices correspond to Markov chains with desirable conditioning properties. We identify some restrictions on the zero-nonzero patterns of such matrices, and construct several infinite classes of matrices for which κ₃ is as small as possible.     

Geometric ergodicity for classes of homogeneous Markov chains

The paper deals with non asymptotic computable bounds for the geometric convergence rate of homogeneous ergodic Markov processes. Some sufficient conditions are stated for simultaneous geometric ergodicity of Markov chain classes. This property is applied to nonparametric estimation in ergodic diffusion processes.     

On asymptotics for Vaserstein coupling of Markov chains

We prove that strong ergodicity of a Markov process is linked with a spectral radius of a certain “associated” semigroup operator, although, not a “natural” one. We also give sufficient conditions for weak ergodicity and provide explicit estimates of the convergence rate. To establish these results we construct a modification of the Vaserstein coupling. Some applications including mixing properties are also discussed.     

One-point extensions of Markov processes by darning

This paper is a continuation of the works by Fukushima–Tanaka (Ann Inst Henri Poincaré Probab Stat 41: 419–459, 2005) and Chen–Fukushima–Ying (Stochastic Analysis and Application, p.153–196. The Abel Symposium, Springer, Heidelberg) on the study of one-point extendability of a pair of standard Markov processes in weak duality. In this paper, general conditions to ensure such an extension are given. In the symmetric case, characterizations of the one-point extensions are given in terms of their Dirichlet forms and in terms of their L ²-infinitesimal generators. In particular, a generalized notion of flux is introduced and is used to characterize functions in the domain of the L ²-infinitesimal generator of the extended process. An important role in our investigation is played by the α-order approaching probability u _α . The research of Z.-Q. Chen is supported in part by NSF Grant DMS-0600206. The research of M. Fukushima is supported in part by Grant-in-Aid for Scientific Research of MEXT No.19540125.