Singularly Perturbed Markov Chains: Convergence and Aggregation |
| |
Authors: | G Yin Q Zhang G Badowski |
| |
Institution: | Department of Mathematics, Wayne State University, Detroit, Michigan, 48202, f1;Department of Mathematics, University of Georgia, Athens, Georgia, 30602, , f2;Department of Mathematics, Wayne State University, Detroit, Michigan, 48202, , f3 |
| |
Abstract: | Asymptotic properties of singularly perturbed Markov chains having measurable and/or continuous generators are developed in this work. The Markov chain under consideration has a finite-state space and is allowed to be nonstationary. Its generator consists of a rapidly varying part and a slowly changing part. The primary concerns are on the properties of the probability vectors and an aggregated process that depend on the characteristics of the fast varying part of the generators. The fast changing part of the generators can either consist of l recurrent classes, or include also transient states in addition to the recurrent classes. The case of inclusion of transient states is examined in detail. Convergence of the probability vectors under the weak topology of L2 is obtained first. Then under slightly stronger conditions, it is shown that the convergence also takes place pointwise. Moreover, convergence under the norm topology of L2 is derived. Furthermore, a process with aggregated states is obtained which converges to a Markov chain in distribution. |
| |
Keywords: | singularly perturbed Markov chain weak topology pointwise convergence convergence in L2 aggregation weak convergence |
本文献已被 ScienceDirect 等数据库收录! |
|