The branching chain with drift in space-time random environment (I): Model,Markov property,moments

There are three parts in this article. In Section 1, we establish the model of branching chain with drift in space-time random environment (BCDSTRE), i.e., the coupling of branching chain and random walk. In Section 2, we prove that any BCDSTRE must be a Markov chain in time random environment when we consider the distribution of the particles in space as a random element. In Section 3, we calculate the first-order moments and the second-order moments of BCDSTRE.     

THE BRANCHING CHAIN WITH DRIFT IN SPACE-TIME RANDOM ENVIRONMENT （I）： MODEL,MARKOV PROPERTY,MOMENTS

There are three parts in this article. In Section 1, we establish the model of branching chain with drift in space-time random environment （BCDSTRE）, i.e., the coupling of branching chain and random walk. In Section 2, we prove that any BCDSTRE must be a Markov chain in time random environment when we consider the distribution of the particles in space as a random element. In Section 3, we calculate the first-order moments and the second-order moments of BCDSTRE.     

THE CONSTRUCTION OF MULTITYPE CANONICAL MARKOV BRANCHING CHAINS IN RANDOM ENVIRONMENTS

The investigation for branching processes has a long history by their strong physics background, but only a few authors have investigated the branching processes in random environments. First of all, the author introduces the concepts of the multitype canonical Markov branching chain in random environment (CMBCRE) and multitype Markov branching chain in random environment (MBCRE) and proved that CMBCRE must be MBCRE, and any MBCRE must be equivalent to another CMBCRE in distribution. The main results of this article are the construction of CMBCRE and some of its probability properties.     

从p—m链到随机环境中的马氏链

第一节引进了p一m链的概念,并用之构造了与它相应的随机环境中的马氏链和绕积马氏链、第二节引进了一系列与随机环境中的马氏链相关的概率特性函数,并得到了这些函数之间的一系列关系.这些结果是经典马氏链的相应结果的一般化,它们在随机环境中的马氏链的极限理论的研究中是很有用的。     

The Construction of Denumerable q-Processes in Random Environments-The Existence and Uniqueness

The concepts of Markov process in random environment, q-matrix in random environment, and q-process in random environment are introduced. The minimal q-process in random environment is constructed and the necessary and sufficient conditions for the uniqueness of q-process in random environment are given.     

THE DECOMPOSITION OF STATE SPACE FOR MARKOV CHAIN IN RANDOM ENVIRONMENT

This paper is a continuation of [8] and [9]. The author obtains the decomposition of state space X of an Markov chain in random environment by making use of the results in [8] and [9], gives three examples, random walk in random environment, renewal process in random environment and queue process in random environment, and obtains the decompositions of the state spaces of these three special examples.     

The construction of markov processes in random environments and the equivalence theorems

In sec.1, we introduce several basic concepts such as random transition function, p-m process and Markov process in random environment and give some examples to construct a random transition function from a non-homogeneous density function. In sec. 2, we construct the Markov process in random enviromment and skew product Markov process by p -m process and investigate the properties of Markov process in random environment and the original process and environment process and skew product process. In sec. 3, we give several equivalence theorems on Markov process in random environment.     

THE ERGODICITY FOR BI-IMMIGRATION BIRTH AND DEATH PROCESSES IN RANDOM ENVIRONMENT

The concepts of bi-immigration birth and death density matrix in random environment and bi-immigration birth and death process in random environment are introduced. For any bi-immigration birth and death matrix in random environment Q（θ） with birth rate λ 〈 death rate μ, the following results are proved, （1） there is an unique q-process in random environment, P^-（θ＊（0）;t） = （p^-（θ^＊（0）;t,i,j）,i,j ≥ 0）, which is ergodic, that is, lim t→∞（θ^＊（0）;t,i,j） = π^-（θ^＊（0）;j） ≥0 does not depend on i ≥ 0 and ∑j≥0π （θ＊（0）;j） = 1, （2） there is a bi-immigration birth and death process in random enjvironment （X^＊ = {X^＊,t ≥ 0},ε^＊ = {εt,t ∈ （-∞, ∞）}） with random transition matrix P^-（θ^＊ （0）;t） such that X^＊ is a strictly stationary process.     

依状态独立的随机环境中的马氏链

本主要讨论了依状态独立的随机环境中的马氏链，并严格地证明了依状态独立的随机环境中的马氏链，如果在环境不退化的一般情形下，不是时齐马氏链，而环境退化必然是马氏链这个结论。     

随机环境中分枝q-过程

引进了机环境中一致马氏过程,随机分枝q-矩阵和随机环境中分枝q-过程.给了随机环境中分枝q-过程存在性和唯一性的充分条件.最后证明了任意随机分枝转移密度矩阵都是零流入的.     

RENEWAL THEOREM FOR （L, 1）-RANDOM WALK IN RANDOM ENVIRONMENT

We consider a random walk on Z in random environment with possible jumps {-L,…, -1, 1}, in the case that the environment {ωi ： i ∈ Z} are i.i.d.. We establish the renewal theorem for the Markov chain of ＂the environment viewed from the particle＂ in both annealed probability and quenched probability, which generalize partially the results of Kesten （1977） and Lalley （1986） for the nearest random walk in random environment on Z, respectively. Our method is based on （L, 1）-RWRE formulated in Hong and Wang the intrinsic branching structure within the （2013）.     

关于随机环境中的马尔可夫过程的简介——纪念李国平院士吴新谋教授诞辰100周年

该文系统地介绍随机环境中的马尔可夫过程. 共4章, 第一章介绍依时的随机环境中的马尔可夫链(MCTRE), 包括MCTRE的存在性及等价描述; 状态分类; 遍历理论及不变测度; p-θ 链的中心极限定理和不变原理. 第二章介绍依时的随机环境中的马尔可夫过程(MPTRE), 包括MPTRE的基本概念; 随机环境中的q -过程存在唯一性; 时齐的q -过程;MPTRE的构造及等价性定理.第三章介绍依时的随机环境中的分枝链(MBCRE), 包括有限维的和无穷维的MBCRE的模型和基本概念; 它们的灭绝概念;两极分化; 增殖率等.第四章介绍依时依空的随机环境中的马尔可夫链(MCSTRE), 包括MCSTRE的基本概念、构造; 依时依空的随机环境中的随机徘徊(RWSTRE)的中心极限定理、不变原理.     

一类随机环境下马尔科夫链状态的分类

本文构造出具有两状态的一类平稳遍历的环境列下马尔科夫链的具体模型 ,并对该环境下马尔科夫链的相空间进行分解 .     

THE CLASSIFICATION AND PERIOD OF STATES FOR MARKOV CHAIN IN RANDOM ENVIRONMENT

This paper is a continuation of [8]. In Section 1, three kinds of communication are introdnced for two states and the relations among them are investigated. In Section 2, two kinds of period of a state are introdnced and it is obtained that the period is a “class property” ,i.e. two states x and y belong to same class implies the period of x is equal to the period of y.     

Kalman filtering of a space-time Markov random field

In this paper, finite-dimensional recursive filters for space-time Markov random fields are derived. These filters can be used with the expectation maximization (EM) algorithm to yield maximum likelihood estimates of the parameters of the model.     

THE CONSTRUCTION OF DENUMERABLE q-PROCESSES IN RANDOM ENVIRONMENTS SATISFYING (F) OR (B)

This article is a continuation of [9]. Based on the discussion of random Kol-mogorov forward (backward) equations, for any given q-matrix in random environment,Q(θ) = (q(θ; x, y), x, y ∈ X), an infinite class of q-processes in random environments sat-isfying the random Kolmogorov forward (backward) equation is constructed. Moreover,under some conditions, all the q-processes in random environments satisfying the random Kolmogorov forward (backward) equation are constructed.     

随机环境中单生链的不稳定性和灭绝

本文首次引入了随机环境中单生链的概念，随机环境中生灭链为其特例，并讨论了马氏环境中单生链的不稳定性和随机环境中单生链的灭绝问题．     

THE ANALYTICAL PROPERTIES FOR HOMOGENEOUS RANDOM TRANSITION FUNCTIONS

The concepts of Markov process in random environment and homogeneous random transition functions are introduced. The necessary and sufficient conditions for homogeneous random transition function are given. The main results in this article are the analytical properties, such as continuity, differentiability, random Kolmogorov backward equation and random Kolmogorov forward equation of homogeneous random transition functions.     

随机环境中马氏链的强常返性

讨论了随机环境中马氏链的强常返性,给出了在一类条件下,弱常返是强常返的及判定X是强常返的一个充分条件.     

Tree-Indexed Markov Chains in Random Environment and Some of Their Strong Limit Properties

In this paper, the authors first introduce the tree-indexed Markov chains in random environment, which takes values on a general state space. Then, they prove the existence of this stochastic process, and develop a class of its equivalent forms. Based on this property, some strong limit theorems including conditional entropy density are studied for the tree-indexed Markov chains in random environment.