一般随机环境中马氏链的强大数律

本文研究了具有离散参数的一般环境中马氏链的强大数定律.利用随机环境中马氏链停时,获得了加在绕积马氏链样本函数上大数定律成立的充分条件.     

ON MARKOV CHAINS IN SPACE-TIME RANDOM ENVIRONMENTS

In Section 1, the authors establish the models of two kinds of Markov chains in space-time random environments (MCSTRE and MCSTRE(+)) with abstract state space. In Section 2, the authors construct a MCSTRE and a MCSTRE(+) by an initial distribution Φ and a random Markov kernel (RMK) p(γ). In Section 3, the authors es-tablish several equivalence theorems on MCSTRE and MCSTRE(+). Finally, the authors give two very important examples of MCMSTRE, the random walk in spce-time random environment and the Markov br...     

THE ANALYTICAL PROPERTIES FOR HOMOGENEOUS RANDOM TRANSITION FUNCTIONS

The concepts of Markov process in random environment and homogeneous random transition functions are introduced. The necessary and sufficient conditions for homogeneous random transition function are given. The main results in this article are the analytical properties, such as continuity, differentiability, random Kolmogorov backward equation and random Kolmogorov forward equation of homogeneous random transition functions.     

从p—m链到随机环境中的马氏链

第一节引进了p一m链的概念,并用之构造了与它相应的随机环境中的马氏链和绕积马氏链、第二节引进了一系列与随机环境中的马氏链相关的概率特性函数,并得到了这些函数之间的一系列关系.这些结果是经典马氏链的相应结果的一般化,它们在随机环境中的马氏链的极限理论的研究中是很有用的。     

Markov decision processes and strongly excessive functions

Strongly excessive functions play an important role in the theory of Markov decision processes and Markov games. In this paper the following question is investigated: What are the properties of Markov decision processes which possess a strongly excessive function? A probabilistic characterization is presented in the form of a random drift through a partitioned state space. For strongly excessive functions which have a positive lower bound a characterization is given in terms of the lifetime distribution of the process.Finally we give a characterization in terms of the spectral radius.     

绕积马氏链的中心极限定理

讨论了具有离散参数的绕积马氏链的中心极限定理,给出了加在过程样本函数上充分条件。得到了绕积马氏链的中心极限定理成立的充分条件.     

The Invariance Principle for p-θ^→ Chain

There are two parts in this paper. In the first part we construct the Markov chain in random environment（MCRE）, the skew product Markov chain and p-θ^→ chain from a random transition matrix and a two-dimensional probability distribution, and in the second part we prove that the invarianee principle for p-θ^→ chain, a more complex non-homogeneous Markov chain, is true under some reasonable conditions. This result is more powerful.     

水库储水建模的马尔可夫骨架过程方法

在本中，我们应用马尔可夫骨架过程的理论，建立了水库储水模型，并且用向后方程刻画了水库储水过程的一维分布,这一模型是随机环境流体模型的推广，在金融管理以及网络技术等领域中都有重要应用．     

THE ERGODICITY FOR BI-IMMIGRATION BIRTH AND DEATH PROCESSES IN RANDOM ENVIRONMENT

The concepts of bi-immigration birth and death density matrix in random environment and bi-immigration birth and death process in random environment are introduced. For any bi-immigration birth and death matrix in random environment Q（θ） with birth rate λ 〈 death rate μ, the following results are proved, （1） there is an unique q-process in random environment, P^-（θ＊（0）;t） = （p^-（θ^＊（0）;t,i,j）,i,j ≥ 0）, which is ergodic, that is, lim t→∞（θ^＊（0）;t,i,j） = π^-（θ^＊（0）;j） ≥0 does not depend on i ≥ 0 and ∑j≥0π （θ＊（0）;j） = 1, （2） there is a bi-immigration birth and death process in random enjvironment （X^＊ = {X^＊,t ≥ 0},ε^＊ = {εt,t ∈ （-∞, ∞）}） with random transition matrix P^-（θ^＊ （0）;t） such that X^＊ is a strictly stationary process.     

Nonparametric Estimation for Semi-Markov Processes Based on its Hazard Rate Functions

The problem of estimating the Markov renewal matrix and the semi-Markov transition matrix based on a history of a finite semi-Markov process censored at time T (fixed) is addressed for the first time. Their asymptotic properties are studied. We begin by the definition of the transition rate of this process and propose a maximum likelihood estimator for the hazard rate functions and then we show that this estimator is uniformly strongly consistent and converges weakly to a normal random variable. We construct a new estimator for an absolute continous semi-Markov kernel and give detailed derivation of uniform strong consistency and weak convergence of this estimator as the censored time tends to infinity. This revised version was published online in June 2006 with corrections to the Cover Date.     

The minimal solution of a Markov renewal equation

Given a killed Markov process, one can use a procedure of Ikedaet al. to revive the process at the killing times. The revived process is again a Markov process and its transition function is the minimal solution of a Markov renewal equation. In this paper we will calculate such solutions for a class of revived processes.     

Standard tri-point transition function

It is usually difficult to express a family of tri-point transition function (TTF) by a transition matrix as Markov processes with one parameter. In this paper, we define three kinds of connection matrixes on the states of standard tri-point transition function (STTF) and study their essential character, give a constructive method on the constant-value standard tri-point transition function and a general expression of the state-symmetric standard tri-point transition function by a sequence of the transition matrixes of special and simple Markov processes with one parameter.     

绕积马氏链的状态

主要研究了绕积马氏链的各种状态,得到了相应的一些充要条件．同时利用Foguel的L1-理论对单链X常返性与瞬时性进行了讨论,回答了单链X是π-不可约链的本质,即绕积马氏链的相空间是最小闭集．     

随机环境中分枝q-过程

引进了机环境中一致马氏过程,随机分枝q-矩阵和随机环境中分枝q-过程.给了随机环境中分枝q-过程存在性和唯一性的充分条件.最后证明了任意随机分枝转移密度矩阵都是零流入的.     

Markov jump random c.d.f.’s and their posterior distributions

In this article we introduce the class of Markov jump random c.d.f.’s as a sub-class of the Q$Q$-Markov prior distributions studied in R.M. Balan [Q$Q$-Markov random probability measures and their posterior distributions, Stochastic Process. Appl. 109 (2004) 296–316]. Our main result states that if the prior distribution of a sample is a Markov jump process, then the posterior distribution can also be viewed as the distribution of a Markov jump process, whose transition mechanism and infinitesimal behavior have been updated in the light of the new data.     

一类随机环境下马尔科夫链状态的分类

本文构造出具有两状态的一类平稳遍历的环境列下马尔科夫链的具体模型 ,并对该环境下马尔科夫链的相空间进行分解 .     

Skew-product extensions of Markov operators and products of dependent random variables

In this paper we generalize the notion of skew products as known in ergodic theory to skew product extensions of Markov operators. We prove that Markov operators are of such a type iff they have relative discrete spectrum (in a slightly generalized sense) thus generalizing a theorem of Parry. In addition we show that skew product extensions of Markov operators play an important role in the theory of products of dependent random variables and we develop this interdependence between the two theories thus generalizing results of Koutsky, Schmetterer and Wolff.     

The Construction of Multivariate Distributions from Markov Random Fields

We address the problem of constructing and identifying a valid joint probability density function from a set of specified conditional densities. The approach taken is based on the development of relations between the joint and the conditional densities using Markov random fields (MRFs). We give a necessary and sufficient condition on the support sets of the random variables to allow these relations to be developed. This condition, which we call the Markov random field support condition, supercedes a common assumption known generally as the positivity condition. We show how these relations may be used in reverse order to construct a valid model from specification of conditional densities alone. The constructive process and the role of conditions needed for its application are illustrated with several examples, including MRFs with multiway dependence and a spatial beta process.     

BMAP的轨道分析和Q过程的伴随MAP

本文用轨道分析方法研究批量Markov到达过程(BMAP),有别于研究BMAP常用的矩阵解析方法.通过BMAP的表现(D_k,k=0,1,2,…),得到BMAP的跳跃概率,证明了BMAP的相过程是时间齐次Markov链,求出了相过程的转移概率和密度矩阵.此外,给定一个带有限状态空间的Q过程J,其跳跃点的计数过程记为N,证明了Q过程J的伴随过程X*=(N,J)是一个MAP,求出了该MAP的转移概率和表现(D_0,D_1),它们是通过密度矩阵Q来表述的.     

Second order limit theorems for the Markov branching process in random environments

In a Markov branching process with random environments, limiting fluctuations of the population size arise from the changing environment, which causes random variation of the ‘deterministic’ population prediction, and from the stochastic wobble around this ‘deterministic’ mean, which is apparent in the ordinary Markov branching process. If the random environment is generated by a suitable stationary process, the first variation typically swamps the second kind. In this paper, environmental processes are considered which, in contrast, lead to sampling and environmental fluctuation of comparable magnitude. The method makes little use either of stationarity or of the branching property, and is amenable to some generalization away from the Markov branching process.