任意随机序列关于非齐次马氏链的随机和的一类随机偏差定理

In this paper, the notion of limit random logarithmic likelihood ratio of stochastic sequence, as a measure of dissimilarity between the joint distribution on measure P and the Markov distribution on measure Q, is introduced. A class of random approximation theorems for arbitrary stochastic dominated sequence are obtained by using the tools of generating functions and the tailed-probability generating functions.     

Discrete Approximations of Controlled Stochastic Systems with Memory: A Survey

This survey article considers discrete approximations of an optimal control problem in which the controlled state equation is described by a general class of stochastic functional differential equations with a bounded memory. Specifically, three different approximation methods, namely (i) semidiscretization scheme; (ii) Markov chain approximation; and (iii) finite difference approximation, are investigated. The convergence results as well as error estimates are established for each of the approximation methods.     

��������ɷ�����������ζ�����Сֵ�ľֲ����޶���

??The local limit theorems for the minimum of a random walk with Markovian increments is given, with using Presman's factorization theory. This result implies the asymptotic behaviour of the survival probability for a critical branching process in Markovian depended random environment.     

关于马氏链强极限定理的一个新结论

本文的目的是要给出一个新形式的对任意可列非齐次马氏链普遍成立的强极限定理     

Exponential Stability in Mean Square for a General Class of Discrete-Time Linear Stochastic Systems

Abstract

The problem of the mean square exponential stability for a class of discrete-time linear stochastic systems subject to independent random perturbations and Markovian switching is investigated. The case of the linear systems whose coefficients depend both to present state and the previous state of the Markov chain is considered. Three different definitions of the concept of exponential stability in mean square are introduced and it is shown that they are not always equivalent. One definition of the concept of mean square exponential stability is done in terms of the exponential stability of the evolution defined by a sequence of linear positive operators on an ordered Hilbert space. The other two definitions are given in terms of different types of exponential behavior of the trajectories of the considered system. In our approach the Markov chain is not prefixed. The only available information about the Markov chain is the sequence of probability transition matrices and the set of its states. In this way one obtains that if the system is affected by Markovian jumping the property of exponential stability is independent of the initial distribution of the Markov chain.

The definition expressed in terms of exponential stability of the evolution generated by a sequence of linear positive operators, allows us to characterize the mean square exponential stability based on the existence of some quadratic Lyapunov functions.

The results developed in this article may be used to derive some procedures for designing stabilizing controllers for the considered class of discrete-time linear stochastic systems in the presence of a delay in the transmission of the data.     

任意随机序列关于二重非齐次马氏链的随机和的一类随机选择系统的随机逼近定理

本文引进任意随机变量序列随机极限对数似然比的概念,通过测度$\pr$下任意相依随机序列联合分布与测度$\qr$下二重非齐次马氏分布相比较,利用母函数与尾概率母函数工具研究任意受控随机序列之随机和在随机选择系统中的一类随机逼近定理.