Shape-driven nested Markov tessellations

A new and rather broad class of stationary random tessellations of the d-dimensional Euclidean space is introduced, which we call shape-driven nested Markov tessellations. Locally, these tessellations are constructed by means of a spatio-temporal random recursive split dynamics governed by a family of Markovian split kernel, generalizing thereby the – by now classical – construction of iteration stable random tessellations. By providing an explicit global construction of the tessellations, it is shown that under suitable assumptions on the split kernels (shape-driven), there exists a unique time-consistent whole-space tessellation-valued Markov process of stationary random tessellations compatible with the given split kernels. Beside the existence and uniqueness result, the typical cell and some aspects of the first-order geometry of these tessellations are in the focus of our discussion.     

Probabilistic compositional models: Solution of an equivalence problem

Probabilistic compositional models, similarly to graphical Markov models, are able to represent multidimensional probability distributions using factorization and closely related concept of conditional independence. Compositional models represent an algebraic alternative to the graphical models. The system of related conditional independencies is not encoded explicitly (e.g. using a graph) but it is hidden in a model structure itself. This paper provides answers to the question how to recognize whether two different compositional model structures are equivalent – i.e., whether they induce the same system of conditional independencies. Above that, it provides an easy way to convert one structure into an equivalent one in terms of some elementary operations on structures, closely related ability to generate all structures equivalent with a given one, and a unique representative of a class of equivalent structures.     

非齐次可列马尔可夫过程的轨道性质

§1 状态分类 定义1.1 设I是非负整数集,P={P_(ij)(s,t)|i,j∈I,α≤s≤t≤b}是转移函数矩阵。称P对i在t右标准,若limp_(ii)(t,t+h)=1;称P对i在t左标准,若limP_(ii)(t-h,t)=1.若P对i在t同时为右标准的和左标准的,则称P对i在t标准。若P对i在每个t标准,则称P对i标准。P对i右标准或左标准与此类似。若P对每个i标准,则称P标准。P右标准或左标准与此类似(参看[5]、[6])。     

Ergodic and adaptive control of hidden Markov models

A partially observed stochastic system is described by a discrete time pair of Markov processes. The observed state process has a transition probability that is controlled and depends on a hidden Markov process that also can be controlled. The hidden Markov process is completely observed in a closed set, which in particular can be the empty set and only observed through the other process in the complement of this closed set. An ergodic control problem is solved by a vanishing discount approach. In the case when the transition operators for the observed state process and the hidden Markov process depend on a parameter and the closed set, where the hidden Markov process is completely observed, is nonempty and recurrent an adaptive control is constructed based on this family of estimates that is almost optimal.     

Uniqueness of quantum Markov chains associated with an XY-model on a cayley tree of order 2

We propose the construction of a quantum Markov chain that corresponds to a “forward” quantum Markov chain. In the given construction, the quantum Markov chain is defined as the limit of finite-dimensional states depending on the boundary conditions. A similar construction is widely used in the definition of Gibbs states in classical statistical mechanics. Using this construction, we study the quantum Markov chain associated with an XY-model on a Cayley tree. For this model, within the framework of the given construction, we prove the uniqueness of the quantum Markov chain, i.e., we show that the state is independent of the boundary conditions.     

Algorithms for improving efficiency of discrete Markov chains

Sampling from an intractable probability distribution is a common and important problem in scientific computing. A popular approach to solve this problem is to construct a Markov chain which converges to the desired probability distribution, and run this Markov chain to obtain an approximate sample. In this paper, we provide two methods to improve the performance of a given discrete reversible Markov chain. These methods require the knowledge of the stationary distribution only up to a normalizing constant. Each of these methods produces a reversible Markov chain which has the same stationary distribution as the original chain, and dominates the original chain in the ordering introduced by Peskun [11]. We illustrate these methods on two Markov chains, one connected to hidden Markov models and one connected to card shuffling. We also prove a result which shows that the Metropolis-Hastings algorithm preserves the Peskun ordering for Markov transition matrices.     

Accumulation points of the Lagrange and Markov spectra

In this note several conditions are developed which together guarantee that an element of the Markov spectrum is an accumulation point of the Lagrange spectrum. Every known limit point of the Lagrange spectrum which is the Markov value of an attained non-completely periodic sequence satisfies these criteria. Examples are given to show that the removal of any one of the conditions can result in an element of the Markov spectrum which is not a limit point of the Lagrange spectrum. New elements of the Markov spectrum satisfying these conditions have been included.     

Lumping in Markov set-chains

This paper shows how lumping in Markov chains can be extended to Markov set-chains. The criteria required for lumping in Markov set-chains is less restrictive than that of Markov chains.     

Recent Results on Recurrent Solutions and Limit Distributions of SDEs

The limit distribution for homogeneous Markov processes is studied extensively and well understood, but it is not the case for inhomogeneous Markov processes. In this paper, we review some recent results on inhomogeneous Markov processes generated by non-autonomous stochastic (partial) differential equations (SDE in short). Under some suitable conditions, we show that the distribution of recurrent solutions of SDEs constitutes the limit distribution of the corresponding inhomogeneous Markov processes.     

马氏环境中可数马氏链的Poisson极限率

研究了马氏环境中的可数马氏链,主要证明了过程于小柱集上的回返次数是渐近地服从Poisson分布。为此,引入熵函数h,首先给出了马氏环境中马氏链的Shannon-Mc Millan-Breiman定理,还给出了一个非马氏过程Posson逼近的例子。当环境过程退化为一常数序列时,便得到可数马氏链的Poisson极限定理。这是有限马氏链Pitskel相应结果的拓广。     

Large Deviations from a Stationary Measure for a Class of Dissipative PDEs with Random Kicks

We study a class of dissipative PDEs perturbed by a bounded random kick force. It is assumed that the random force is nondegenerate, so that the Markov process obtained by the restriction of solutions to integer times has a unique stationary measure. The main result of the paper is a large deviations principle for occupation measures of the Markov process in question. The proof is based on Kifer's large‐deviation criterion, a coupling argument for Markov processes, and an abstract result on large‐time asymptotic for generalized Markov semigroups.© 2015 Wiley Periodicals, Inc.     

双无限环境中马氏链的中心极限定理

本文研究了双无限环境中马氏链,构造了一马氏双链.利用马氏链的理论,在双链平稳遍历的条件下,获得了双无限环境中马氏链的中心极限定理成立的充分条件.     

Word functions of pseudo-Markov chains

A word function is a function from the set of all words over a finite alphabet into the set of real numbers. In particular, when the blocks of a partition over the state set of a Markov chain are taken as the letters of the finite alphabet, and the function represents the probabilities that the chain will visit sequences of such blocks consecutively, then the function is a function of a Markov chain. It is known that (the rank of a function is defined in the text), a word function is of “finite rank” if and only if it is a function of a pseudo Markov chain (“pseudo” means here that the initial vector and the matrix representing the chain may have positive, negative, or zero values and are not necessarily stochastic). The aim of this note is to show that any function of a pseudo Markov chain can be represented as the difference of two functions of true Markov chains multiplied by a factor which grows exponentially with the length of the arguments (considered as words over a finite alphabet).     

Weak convergence of Markov-modulated random sequences

This work is concerned with weak convergence of non-Markov random processes modulated by a Markov chain. The motivation of our study stems from a wide variety of applications in actuarial science, communication networks, production planning, manufacturing and financial engineering. Owing to various modelling considerations, the modulating Markov chain often has a large state space. Aiming at reduction of computational complexity, a two-time-scale formulation is used. Under this setup, the Markov chain belongs to the class of nearly completely decomposable class, where the state space is split into several subspaces. Within each subspace, the transitions of the Markov chain varies rapidly, and among different subspaces, the Markov chain moves relatively infrequently. Aggregating all the states of the Markov chain in each subspace to a single super state leads to a new process. It is shown that under such aggregation schemes, a suitably scaled random sequence converges to a switching diffusion process.     

客户回报随机过程的Markov性和时间齐次性

在客户发展关系的Markov链模型的基础上,构建了企业的客户回报随机过程．证明了：在适当假设下,客户回报过程是Markov链。甚至是时间齐次的Markov链．本文求出了该链的转移概率．通过转移概率得到了客户给企业期望回报的一些计算公式,从而为企业选定发展客户关系策略提供了有效的量化基础．     

关于渐近循环马氏链泛函的强大数定律

研究了一类非齐次马氏链———渐近循环马氏链泛函的强大数定律,首先引出了渐近循环马氏链的概念,然后给出了若干引理.利用了渐近循环马氏链关于状态序偶出现频率的强大数定理给出并证明了关于渐近循环马氏链泛函的强大数定律,所得定理作为推论可得到已有的结果.     

Fuzzy Markov Chains and Decision-Making

Decision-making in an environment of uncertainty and imprecision for real-world problems is a complex task. In this paper it is introduced general finite state fuzzy Markov chains that have a finite convergence to a stationary (may be periodic) solution. The Cesaro average and the -potential for fuzzy Markov chains are defined, then it is shown that the relationship between them corresponds to the Blackwell formula in the classical theory of Markov decision processes. Furthermore, it is pointed out that recurrency does not necessarily imply ergodicity. However, if a fuzzy Markov chain is ergodic, then the rows of its ergodic projection equal the greatest eigen fuzzy set of the transition matrix. Then, the fuzzy Markov chain is shown to be a robust system with respect to small perturbations of the transition matrix, which is not the case for the classical probabilistic Markov chains. Fuzzy Markov decision processes are finally introduced and discussed.     

随机环境中马氏链的常返性和瞬时性

在π-不可约条件下,得到随机环境中的马氏链瞬时和常返的判定准则,进而得到随机环境中马氏链常返的充要条件;如果环境还是平稳的,则状态空间中不存在非正则本质态.     

用耦合方法研究马氏链f-指数遍历

该文在一般状态空间下研究马氏链指数遍历性,指数遍历马氏链,增加条件π(f~p)<∞, p> 1,利用耦合方法得到了存在满的吸收集,使得马氏链在其上是f-指数遍历的.