Asymptotic stability, ergodicity and other asymptotic properties of the nonlinear filter

In this work we study connections between various asymptotic properties of the nonlinear filter. It is assumed that the signal has a unique invariant probability measure. The key property of interest is expressed in terms of a relationship between the observation σ field and the tail σ field of the signal, in the stationary filtering problem. This property can be viewed as the permissibility of the interchange of the order of the operations of maximum and countable intersection for certain σ-fields. Under suitable conditions, it is shown that the above property is equivalent to various desirable properties of the filter such as

(a) uniqueness of invariant measure for the signal,

(b) uniqueness of invariant measure for the pair (signal, filter),

(c) a finite memory property of the filter,

(d) a property of finite time dependence between the signal and observation σ fields and

(e) asymptotic stability of the filter.

Previous works on the asymptotic stability of the filter for a variety of filtering models then identify a rich class of filtering problems for which the above equivalent properties hold.     

关于任意随机变量序列泛函的强极限定理

本文在k是固定的正整数，{fn}是R^k 1上的Borel可测函数列时，得到了任意随机变量序列{Xrn≥0}的泛函{fn(Xn-k,…,Xn)}的强极限定理，它是Chung的关于独立随机变量序列的强大数律的推广，作为推论，得到了k重非齐次马尔科夫链的一类强极限定理．     

Capacity Constrained Transit Assignment with Common Lines

This paper proposes the use of absorbing Markov chains to solve the capacity constrained transit network loading problem taking common lines into account. The approach handles congested transit networks, where some passengers will not be able to board because of the absence of sufficient space. The model also handles the common lines problem, where choice of route depends on frequency of arrivals. The mathematical formulation of the problem is presented together with a numerical example. This revised version was published online in July 2006 with corrections to the Cover Date.     

Near-Optimal Controls of Discrete-Time Dynamic Systems Driven by Singularly-Perturbed Markov Chains

This work is devoted to near-optimal controls of large-scale discrete-time nonlinear dynamic systems driven by Markov chains; the underlying problem is to minimize an expected cost function. Our main goal is to reduce the complexity of the underlying systems. To achieve this goal, discrete-time control models under singularly-perturbed Markov chains are introduced. Using a relaxed control representation, our effort is devoted to finding near-optimal controls. Lumping the states in each irreducible class into a single state gives rise to a limit system. Applying near-optimal controls of the limit system to the original system, near-optimal controls of the original system are derived.     

Nonparametric estimation and adaptive control in a class of finite Markov decision chains

We consider a class of Markov decision processes withfinite state and action spaces which, essentially, is determined by the following condition: The state space isirreducible under the action of any stationary policy. However, except by this restriction, the transition law iscompletely unknown to the controller. In this context, we find a set of policies under which thefrequency estimators of the transition law are strongly consistent and then, this result is applied to constructadaptive asymptotically discount-optimal policies.Dedicated to Professor Truman O. Lewis, on the occasion of his sixtieth birthdayThis research was supported in part by the Third World Academy of Sciences (TWAS) under Grant TWAS RG MP 898-152, and in part by the Consejo Nacional de Ciencia y Tecnología (CONACYT) under Grant A128CCOEO550 (MT-2).     

Local polynomial fitting under association

We consider the estimation of multivariate regression functions r(x₁,…,x_d) and their partial derivatives up to a total order p1 using high-order local polynomial fitting. The processes {Y_i,X_i} are assumed to be (jointly) associated. Joint asymptotic normality is established for the estimates of the regression function r and all its partial derivatives up to the total order p. Expressions for the bias and variance/covariance matrix (of the asymptotic distribution) are given.     

A numerically stable algorithm for two server queue models

In this paper, we consider a queueing system in which there are two exponential servers, each having his own queue, and arriving customers will join the shorter queue. Based on the results given in Flatto and McKean, we rewrite the formula for the probability that there are exactlyk customers in each queue, wherek = 0, 1,…. This enables us to present an algorithm for computing these probabilities and then to find the joint distribution of the queue lengths in the system. A program and numerical examples are given.     

Some time change representations of stable integrals, via predictable transformations of local martingales

From the predictable reduction of a marked point process to Poisson, we derive a similar reduction theorem for purely discontinuous martingales to processes with independent increments. Both results are then used to examine the existence of stochastic integrals with respect to stable Lévy processes, and to prove a variety of time change representations for such integrals. The Knight phenomenon, where possibly dependent but orthogonal processes become independent after individual time changes, emerges as a general principle.     

A simple formula for mean multiplexing delay for independent regenerative sources

Simple expressions are given for the mean delay, mean waiting time, and mean busy period length in a multiplexer. Data streams with active periods having a general distribution are permitted, and the data rate during the active periods can be random. Data can also arrive in batches. The key restrictions of the model are that the sources are independent, idle periods are exponentially distributed, and a source generates at least enough data during an active period to keep the server busy throughout the period. The exact formulas allow evaluation of the error in approximations such as a heavy traffic diffusion approximation.Both continuous and discrete time models are considered. The discrete-time model includes that studied by Viterbi and subsequently generalized by Neuts. The Pollaczek-Khinchine formula for the mean amount of work in anM/GI/1 queue is retrieved as a limiting case.Preliminary version presented at IEEE INFOCOM, San Francisco, April 1993.     

关于非齐次m阶马氏信源的渐近均分割性

本文研究非齐次m阶马氏信源的渐近均分割性，首先我们得到关于此种信源m 1元函数的一类强极限定理，作为推论，得到关于任意非齐次m阶马氏信源状态和熵密度的几个极限定理，最后得到一类非齐次m阶马氏信源的渐近均分割性。