Near-Optimal Controls of Discrete-Time Dynamic Systems Driven by Singularly-Perturbed Markov Chains

This work is devoted to near-optimal controls of large-scale discrete-time nonlinear dynamic systems driven by Markov chains; the underlying problem is to minimize an expected cost function. Our main goal is to reduce the complexity of the underlying systems. To achieve this goal, discrete-time control models under singularly-perturbed Markov chains are introduced. Using a relaxed control representation, our effort is devoted to finding near-optimal controls. Lumping the states in each irreducible class into a single state gives rise to a limit system. Applying near-optimal controls of the limit system to the original system, near-optimal controls of the original system are derived.     

Nonparametric estimation and adaptive control in a class of finite Markov decision chains

We consider a class of Markov decision processes withfinite state and action spaces which, essentially, is determined by the following condition: The state space isirreducible under the action of any stationary policy. However, except by this restriction, the transition law iscompletely unknown to the controller. In this context, we find a set of policies under which thefrequency estimators of the transition law are strongly consistent and then, this result is applied to constructadaptive asymptotically discount-optimal policies.Dedicated to Professor Truman O. Lewis, on the occasion of his sixtieth birthdayThis research was supported in part by the Third World Academy of Sciences (TWAS) under Grant TWAS RG MP 898-152, and in part by the Consejo Nacional de Ciencia y Tecnología (CONACYT) under Grant A128CCOEO550 (MT-2).     

带利息力和干扰的批量索赔一般到达风险模型

本文在经典风险模型的基础上,将索赔到达过程推广为更新过程,索赔可以批量到达,且带有常数利息力和Brown运动干扰项,得到一个新的风险模型,运用Markov骨架过程的方法,得出盈余过程的瞬时分布和生存概率.     

Fully-angular polyhex chains with minimal total π-electron energy

By Hückel molecular orbital (HMO) theory, the calculation of the total energy of all π-electrons in conjugated hydrocarbons can be reduced to that of E(G)=|λ₁|+|λ₂|+?+|λn|, where λi are the eigenvalues of the corresponding graph G. Denote by Ψn the set of all fully-angular polyhex chains with n hexagons. In this paper, we show that Hn has the minimum total π-electron energy among chains in Ψn, where Hn is the helicene chain.     

A numerically stable algorithm for two server queue models

In this paper, we consider a queueing system in which there are two exponential servers, each having his own queue, and arriving customers will join the shorter queue. Based on the results given in Flatto and McKean, we rewrite the formula for the probability that there are exactlyk customers in each queue, wherek = 0, 1,…. This enables us to present an algorithm for computing these probabilities and then to find the joint distribution of the queue lengths in the system. A program and numerical examples are given.     

关于非齐次m阶马氏信源的渐近均分割性

本文研究非齐次m阶马氏信源的渐近均分割性，首先我们得到关于此种信源m 1元函数的一类强极限定理，作为推论，得到关于任意非齐次m阶马氏信源状态和熵密度的几个极限定理，最后得到一类非齐次m阶马氏信源的渐近均分割性。     

On distributionally regenerative processes

The paper is concerned with characterization results for distributional regeneration. It is shown that distributional regeneration is equivalent to renewal representation of the associated (shift) Markov operator. A sufficient condition for the distributional regeneration of the transfer operator in terms of variation is also formulated. Finally, a minorization condition is formulated and proved to be sufficient for recurrent co-Feller operators.     

教学质量的时齐马尔可夫链评估法

本文研究了教学质量评估中的一种定量分析方法──时齐马尔可夫链评估法．阐明了这种方法的理论依据及其实施程序、并指出它较之其他教学质量评估法更显合理．