首页 | 本学科首页   官方微博 | 高级检索  
     检索      


Average cost Markov control processes: stability with respect to the Kantorovich metric
Authors:Evgueni Gordienko  Enrique Lemus-Rodríguez  Raúl Montes-de-Oca
Institution:(1) Universidad Autónoma Metropolitana, Unidad Iztapalapa, Av. San Rafael Atlixco # 186, Colonia Vicentina, 09340 México D.F., Mexico;(2) Universidad Anáhuac, México Norte, Av. Lomas Anáhuac s/n, Colonia Lomas Anáhuac Huixquilucan, 52786 Edo. de México, Mexico
Abstract:We study perturbations of a discrete-time Markov control process on a general state space. The amount of perturbation is measured by means of the Kantorovich distance. We assume that an average (per unit of time on the infinite horizon) optimal control policy can be found for the perturbed (supposedly known) process, and that it is used to control the original (unperturbed) process. The one-stage cost is not assumed to be bounded. Under Lyapunov-like conditions we find upper bounds for the average cost excess when such an approximation is used in place of the optimal (unknown) control policy. As an application of the found inequalities we consider the approximation by relevant empirical distributions. We illustrate our results by estimating the stability of a simple autoregressive control process. Also examples of unstable processes are provided.
Keywords:Discrete-time Markov control process  Average cost  Contraction  Stability inequality  Kantorovich metric
本文献已被 SpringerLink 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号