On the optimal control of arrivals to a single queue with arbitrary feedback delay |
| |
Authors: | Kuri Joy Kumar Anurag |
| |
Institution: | (1) Departement de Génie Electrique et de Génie Informatique, école Polytechnique, Case Postale 6079, Succ A, Montréal, Canada, H3C 3A7;(2) Department of Electrical Communication Engineering, Indian Institute of Science, Bangalore, 560012, India |
| |
Abstract: | We consider a problem of admission control to a single queue in discrete time. The controller has access to k step old queue lengths only, where k can be arbitrary. The problem is motivated, in particular, by recent advances in high-speed networking where information
delays have become prominent. We formulate the problem in the framework of Completely Observable Controlled Markov Chains,
in terms of a multi-dimensional state variable. Exploiting the structure of the problem, we show that under appropriate conditions,
the multi-dimensional Dynamic Programming Equation (DPE) can be reduced to a unidimensional one. We then provide simple computable
upper and lower bounds to the optimal value function corresponding to the reduced unidimensional DPE. These upper and lower
bounds, along with a certain relationship among the parameters of the problem, enable us to deduce partially the structural
features of the optimal policy. Our approach enables us to recover simply, in part, the recent results of Altman and Stidham,
who have shown that a multiple-threshold-type policy is optimal for this problem. Further, under the same relationship among
the parameters of the problem, we provide easily computable upper bounds to the multiple thresholds and show the existence
of simple relationships among these upper bounds. These relationships allow us to gain very useful insights into the nature
of the optimal policy. In particular, the insights obtained are of great importance for the problem of actually computing
an optimal policy because they reduce the search space enormously.
This revised version was published online in June 2006 with corrections to the Cover Date. |
| |
Keywords: | Markov decision theory delayed feedback information threshold policies |
本文献已被 SpringerLink 等数据库收录! |
|