Finite horizon semi-Markov decision processes with application to maintenance systems |
| |
Authors: | Yonghui Huang Xianping Guo |
| |
Institution: | School of Mathematics and Computational Science, Sun Yat-Sen University, Guangzhou 510275, China Guangdong Province Key Laboratory of Computational Science, Guangzhou 510275, China |
| |
Abstract: | This paper investigates finite horizon semi-Markov decision processes with denumerable states. The optimality is over the class of all randomized history-dependent policies which include states and also planning horizons, and the cost rate function is assumed to be bounded below. Under suitable conditions, we show that the value function is a minimum nonnegative solution to the optimality equation and there exists an optimal policy. Moreover, we develop an effective algorithm for computing optimal policies, derive some properties of optimal policies, and in addition, illustrate our main results with a maintenance system. |
| |
Keywords: | Dynamic programming Finite horizon semi-Markov decision processes Value function Optimality equation Optimal policy |
本文献已被 ScienceDirect 等数据库收录! |
|