On some applications of Wald's identity to dams |
| |
Authors: | Revindra M. Phatarfod |
| |
Affiliation: | Department of Mathematics, Monash University, Clayton, Victoria 3168, Australia |
| |
Abstract: | It is known that the main difficulty in applying the Markovian analogue of Wald's Identity is the presence, in the Identity, of the last state variable before the random walk is terminated. In this paper we show that this difficulty can be overcome if the underlying Markov chain has a finite state space. The absorption probabilities thus obtained are used, by employing a duality argument, to derive time-dependent and limiting probabilities for the depletion process of a dam with Markovian inputs.The second problem that is considered here is that of a non-homogeneous but cyclic Markov chain. An analogue of Wald's Identity is obtained for this case, and is used to derive time- dependent and limiting probabilities for the depletion process with inputs forming a non- homogeneous (cyclic) Markov chain. |
| |
Keywords: | Wald's Identity non-homogeneous Markov chain bottomless dams Markov chains duality |
本文献已被 ScienceDirect 等数据库收录! |
|