Stochastic Detectability and Mean Bounded Error Covariance of the Recursive Kalman Filter with Markov Jump Parameters

In this article, we study the error covariance of the recursive Kalman filter when the parameters of the filter are driven by a Markov chain taking values in a countably infinite set. We do not assume ergodicity nor require the existence of limiting probabilities for the Markov chain. The error covariance matrix of the filter depends on the Markov state realizations, and hence forms a stochastic process. We show in a rather direct and comprehensive manner that this error covariance process is mean bounded under the standard stochastic detectability concept. Illustrative examples are included.