Parameter estimation of partially observed continuous time stochastic processes via the EM algorithm

An algorithm is presented for the problem of maximum likelihood (ML) estimation of parameters of partially observed continuous time random processes. This algorithm is an extension of the EM algorithm 3] used in the time series literature, and preserves its main features. It is then applied to the problem of parameter estimation of continuous time, finite state or infinite state (diffusions) Markov processes observed via a noisy sensor. The algorithm in general involves iterations of non-linear smoothing with known parameters and then a non-stochastic maximization. For special cases, including linear models and AR/ARMA processes observed in white noise, each iteration is easily performed with finite dimensional filters. Finally, the algorithm is applied to parameter estimation of “randomly slowly varying” linear systems observed in white noise, and explicit results are derived.