Bayesian ergodic adaptive control of diffusion processes

A Bayesian adaptive control problem for ergodic diffusions is considered. A nearly self-optimising strategy is constructed on the basis of discrete-time observations of the state process. In this derivation a key role is played by an embedded Markov chain with an associated Bellman-type equation which appears to be of independent interest