Measure change techniques in optimal control

Fully and partially observed stochastic control of systems with nonlinear dynamics and terminal and running costs are considered. Measure changes are introduced which allow both state and observation dynamics to be thought of as linear. In the case when the terms of the cost have a special form the measure change transformation “cancels out” the nonlinearities and changes the original nonlinear problem into a classical LQG one and standard results can be applied. We also consider unnormalized conditional densities of the whole path as state variables and obtain dynamic programming and verification results. R. J. Elliott wishes to acknowledge support of the Natural Sciences and Engineering Research Council of Canada, Grant A7964.