Girsanov functionals and optimal bang-bang laws for final value stochastic control |
| |
Authors: | Václav E Beneš |
| |
Institution: | Bell Laboratories, Murray Hill, N.J. 07974, USA;University of California, Berkeley, Calif., USA |
| |
Abstract: | Girsanov's theorem is a generalization of the Cameron-Martin formula for the derivative of a measure induced by a translation in Wiener space. It states that for ? a nonanticipative Brownian functional with ∫|?|2 ds < ∞ a.s. and with , where , the translated functions are a Wiener process under P?. The Girsanov functionals exp ζ(?)] have been used in stochastic control theory to define measures corresponding to solutions of stochastic DEs with only measurable control laws entering the right-hand sides. The present aim is to show that these same concepts have direct practical application to final value problems with bounded control. This is done here by an example, the noisy integrator: Make E{x21}∣small, subject to dxt = ut dt + dwt, |u|? 1, xt observed. For each control law there is a definite cost v(1?t, x) of starting at x, t and using that law till t = 1, expressible as an integral with respect to (a suitable) P?. By restricting attention to a dense set of smooth laws, using Itô's lemma, Kac's theorem, and the maximum principle for parabolic equations, it is possible to calculate sgn vx for a critical class of control laws, then to compare control laws, “solve” the Bellman-Hamilton-Jacobi equation, and thus justify selection of the obvious bang-bang law as optimal. |
| |
Keywords: | |
本文献已被 ScienceDirect 等数据库收录! |
|