首页 | 本学科首页   官方微博 | 高级检索  
     检索      


Girsanov functionals and optimal bang-bang laws for final value stochastic control
Authors:Václav E Beneš
Institution:Bell Laboratories, Murray Hill, N.J. 07974, USA;University of California, Berkeley, Calif., USA
Abstract:Girsanov's theorem is a generalization of the Cameron-Martin formula for the derivative of a measure induced by a translation in Wiener space. It states that for ? a nonanticipative Brownian functional with ∫|?|2 ds < ∞ a.s. and dP?=expζ(?)] dP with E? {1}=1, where ζ(?) = ∫?dw-12∫|?|2ds, the translated functions (Tw)(t) = wt - 0t?ds are a Wiener process under P?. The Girsanov functionals exp ζ(?)] have been used in stochastic control theory to define measures corresponding to solutions of stochastic DEs with only measurable control laws entering the right-hand sides. The present aim is to show that these same concepts have direct practical application to final value problems with bounded control. This is done here by an example, the noisy integrator: Make E{x21}∣small, subject to dxt = ut dt + dwt, |u|? 1, xt observed. For each control law there is a definite cost v(1?t, x) of starting at x, t and using that law till t = 1, expressible as an integral with respect to (a suitable) P?. By restricting attention to a dense set of smooth laws, using Itô's lemma, Kac's theorem, and the maximum principle for parabolic equations, it is possible to calculate sgn vx for a critical class of control laws, then to compare control laws, “solve” the Bellman-Hamilton-Jacobi equation, and thus justify selection of the obvious bang-bang law as optimal.
Keywords:
本文献已被 ScienceDirect 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号