Meshfree Approximation for Stochastic Optimal Control Problems

In this work,we study the gradient projection method for solving a class of stochastic control problems by using a mesh free approximation ap-proach to implement spatial dimension approximation.Our main contribu-tion is to extend the existing gradient projection method to moderate high-dimensional space.The moving least square method and the general radial basis function interpolation method are introduced as showcase methods to demonstrate our computational framework,and rigorous numerical analysis is provided to prove the convergence of our meshfree approximation approach.We also present several numerical experiments to validate the theoretical re-sults of our approach and demonstrate the performance meshfree approxima-tion in solving stochastic optimal control problems.     

Forward-backward Stochastic Differential Equations and Backward Linear Quadratic Stochastic Optimal Control Problem

In this paper, we use the solutions of forward-backward stochastic differential equations to get the optimal control for backward stochastic linear quadratic optimal control problem. And we also give the linear feedback regulator for the optimal control problem by using the solutions of a group of Riccati equations.     

条件平均场随机微分方程的最优控制问题

作者研究了一个条件平均场随机微分方程的最优控制问题.这种方程和某些部分信息下的随机最优控制问题有关,并且可以看做是平均场随机微分方程的推广.作者以庞特里雅金最大值原理的形式给出最优控制满足的必要和充分条件.此外,文中给出一个线性二次最优控制问题来说明理论结果的应用.     

随机递归最优控制和混合最优控制问题

对随机递归最优控制问题即代价函数由特定倒向随机微分方程解来描述和递归混合最优控制问题即控制者还需 决定最优停止时刻, 得到了最优控制的存在性结果. 在一类等价概率测度集中,还给出了递归最优值函数的最小和最大数学期望.     

Stochastic Linear Quadratic Optimal Control Problems

This paper is concerned with the stochastic linear quadratic optimal control problem (LQ problem, for short) for which the coefficients are allowed to be random and the cost functional is allowed to have a negative weight on the square of the control variable. Some intrinsic relations among the LQ problem, the stochastic maximum principle, and the (linear) forward—backward stochastic differential equations are established. Some results involving Riccati equation are discussed as well. Accepted 15 May 2000. Online publication 1 December 2000     

Maximum Principle for a Stochastic Optimal Control Problem and Application to Portfolio/Consumption Choice

We consider mainly an optimal control problem motivated by a portfolio and consumption choice problem in a financial market where the utility of the investor is assumed to have a given homogeneous form. A Pontryagin local maximum principle is obtained by using classical variational methods. We apply the result to make optimal portfolio and consumption decisions for the problem under consideration. The optimal selection coincides with the one obtained in Refs. 1 and 2, where the Bellman dynamic programming principle was used.     

Weak Solutions of Semilinear PDEs in Sobolev Spaces and Their Probabilistic Interpretation via the FBSDEs

Abstract

The article is devoted to representation of weak solutions (in Sobolev sense) of degenerate parabolic partial differential equations through forward-backward stochastic differential equations. Before, we prove a weak version of a norm equivalence result.     

A Stochastic Linear Quadratic Optimal Control Problem with Generalized Expectation

Abstract

In this article, we initiate a study on optimal control problem for linear stochastic differential equations with quadratic cost functionals under generalized expectation via backward stochastic differential equations.     

正倒向随机微分方程组的数值解法

1990年,Pardoux和Peng(彭实戈)解决了非线性倒向随机微分方程(backward stochastic differential equation,BSDE)解的存在唯一性问题,从而建立了正倒向随机微分方程组(forward backward stochastic differential equations,FBSDEs)的理论基础;之后,正倒向随机微分方程组得到了广泛研究,并被应用于众多研究领域中,如随机最优控制、偏微分方程、金融数学、风险度量、非线性期望等.近年来,正倒向随机微分方程组的数值求解研究获得了越来越多的关注,本文旨在基于正倒向随机微分方程组的特性,介绍正倒向随机微分方程组的主要数值求解方法.我们将重点介绍讨论求解FBSDEs的积分离散法和微分近似法,包括一步法和多步法,以及相应的数值分析和理论分析结果.微分近似法能构造出求解全耦合FBSDEs的高效高精度并行数值方法,并且该方法采用最简单的Euler方法求解正向随机微分方程,极大地简化了问题求解的复杂度.文章最后,我们尝试提出关于FBSDEs数值求解研究面临的一些亟待解决和具有挑战性的问题.     

Stochastic Optimal Control for the Stochastic Heat Equation with Exponentially Growing Coefficients and with Control and Noise on a Subdomain

Abstract

We consider stochastic optimal control problems in Banach spaces, related to nonlinear controlled equations with dissipative non linearities: on the nonlinear term we do not impose any growth condition. The problems are treated via the backward stochastic differential equations approach, that allows also to solve in mild sense Hamilton Jacobi Bellman equations in Banach spaces. We apply the results to controlled stochastic heat equation, in space dimension 1, with control and noise acting on a subdomain.     

A Deterministic Approach To Stochastic Optimal Control With Application To Anticipative Control

Using the decomposition of solution of SDE, we consider the stochastic optimal control problem with anticipative controls as a family of deterministic control problems parametrized by the paths of the driving Wiener process and of a newly introduced Lagrange multiplier stochastic process (nonanticipativity equality constraint). It is shown that the value function of these problems is the unique global solution of a robust equation (random partial differential equation) associated to a linear backward Hamilton-Jacobi-Bellman stochastic partial differential equation (HJB SPDE). This appears as limiting SPDE for a sequence of random HJB PDE's when linear interpolation approximation of the Wiener process is used. Our approach extends the Wong-Zakai type results [20] from SDE to the stochastic dynamic programming equation by showing how this arises as average of the limit of a sequence of deterministic dynamic programming equations. The stochastic characteristics method of Kunita [13] is used to represent the value function. By choosing the Lagrange multiplier equal to its nonanticipative constraint value the usual stochastic (nonanticipative) optimal control and optimal cost are recovered. This suggests a method for solving the anticipative control problems by almost sure deterministic optimal control. We obtain a PDE for the “cost of perfect information” the difference between the cost function of the nonanticipative control problem and the cost of the anticipative problem which satisfies a nonlinear backward HJB SPDE. Poisson bracket conditions are found ensuring this has a global solution. The cost of perfect information is shown to be zero when a Lagrangian submanifold is invariant for the stochastic characteristics. The LQG problem and a nonlinear anticipative control problem are considered as examples in this framework     

A Type of General Forward-Backward Stochastic Differential Equations and Applications

The authors discuss one type of general forward-backward stochastic differential equations (FBSDEs) with It?o’s stochastic delayed equations as the forward equations and anticipated backward stochastic differential equations as the backward equations. The existence and uniqueness results of the general FBSDEs are obtained. In the framework of the general FBSDEs in this paper, the explicit form of the optimal control for linearquadratic stochastic optimal control problem with delay and the Nash equilibrium point for nonzero sum differential games problem with delay are obtained.     

Necessary Maximum Principle of Stochastic Optimal Control with Delay and Jump Diffusion

In this paper, we have studied the necessary maximum principle of stochastic optimal control problem with delay and jump diffusion.     

倒向随机方程期权定价模型的一类随机算法

期权定价问题可以转化为对倒向随机微分方程的求解,进而转化为对相应抛物型偏微分方程的求解.为了求解与倒向随机微分方程相应的二阶拟线性抛物型微分方程初值问题,引入一类新的随机算法-分层方法取代传统的确定性数值算法.这种数值方法理论上是通过弱显式欧拉法,离散其相应随机系统解的概率表示而得到.该随机算法的收敛性在文中得到证明,其稳定性是自然的.并构造了易于数值实现的基于插值的算法,实证研究说明这种算法能很好地提供期权定价模型的数值模拟.     

Numerical Schemes for Discontinuous Value Functions of Optimal Control

In this paper we explain that various (possibly discontinuous) value functions for optimal control problem under state-constraints can be approached by a sequence of value functions for suitable discretized systems. The key-point of this approach is the characterization of epigraphs of the value functions as suitable viability kernels. We provide new results for estimation of the convergence rate of numerical schemes and discuss conditions for the convergence of discrete optimal controls to the optimal control for the initial problem.     

Modified Equations for Stochastic Differential Equations

We describe a backward error analysis for stochastic differential equations with respect to weak convergence. Modified equations are provided for forward and backward Euler approximations to Itô SDEs with additive noise, and extensions to other types of equation and approximation are discussed.     

Sufficient Stochastic Maximum Principle for the Optimal Control of Jump Diffusions and Applications to Finance

We correct Example 4.2 of Ref. 1.     

Sufficient Stochastic Maximum Principle for the Optimal Control of Jump Diffusions and Applications to Finance

We give a verification theorem by employing Arrow's generalization of the Mangasarian sufficient condition to a general jump diffusion setting and show the connections of adjoint processes to dynamic programming. The result is applied to financial optimization problems.     

Maximum principle for optimal control problems involving impulse controls with nonsmooth data

This paper is concerned with the stochastic maximum principle for impulse optimal control problems of forward–backward systems, where the coefficients of the forward part are Lipschitz continuous. The domain of the regular controls is not necessarily convex. We establish a Pontryagins maximum principle for this control problem by applying Ekelands variational principle to a sequence of approximated control problems with smooth coefficients of the initial problems.     

Optimal control of self-adjoint nonlinear operator equations in Hilbert spaces

In this paper, we formulate and study a general optimal control problem governed by nonlinear operator equations described by unbounded self-adjoint operators in Hilbert spaces. This problem extends various particular control models studied in the literature, while it has not been considered before in such a generality. We develop an efficient way to construct a finite-dimensional subspace extension of the given self-adjoint operator that allows us to design the corresponding adjoint system and finally derive an appropriate counterpart of the Pontryagin Maximum Principle for the constrained optimal control problem under consideration by using the obtained increment formula for the cost functional and needle type variations of optimal controls.