Quadratic Control for Stochastic Systems Defined by Evolution Operators and Square Integrable Martingales

The infinite dimensional version of the linear quadratic cost control problem is studied by Curtain and Pritchard [2], Gibson [5] by using Riccati integral equations, instead of differential equations. In the present paper the corresponding stochastic case over a finite horizon is considered. The stochastic perturbations are given by Hilbert valued square integrable martingales and it is shown that the deterministic optimal feedback control is also optimal in the stochastic case. Sufficient conditions are given for the convergence of approximate solutions of optimal control problems.     

Forward and Backward Mean-Field Stochastic Partial Differential Equation and Optimal Control

This paper is mainly concerned with the solutions to both forward and backward mean-field stochastic partial differential equation and the corresponding optimal control problem for mean-field stochastic partial differential equation. The authors first prove the continuous dependence theorems of forward and backward mean-field stochastic partial differential equations and show the existence and uniqueness of solutions to them. Then they establish necessary and sufficient optimality conditions of the control problem in the form of Pontryagin''s maximum principles. To illustrate the theoretical results, the authors apply stochastic maximum principles to study the infinite-dimensional linear-quadratic control problem of mean-field type. Further, an application to a Cauchy problem for a controlled stochastic linear PDE of mean-field type is studied.     

A Stochastic Linear Quadratic Optimal Control Problem with Generalized Expectation

Abstract

In this article, we initiate a study on optimal control problem for linear stochastic differential equations with quadratic cost functionals under generalized expectation via backward stochastic differential equations.     

Stochastic control problems with delay

We consider optimal control problems for systems described by stochastic differential equations with delay. We state conditions for certain classes of such systems under which the stochastic control problems become finite-dimensional. These conditions are illustrated with three applications. First, we solve some linear quadratic problems with delay. Then we find the optimal consumption rate in a financial market with delay. Finally, we solve explicitly a deterministic fluid problem with delay which arises from admission control in ATM communication networks.     

Regularity of Backward Stochastic Volterra Integral Equations in Hilbert Spaces

This article investigates backward stochastic Volterra integral equations in Hilbert spaces. The existence and uniqueness of their adapted solutions is reviewed. We establish the regularity of the adapted solutions to such equations by means of Malliavin calculus. For an application, we study an optimal control problem for a stochastic Volterra integral equation driven by a Hilbert space-valued fractional Brownian motion. A Pontryagin-type maximum principle is formulated for the problem and an example is presented.     

Stochastic maximum principle for mean-field forward-backward stochastic control system with terminal state constraints

In this paper,we consider an optimal control problem with state constraints,where the control system is described by a mean-field forward-backward stochastic differential equation(MFFBSDE,for short)and the admissible control is mean-field type.Making full use of the backward stochastic differential equation theory,we transform the original control system into an equivalent backward form,i.e.,the equations in the control system are all backward.In addition,Ekeland’s variational principle helps us deal with the state constraints so that we get a stochastic maximum principle which characterizes the necessary condition of the optimal control.We also study a stochastic linear quadratic control problem with state constraints.     

A Stochastic Maximum Principle for a Stochastic Differential Game of a Mean-Field Type

We construct a stochastic maximum principle (SMP) which provides necessary conditions for the existence of Nash equilibria in a certain form of N-agent stochastic differential game (SDG) of a mean-field type. The information structure considered for the SDG is of a possible asymmetric and partial type. To prove our SMP we take an approach based on spike-variations and adjoint representation techniques, analogous to that of S.?Peng (SIAM J. Control Optim. 28(4):966?C979, 1990) in the optimal stochastic control context. In our proof we apply adjoint representation procedures at three points. The first-order adjoint processes are defined as solutions to certain mean-field backward stochastic differential equations, and second-order adjoint processes of a first type are defined as solutions to certain backward stochastic differential equations. Second-order adjoint processes of a second type are defined as solutions of certain backward stochastic equations of a type that we introduce in this paper, and which we term conditional mean-field backward stochastic differential equations. From the resulting representations, we show that the terms relating to these second-order adjoint processes of the second type are of an order such that they do not appear in our final SMP equations. A?comparable situation exists in an article by R.?Buckdahn, B.?Djehiche, and J.?Li (Appl. Math. Optim. 64(2):197?C216, 2011) that constructs a SMP for a mean-field type optimal stochastic control problem; however, the approach we take of using these second-order adjoint processes of a second type to deal with the type of terms that we refer to as the second form of quadratic-type terms represents an alternative to a development, to our setting, of the approach used in their article for their analogous type of term.     

Stochastic Linear Quadratic Optimal Control Problems

This paper is concerned with the stochastic linear quadratic optimal control problem (LQ problem, for short) for which the coefficients are allowed to be random and the cost functional is allowed to have a negative weight on the square of the control variable. Some intrinsic relations among the LQ problem, the stochastic maximum principle, and the (linear) forward—backward stochastic differential equations are established. Some results involving Riccati equation are discussed as well. Accepted 15 May 2000. Online publication 1 December 2000     

An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations

In this paper, we will study an indefinite stochastic linear quadratic optimal control problem, where the controlled system is described by a stochastic differential equation with delay. By introducing the relaxed compensator as a novel method, we obtain the well-posedness of this linear quadratic problem for indefinite case. And then, we discuss the uniqueness and existence of the solutions for a kind of anticipated forward–backward stochastic differential delayed equations. Based on this, we derive the solvability of the corresponding stochastic Hamiltonian systems, and give the explicit representation of the optimal control for the linear quadratic problem with delay in an open-loop form. The theoretical results are validated as well on the control problems of engineering and economics under indefinite condition.     

Optimization of Nonlinear Systems of Stochastic Difference Equations

We present new results concerning the synthesis of optimal control for systems of difference equations that depend on a semi-Markov or Markov stochastic process. We obtain necessary conditions for the optimality of solutions that generalize known conditions for the optimality of deterministic systems of control. These necessary optimality conditions are obtained in the form convenient for the synthesis of optimal control. On the basis of Lyapunov stochastic functions, we obtain matrix difference equations of the Riccati type, the integration of which enables one to synthesize an optimal control. The results obtained generalize results obtained earlier for deterministic systems of difference equations.     

Stochastic Control for Mean-Field Stochastic Partial Differential Equations with Jumps

We study optimal control for mean-field stochastic partial differential equations (stochastic evolution equations) driven by a Brownian motion and an independent Poisson random measure, in case of partial information control. One important novelty of our problem is represented by the introduction of general mean-field operators, acting on both the controlled state process and the control process. We first formulate a sufficient and a necessary maximum principle for this type of control. We then prove the existence and uniqueness of the solution of such general forward and backward mean-field stochastic partial differential equations. We apply our results to find the explicit optimal control for an optimal harvesting problem.     

Maximum Principle for Partially-Observed Optimal Control of Fully-Coupled Forward-Backward Stochastic Systems

This paper is concerned with partially-observed optimal control problems for fully-coupled forward-backward stochastic systems. The maximum principle is obtained on the assumption that the forward diffusion coefficient does not contain the control variable and the control domain is not necessarily convex. By a classical spike variational method and a filtering technique, the related adjoint processes are characterized as solutions to forward-backward stochastic differential equations in finite-dimensional spaces. Then, our theoretical result is applied to study a partially-observed linear-quadratic optimal control problem for a fully-coupled forward-backward stochastic system and an explicit observable control variable is given.     

A Deterministic Approach To Stochastic Optimal Control With Application To Anticipative Control

Using the decomposition of solution of SDE, we consider the stochastic optimal control problem with anticipative controls as a family of deterministic control problems parametrized by the paths of the driving Wiener process and of a newly introduced Lagrange multiplier stochastic process (nonanticipativity equality constraint). It is shown that the value function of these problems is the unique global solution of a robust equation (random partial differential equation) associated to a linear backward Hamilton-Jacobi-Bellman stochastic partial differential equation (HJB SPDE). This appears as limiting SPDE for a sequence of random HJB PDE's when linear interpolation approximation of the Wiener process is used. Our approach extends the Wong-Zakai type results [20] from SDE to the stochastic dynamic programming equation by showing how this arises as average of the limit of a sequence of deterministic dynamic programming equations. The stochastic characteristics method of Kunita [13] is used to represent the value function. By choosing the Lagrange multiplier equal to its nonanticipative constraint value the usual stochastic (nonanticipative) optimal control and optimal cost are recovered. This suggests a method for solving the anticipative control problems by almost sure deterministic optimal control. We obtain a PDE for the “cost of perfect information” the difference between the cost function of the nonanticipative control problem and the cost of the anticipative problem which satisfies a nonlinear backward HJB SPDE. Poisson bracket conditions are found ensuring this has a global solution. The cost of perfect information is shown to be zero when a Lagrangian submanifold is invariant for the stochastic characteristics. The LQG problem and a nonlinear anticipative control problem are considered as examples in this framework     

伊藤-泊松型随机微分方程的线性二次控制

本文研究伊藤-泊松型随机微分方程的线性二次控制问题,利用动态规划方法、伊藤公式等技巧,通过解HJB方程,我们得到了随机Riccati方程及另外两个微分方程,求出控制变量,解决了线性二次最优控制最优问题.     

A Type of General Forward-Backward Stochastic Differential Equations and Applications

The authors discuss one type of general forward-backward stochastic differential equations (FBSDEs) with It?o’s stochastic delayed equations as the forward equations and anticipated backward stochastic differential equations as the backward equations. The existence and uniqueness results of the general FBSDEs are obtained. In the framework of the general FBSDEs in this paper, the explicit form of the optimal control for linearquadratic stochastic optimal control problem with delay and the Nash equilibrium point for nonzero sum differential games problem with delay are obtained.     

Reflected Backward Stochastic Differential Equations,Convex Risk Measures and American Options

We use convex risk measures to assess unhedged risks for American-style contingent claims in a continuous-time non-Markovian economy using reflected backward stochastic differential equations (RBSDEs). A two-stage approach is adopted to evaluate the risk. We formulate the evaluation problem as an optimal stopping-control problem and discuss the problem using reflected BSDEs. The convex risk measures are represented as solutions of RBSDEs. In the Markov case, we relate the RBSDE solutions to the unique viscosity solutions of related obstacle problems for parabolic partial differential equations.     

Optimal control of random evolutions

We consider a stochastic control problem for a random evolution. We study the Bellman equation of the problem and we prove the existence of an optimal stochastic control which is Markovian. This problem enables us to approximate the general problem of the optimal control of solutions of stochastic differential equations.     

条件平均场随机微分方程的最优控制问题

作者研究了一个条件平均场随机微分方程的最优控制问题.这种方程和某些部分信息下的随机最优控制问题有关,并且可以看做是平均场随机微分方程的推广.作者以庞特里雅金最大值原理的形式给出最优控制满足的必要和充分条件.此外,文中给出一个线性二次最优控制问题来说明理论结果的应用.     

Quantitative Stability Analysis of Two-Stage Stochastic Linear Programs with Full Random Recourse

Abstract

In this paper, we apply the parametric linear programing technique and pseudo metrics to study the quantitative stability of the two-stage stochastic linear programing problem with full random recourse. Under the simultaneous perturbation of the cost vector, coefficient matrix, and right-hand side vector, we first establish the locally Lipschitz continuity of the optimal value function and the boundedness of optimal solutions of parametric linear programs. On the basis of these results, we deduce the locally Lipschitz continuity and the upper bound estimation of the objective function of the two-stage stochastic linear programing problem with full random recourse. Then by adopting different pseudo metrics, we obtain the quantitative stability results of two-stage stochastic linear programs with full random recourse which improve the current results under the partial randomness in the second stage problem. Finally, we apply these stability results to the empirical approximation of the two-stage stochastic programing model, and the rate of convergence is presented.     

随机参数和随机资金流环境下基于二次效用函数的投资组合优化

研究完全市场下基于二次效用最大化的带有随机资金流的动态投资组合选择问题,其中假设无风险利率、股票收益率和波动率矩阵都是一致有界随机过程.通过应用线性二次控制方法和向后随机微分方程理论得到了最优投资组合的解析表达式.