Maximum principle for optimal control of neutral stochastic functional differential systems

This paper is concerned with optimal control of neutral stochastic functional differential equations (NSFDEs). The Pontryagin maximum principle is proved for optimal control, where the adjoint equation is a linear neutral backward stochastic functional equation of Volterra type (VNBSFE). The existence and uniqueness of the solution are proved for the general nonlinear VNBSFEs. Under the convexity assumption of the Hamiltonian function, a sufficient condition for the optimality is addressed as well.     

Stochastic maximum principle for mean-field forward-backward stochastic control system with terminal state constraints

In this paper,we consider an optimal control problem with state constraints,where the control system is described by a mean-field forward-backward stochastic differential equation(MFFBSDE,for short)and the admissible control is mean-field type.Making full use of the backward stochastic differential equation theory,we transform the original control system into an equivalent backward form,i.e.,the equations in the control system are all backward.In addition,Ekeland’s variational principle helps us deal with the state constraints so that we get a stochastic maximum principle which characterizes the necessary condition of the optimal control.We also study a stochastic linear quadratic control problem with state constraints.     

A Type of General Forward-Backward Stochastic Differential Equations and Applications

The authors discuss one type of general forward-backward stochastic differential equations (FBSDEs) with It?o’s stochastic delayed equations as the forward equations and anticipated backward stochastic differential equations as the backward equations. The existence and uniqueness results of the general FBSDEs are obtained. In the framework of the general FBSDEs in this paper, the explicit form of the optimal control for linearquadratic stochastic optimal control problem with delay and the Nash equilibrium point for nonzero sum differential games problem with delay are obtained.     

条件平均场随机微分方程的最优控制问题

作者研究了一个条件平均场随机微分方程的最优控制问题.这种方程和某些部分信息下的随机最优控制问题有关,并且可以看做是平均场随机微分方程的推广.作者以庞特里雅金最大值原理的形式给出最优控制满足的必要和充分条件.此外,文中给出一个线性二次最优控制问题来说明理论结果的应用.     

Backward stochastic Volterra integral equations and some related problems

Backward stochastic Volterra integral equations (BSVIEs, for short) are introduced. The existence and uniqueness of adapted solutions are established. A duality principle between linear BSVIEs and (forward) stochastic Volterra integral equations is obtained. As applications of the duality principle, a comparison theorem is proved for the adapted solutions of BSVIEs, and a Pontryagin type maximum principle is established for an optimal control of stochastic integral equations.     

RAZUMIKHIN-TYPE THEOREM FOR NEUTRAL STOCHASTIC FUNCTIONAL DIFFERENTIAL EQUATIONS WITH UNBOUNDED DELAY

This paper establishes the Razumikhin-type theorem on stability for neutral stochastic functional differential equations with unbounded delay. To overcome difficulties from unbounded delay, we develop several different techniques to investigate stability. To show our idea clearly, we examine neutral stochastic delay differential equations with unbounded delay and linear neutral stochastic Volterra unbounded-delay-integro-differential equations.     

Forward and Backward Mean-Field Stochastic Partial Differential Equation and Optimal Control

This paper is mainly concerned with the solutions to both forward and backward mean-field stochastic partial differential equation and the corresponding optimal control problem for mean-field stochastic partial differential equation. The authors first prove the continuous dependence theorems of forward and backward mean-field stochastic partial differential equations and show the existence and uniqueness of solutions to them. Then they establish necessary and sufficient optimality conditions of the control problem in the form of Pontryagin''s maximum principles. To illustrate the theoretical results, the authors apply stochastic maximum principles to study the infinite-dimensional linear-quadratic control problem of mean-field type. Further, an application to a Cauchy problem for a controlled stochastic linear PDE of mean-field type is studied.     

Regularity of Backward Stochastic Volterra Integral Equations in Hilbert Spaces

This article investigates backward stochastic Volterra integral equations in Hilbert spaces. The existence and uniqueness of their adapted solutions is reviewed. We establish the regularity of the adapted solutions to such equations by means of Malliavin calculus. For an application, we study an optimal control problem for a stochastic Volterra integral equation driven by a Hilbert space-valued fractional Brownian motion. A Pontryagin-type maximum principle is formulated for the problem and an example is presented.     

Linear square optimal control problem for stochastic difference equations with unknown parameters

The problems of stability and optimal control for stochastic difference equations are receiving important attention now (see, for example, [1–3]). In this paper, the optimal control in final form is obtained for optimal control problem of stochastic linear difference equation with unknown parameters and square cost functional. For stochastic functional differential equations, analogous result are obtained in [4].     

An analytic approach to stochastic Volterra equations with completely monotone kernels

We apply the semigroup setting of Desch and Miller to a class of stochastic integral equations of Volterra type with completely monotone kernels with a multiplicative noise term; the corresponding equation is an infinite dimensional stochastic equation with unbounded diffusion operator that we solve with the semigroup approach of Da Prato and Zabczyk. As a motivation of our results, we study an optimal control problem when the control enters the system together with the noise.      

A Stochastic Maximum Principle for a Stochastic Differential Game of a Mean-Field Type

We construct a stochastic maximum principle (SMP) which provides necessary conditions for the existence of Nash equilibria in a certain form of N-agent stochastic differential game (SDG) of a mean-field type. The information structure considered for the SDG is of a possible asymmetric and partial type. To prove our SMP we take an approach based on spike-variations and adjoint representation techniques, analogous to that of S.?Peng (SIAM J. Control Optim. 28(4):966?C979, 1990) in the optimal stochastic control context. In our proof we apply adjoint representation procedures at three points. The first-order adjoint processes are defined as solutions to certain mean-field backward stochastic differential equations, and second-order adjoint processes of a first type are defined as solutions to certain backward stochastic differential equations. Second-order adjoint processes of a second type are defined as solutions of certain backward stochastic equations of a type that we introduce in this paper, and which we term conditional mean-field backward stochastic differential equations. From the resulting representations, we show that the terms relating to these second-order adjoint processes of the second type are of an order such that they do not appear in our final SMP equations. A?comparable situation exists in an article by R.?Buckdahn, B.?Djehiche, and J.?Li (Appl. Math. Optim. 64(2):197?C216, 2011) that constructs a SMP for a mean-field type optimal stochastic control problem; however, the approach we take of using these second-order adjoint processes of a second type to deal with the type of terms that we refer to as the second form of quadratic-type terms represents an alternative to a development, to our setting, of the approach used in their article for their analogous type of term.     

A Nonhomogeneous Mean-Field Linear-Quadratic Optimal Control Problem and Application

In this paper, a mean-variance hedging portfolio problem is considered for mean-field stochastic differential equations. The original problem can be reformulated as a nonhomogeneous linear-quadratic optimal control problem with mean-field type. By virtue of the classical completion of squares, the optimal control is obtained in the form of state feedback. We use the theoretical results to the mean-variance hedging portfolio problem and get the optimal portfolio strategy.

     

L\'evy过程驱动的正倒向随机系统的随机最大值原理

研究了由Teugels鞅和与之独立的多维Brown运动共同驱动的正倒向随机控制系统的最优控制问题. 这里Teugels鞅是一列与L\'{e}vy 过程相关的两两强正交的正态鞅 (见Nualart, Schoutens 在2000年的结果). 在允许控制值域为一非空凸闭集假设下, 采用凸变分法和对偶技术获得了最优控制存在所满足的充分和必要条件. 作为应用, 系统研究了线性正倒向随机系统的二次最优控制问题(简记为FBLQ问题), 通过相应的随机哈密顿系统对最优控制 进行了对偶刻画. 这里的随机哈密顿系统是由Teugels鞅和多维Brown运动共同驱动的线性正倒向随机微分方程, 其由状态方程、伴随方程和最优控制的对偶表示共同来构成.     

An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations

In this paper, we will study an indefinite stochastic linear quadratic optimal control problem, where the controlled system is described by a stochastic differential equation with delay. By introducing the relaxed compensator as a novel method, we obtain the well-posedness of this linear quadratic problem for indefinite case. And then, we discuss the uniqueness and existence of the solutions for a kind of anticipated forward–backward stochastic differential delayed equations. Based on this, we derive the solvability of the corresponding stochastic Hamiltonian systems, and give the explicit representation of the optimal control for the linear quadratic problem with delay in an open-loop form. The theoretical results are validated as well on the control problems of engineering and economics under indefinite condition.     

风险的动态定量和一个相关的随机对策问题

本文讨论不完全市场中股票收益率不确定时的动态风险度量问题和一个相关的随机对策问题。该动态风险度量可表示为一个随机最优控制问题的值函数,以倒向随机微分方程为工具我们给出了最优目标具有的形式,并给出随机对策问题上值与下值相等的充分条件和鞍点的存在性。     

Instability in the critical case of pair of pure imaginary roots for a class of systems with aftereffect

The stability of a system described by Volterra integrodifferential equations is investigated in the critical case when the characteristic equation has a pair of pure imaginery roots. Conditions for instability, analogous to the well-known conditions from the theory of differential equations [1], are derived. (A similar result was established previously in [2] for integrodifferential equations of simpler structure with integral kernels of exponential-polynomial type). For the proof, several manipulations are used to simplify the original equation and, in particular, to reduce the linearized equation to the form of a differential equation with constant diagonal matrix. (An analogous approach was used to analyse instability for Volterra integrodifferential equations in the critical case of zero root in [3, 4]). As an example, the sign of the Lyapunov constant in the problem of the rotational motion of a rigid body with viscoelastic supports is calculated.     

一类新的线性二次随机最优控制器的设计

给出一类正倒向随机微分方程解的存在唯一性结果,应用这个结果研究了一类新的推广的随机线性二次最优控制器的设计问题,得到了由正倒向随机微分方程解所表示的唯一最优控制器的显式结构;在推广的Riccati方程系统基础上,得到最优控制器精确的线性反馈形式.最后,给出了随机线性二次最优控制器的设计算法.     

Stochastic Control for Mean-Field Stochastic Partial Differential Equations with Jumps

We study optimal control for mean-field stochastic partial differential equations (stochastic evolution equations) driven by a Brownian motion and an independent Poisson random measure, in case of partial information control. One important novelty of our problem is represented by the introduction of general mean-field operators, acting on both the controlled state process and the control process. We first formulate a sufficient and a necessary maximum principle for this type of control. We then prove the existence and uniqueness of the solution of such general forward and backward mean-field stochastic partial differential equations. We apply our results to find the explicit optimal control for an optimal harvesting problem.     

The maximum principle for the nonlinear stochastic optimal control problem of switching systems

The aim of this paper is to present a stochastic maximum principle for an optimal control problem of switching systems. It presents necessary conditions of optimality in the form of a maximum principle for stochastic switching systems, in which the dynamic of the constituent processes takes the form of stochastic differential equations. The restrictions on transitions for the system are described through equality constraints.     

Well-posedness and regularity of backward stochastic Volterra integral equations

Backward stochastic Volterra integral equations (BSVIEs, for short) are studied. Notion of adapted M-solution is introduced. Well-posedness of BSVIEs is established and some regularity results are proved for the adapted M-solutions via Malliavin calculus. A Pontryagin type maximum principle is presented for optimal controls of stochastic Volterra integral equations.