An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations

In this paper, we will study an indefinite stochastic linear quadratic optimal control problem, where the controlled system is described by a stochastic differential equation with delay. By introducing the relaxed compensator as a novel method, we obtain the well-posedness of this linear quadratic problem for indefinite case. And then, we discuss the uniqueness and existence of the solutions for a kind of anticipated forward–backward stochastic differential delayed equations. Based on this, we derive the solvability of the corresponding stochastic Hamiltonian systems, and give the explicit representation of the optimal control for the linear quadratic problem with delay in an open-loop form. The theoretical results are validated as well on the control problems of engineering and economics under indefinite condition.     

Indefinite stochastic LQ control with cross term via semidefinite programming

An indefinite stochastic linear-quadratic (LQ) optimal control problem with cross term over an infinite time horizon is studied, allowing the weighting matrices to be indefinite. A systematic approach to the problem based on semidefinite programming (SDP) and related duality analysis is developed. Several implication relations among the SDP complementary duality, the existence of the solution to the generalized Riccati equation and the optimality of LQ problem are discussed. Based on these relations, a numerical procedure that provides a thorough treatment of the LQ problem via primal-dual SDP is given: it identifies a stabilizing optimal feedback control or determines the problem has no optimal solution. An example is provided to illustrate the results obtained.     

General Linear Quadratic Optimal Stochastic Control Problem Driven by a Brownian Motion and a Poisson Random Martingale Measure with Random Coefficients

In this article, we consider a linear-quadratic optimal control problem (LQ problem) for a controlled linear stochastic differential equation driven by a multidimensional Browinan motion and a Poisson random martingale measure in the general case, where the coefficients are allowed to be predictable processes or random matrices. By the duality technique, the dual characterization of the optimal control is derived by the optimality system (so-called stochastic Hamilton system), which turns out to be a linear fully coupled forward-backward stochastic differential equation with jumps. Using a decoupling technique, the connection between the stochastic Hamilton system and the associated Riccati equation is established. As a result, the state feedback representation is obtained for the optimal control. As the coefficients for the LQ problem are random, here, the associated Riccati equation is a highly nonlinear backward stochastic differential equation (BSDE) with jumps, where the generator depends on the unknown variables K, L, and H in a quadratic way (see (5.9) herein). For the case where the generator is bounded and is linearly dependent on the unknown martingale terms L and H, the existence and uniqueness of the solution for the associated Riccati equation are established by Bellman's principle of quasi-linearization.     

On the existence of the stabilizing solution of generalized Riccati equations arising in zero-sum stochastic difference games: the time-varying case

In this paper, a large class of time-varying Riccati equations arising in stochastic dynamic games is considered. The problem of the existence and uniqueness of some globally defined solution, namely the bounded and stabilizing solution, is investigated. As an application of the obtained existence results, we address in a second step the problem of infinite-horizon zero-sum two players linear quadratic (LQ) dynamic game for a stochastic discrete-time dynamical system subject to both random switching of its coefficients and multiplicative noise. We show that in the solution of such an optimal control problem, a crucial role is played by the unique bounded and stabilizing solution of the considered class of generalized Riccati equations.     

带有交叉项的离散不定随机线性二次控制问题

研究性能指标带有交叉项的离散时间不定随机线性二次(LQ)控制问题，允许权矩阵是不定的。引入一个广义差分Riccati方程，证明了此方程的可解性是LQ问题存在最优控制的一个充分条件，并用方程的解给出了最优控制。推广了[1]的结果。     

A stochastic linear–quadratic problem with Lévy processes and its application to finance

We study a Linear–Quadratic Regulation (LQR) problem with Lévy processes and establish the closeness property of the solution of the multi-dimensional Backward Stochastic Riccati Differential Equation (BSRDE) with Lévy processes. In particular, we consider multi-dimensional and one-dimensional BSRDEs with Teugel’s martingales which are more general processes driven by Lévy processes. We show the existence and uniqueness of solutions to the one-dimensional regular and singular BSRDEs with Lévy processes by means of the closeness property of the BSRDE and obtain the optimal control for the non-homogeneous case. An application of the backward stochastic differential equation approach to a financial (portfolio selection) problem with full and partial observation cases is provided.     

Discrete-time Indefinite LQ Control with State and Control Dependent Noises

This paper deals with the discrete-time stochastic LQ problem involving state and control dependent noises, whereas the weighting matrices in the cost function are allowed to be indefinite. In this general setting, it is shown that the well-posedness and the attainability of the LQ problem are equivalent. Moreover, a generalized difference Riccati equation is introduced and it is proved that its solvability is necessary and sufficient for the existence of an optimal control which can be either of state feedback or open-loop form. Furthermore, the set of all optimal controls is identified in terms of the solution to the proposed difference Riccati equation.     

A pathwise approach to backward and forward stochastic differential equations on the poisson space*

We study the existence and uniqueness of pathwise solutions to backward and forward stochastic differential equations on the Poisson space. We obtain the structure of these pathwise solutions to give the relationship between them. Also, in the bilinear case, we calculate the explicit form of their chaos decompositions.     

Optimal control of backward stochastic heat equation with Neumann boundary control and noise

This paper considers a stochastic control problem in which the dynamic system is a controlled backward stochastic heat equation with Neumann boundary control and boundary noise and the state must coincide with a given random vector at terminal time. Through defining a proper form of the mild solution for the state equation, the existence and uniqueness of the mild solution is given. As a main result, a global maximum principle for our control problem is presented. The main result is also applied to a backward linear-quadratic control problem in which an optimal control is obtained explicitly as a feedback of the solution to a forward–backward stochastic partial differential equation.     

Stochastic Control for Mean-Field Stochastic Partial Differential Equations with Jumps

We study optimal control for mean-field stochastic partial differential equations (stochastic evolution equations) driven by a Brownian motion and an independent Poisson random measure, in case of partial information control. One important novelty of our problem is represented by the introduction of general mean-field operators, acting on both the controlled state process and the control process. We first formulate a sufficient and a necessary maximum principle for this type of control. We then prove the existence and uniqueness of the solution of such general forward and backward mean-field stochastic partial differential equations. We apply our results to find the explicit optimal control for an optimal harvesting problem.     

Maximum principle for optimal control of neutral stochastic functional differential systems

This paper is concerned with optimal control of neutral stochastic functional differential equations (NSFDEs). The Pontryagin maximum principle is proved for optimal control, where the adjoint equation is a linear neutral backward stochastic functional equation of Volterra type (VNBSFE). The existence and uniqueness of the solution are proved for the general nonlinear VNBSFEs. Under the convexity assumption of the Hamiltonian function, a sufficient condition for the optimality is addressed as well.     

带跳的分数倒向重随机微分方程及相应的随机积分偏微分方程

本文首次把Poisson随机测度引入分数倒向重随机微分方程,基于可料的Girsanov变换证明由Brown运动、Poisson随机测度和Hurst参数在(1/2,1)范围内的分数Brown运动共同驱动的半线性倒向重随机微分方程解的存在唯一性.在此基础上,本文定义一类半线性随机积分偏微分方程的随机黏性解,并证明该黏性解由带跳分数倒向重随机微分方程的解唯一地给出,对经典的黏性解理论作出有益的补充.     

Optimal control problems constrained by the stochastic Navier–Stokes equations with multiplicative Lévy noise

We consider the controlled stochastic Navier–Stokes equations in a bounded multidimensional domain, where the noise term allows jumps. In order to prove existence and uniqueness of an optimal control w.r.t. a given control problem, we first need to show the existence and uniqueness of a local mild solution of the considered controlled stochastic Navier–Stokes equations. We then discuss the control problem, where the related cost functional includes stopping times dependent on controls. Based on the continuity of the cost functional, we can apply existence and uniqueness results provided in [4], which enables us to show that a unique optimal control exists.     

Well-posedness of a stochastic phase-field problem with multiplicative noises

In this paper, we prove the existence and uniqueness of the solution of a stochastic phase-field problem with multiplicative noises. Phase-field models are typically used to describe melting and solidification processes. We consider here the case of multiplicative noises induced by a Q-Brownian motion.     

Indefinite LQ optimal control with cross term for discrete‐time uncertain systems

Recently, there has been an increasing interest in the study on uncertain optimal control problems. In this paper, a linear quadratic (LQ) optimal control with cross term for discrete‐time uncertain systems is considered, whereas the weighting matrices in the cost function are allowed to be indefinite. Firstly, a recurrence equation for the problem is presented based on Bellman's principle of optimality in dynamic programming. Then, a necessary condition for the existence of an optimal linear state feedback control of the indefinite LQ problem is given by the recurrence equation. Moreover, a sufficient condition of well‐posedness for the indefinite LQ problem is presented by introducing a linear matrix inequality (LMI) condition. Furthermore, it is shown that the well‐posedness of the indefinite LQ problem, the solvability of the indefinite LQ problem, the LMI condition, and the solvability of the constrained difference equation are equivalent to each other. Finally, an example is presented to illustrate the results obtained.     

Hilbert space-valued forward-backward stochastic differential equations with Poisson jumps and applications

In this paper, we study a class of Hilbert space-valued forward-backward stochastic differential equations (FBSDEs) with bounded random terminal times; more precisely, the FBSDEs are driven by a cylindrical Brownian motion on a separable Hilbert space and a Poisson random measure. In the case where the coefficients are continuous but not Lipschitz continuous, we prove the existence and uniqueness of adapted solutions to such FBSDEs under assumptions of weak monotonicity and linear growth on the coefficients. Existence is shown by applying a finite-dimensional approximation technique and the weak convergence theory. We also use these results to solve some special types of optimal stochastic control problems.     

Spin-boson model through a Poisson-driven stochastic process

We give a functional integral representation of the semigroup generated by the spin-boson Hamiltonian by making use of a Poisson point process and a Euclidean field. We present a method of constructing Gibbs path measures indexed by the full real line which can be applied also to more general stochastic processes with jump discontinuities. Using these tools we then show existence and uniqueness of the ground state of the spin-boson, and analyze ground state properties. In particular, we prove super-exponential decay of the number of bosons, Gaussian decay of the field operators, derive expressions for the positive integer, fractional and exponential moments of the field operator, and discuss the field fluctuations in the ground state.     

Mean-field type forward-backward doubly stochastic differential equations and related stochastic differential games

We study a kind of partial information non-zero sum differential games of mean-field backward doubly stochastic differential equations, in which the coefficient contains not only the state process but also its marginal distribution, and the cost functional is also of mean-field type. It is required that the control is adapted to a sub-filtration of the filtration generated by the underlying Brownian motions. We establish a necessary condition in the form of maximum principle and a verification theorem, which is a sufficient condition for Nash equilibrium point. We use the theoretical results to deal with a partial information linear-quadratic (LQ) game, and obtain the unique Nash equilibrium point for our LQ game problem by virtue of the unique solvability of mean-field forward-backward doubly stochastic differential equation.     

Well-posedness of stochastic Korteweg-de Vries-Benjamin-Ono equation

In this paper, we consider the stochastic Korteweg-de Vries-Benjamin-Ono equation with white noise. Using Fourier restriction norm method and some basic inequalities, we obtain a local existence and uniqueness result for the solution of this problem. We also get global existence of the L ²(ℝ) solution.     

一类新的线性二次随机最优控制器的设计

给出一类正倒向随机微分方程解的存在唯一性结果,应用这个结果研究了一类新的推广的随机线性二次最优控制器的设计问题,得到了由正倒向随机微分方程解所表示的唯一最优控制器的显式结构;在推广的Riccati方程系统基础上,得到最优控制器精确的线性反馈形式.最后,给出了随机线性二次最优控制器的设计算法.