Linear square optimal control problem for stochastic difference equations with unknown parameters

The problems of stability and optimal control for stochastic difference equations are receiving important attention now (see, for example, [1–3]). In this paper, the optimal control in final form is obtained for optimal control problem of stochastic linear difference equation with unknown parameters and square cost functional. For stochastic functional differential equations, analogous result are obtained in [4].     

Approximations for functionals and optimal control problems on jump diffusion processes

The paper treats approximations to stochastic differential equations with both a diffusion and a jump component, and to associated functionals and partial-differential-integral equations of the (degenerate or not) elliptic or parabolic type. Approximations for the optimal control problem on such a model, or for the associated nonlinear partial-differential-integral equation are discussed. The techniques are purely probabilistic and are extensions of those in [3], which dealt with the diffusion case.     

Optimal control of linear stochastic evolution equations in Hilbert spaces and uniform observability

In this paper we study the existence of the optimal (minimizing) control for a tracking problem, as well as a quadratic cost problem subject to linear stochastic evolution equations with unbounded coefficients in the drift. The backward differential Riccati equation (BDRE) associated with these problems (see [2], for finite dimensional stochastic equations or [21], for infinite dimensional equations with bounded coefficients) is in general different from the conventional BDRE (see [10], [18]). Under stabilizability and uniform observability conditions and assuming that the control weight-costs are uniformly positive, we establish that BDRE has a unique, uniformly positive, bounded on ℝ ₊ and stabilizing solution. Using this result we find the optimal control and the optimal cost. It is known [18] that uniform observability does not imply detectability and consequently our results are different from those obtained under detectability conditions (see [10]).      

A necessary condition for optimal control of?initial coupled forward-backward stochastic differential equations with?partial information

This paper is concerned with a class of optimal control problems of forward-backward stochastic differential equations. One feature of these problems is that they are in the case of partial information and state equations are coupled at initial time. In terms of a classical convex variational technique, we establish a partial information maximum principle for the foregoing optimization problems. We also work out an example of partial information linear-quadratic optimal control to illustrate the application of the theoretical results; meanwhile, we find a forward-backward stochastic differential filtering equation, which is essentially different from classical forward stochastic filtering equations.     

Large deviations for stochastic PDE with Lévy noise

We prove a large deviation principle result for solutions of abstract stochastic evolution equations perturbed by small Lévy noise. We use general large deviations theorems of Varadhan and Bryc coupled with the techniques of Feng and Kurtz (2006) [15], viscosity solutions of integro-partial differential equations in Hilbert spaces, and deterministic optimal control methods. The Laplace limit is identified as a viscosity solution of a Hamilton-Jacobi-Bellman equation of an associated control problem. We also establish exponential moment estimates for solutions of stochastic evolution equations driven by Lévy noise. General results are applied to stochastic hyperbolic equations perturbed by subordinated Wiener process.     

On the optimal control of integral-functional equations

The problem of the optimal control of stochastic integral-functional equations of neutral type with an intergral quality functional is considered. For the case of a linear quadratic problem an explicit form of the optimal control is presented.

A class of equations which originated in the synthesis of Volterra equations, and stochastic differential equations with after-effects of neutral type are discussed. The problem of the optimal control of such systems is an essential development of the theory of controlled differential equations /1–8/. Examples of real objects whose mathematical models contain equations with an after-effect are discussed in /9/. A study of integral equations of neutral type is essential in controlling the motion of bodies in a continuous medium, /10/. Volterra equations first arose in the theory of creep and form the basis of this theory /11, 12/.     

Stochastic Control for Mean-Field Stochastic Partial Differential Equations with Jumps

We study optimal control for mean-field stochastic partial differential equations (stochastic evolution equations) driven by a Brownian motion and an independent Poisson random measure, in case of partial information control. One important novelty of our problem is represented by the introduction of general mean-field operators, acting on both the controlled state process and the control process. We first formulate a sufficient and a necessary maximum principle for this type of control. We then prove the existence and uniqueness of the solution of such general forward and backward mean-field stochastic partial differential equations. We apply our results to find the explicit optimal control for an optimal harvesting problem.     

Viscosity Solutions for a System of Integro-PDEs and Connections to Optimal Switching and Control of Jump-Diffusion Processes

We develop a viscosity solution theory for a system of nonlinear degenerate parabolic integro-partial differential equations (IPDEs) related to stochastic optimal switching and control problems or stochastic games. In the case of stochastic optimal switching and control, we prove via dynamic programming methods that the value function is a viscosity solution of the IPDEs. In our setting the value functions or the solutions of the IPDEs are not smooth, so classical verification theorems do not apply.     

Maximum Principle for Markov Regime-Switching Forward–Backward Stochastic Control System with Jumps and Relation to Dynamic Programming

This paper presents a sufficient stochastic maximum principle for a stochastic optimal control problem of Markov regime-switching forward–backward stochastic differential equations with jumps. The relationship between the stochastic maximum principle and the dynamic programming principle in a Markovian case is also established. Finally, applications of the main results to a recursive utility portfolio optimization problem in a financial market are discussed.     

An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations

In this paper, we will study an indefinite stochastic linear quadratic optimal control problem, where the controlled system is described by a stochastic differential equation with delay. By introducing the relaxed compensator as a novel method, we obtain the well-posedness of this linear quadratic problem for indefinite case. And then, we discuss the uniqueness and existence of the solutions for a kind of anticipated forward–backward stochastic differential delayed equations. Based on this, we derive the solvability of the corresponding stochastic Hamiltonian systems, and give the explicit representation of the optimal control for the linear quadratic problem with delay in an open-loop form. The theoretical results are validated as well on the control problems of engineering and economics under indefinite condition.     

An inverse optimal problem in discrete-time stochastic control

In this paper, we study an inverse optimal problem in discrete-time stochastic control. We give necessary and sufficient conditions for a solution to a system of stochastic difference equations to be the solution of a certain optimal control problem. Our results extend to the stochastic case the work of Dechert. In particular, we present a stochastic version of an important principle in welfare economics.     

A Deterministic Approach To Stochastic Optimal Control With Application To Anticipative Control

Using the decomposition of solution of SDE, we consider the stochastic optimal control problem with anticipative controls as a family of deterministic control problems parametrized by the paths of the driving Wiener process and of a newly introduced Lagrange multiplier stochastic process (nonanticipativity equality constraint). It is shown that the value function of these problems is the unique global solution of a robust equation (random partial differential equation) associated to a linear backward Hamilton-Jacobi-Bellman stochastic partial differential equation (HJB SPDE). This appears as limiting SPDE for a sequence of random HJB PDE's when linear interpolation approximation of the Wiener process is used. Our approach extends the Wong-Zakai type results [20] from SDE to the stochastic dynamic programming equation by showing how this arises as average of the limit of a sequence of deterministic dynamic programming equations. The stochastic characteristics method of Kunita [13] is used to represent the value function. By choosing the Lagrange multiplier equal to its nonanticipative constraint value the usual stochastic (nonanticipative) optimal control and optimal cost are recovered. This suggests a method for solving the anticipative control problems by almost sure deterministic optimal control. We obtain a PDE for the “cost of perfect information” the difference between the cost function of the nonanticipative control problem and the cost of the anticipative problem which satisfies a nonlinear backward HJB SPDE. Poisson bracket conditions are found ensuring this has a global solution. The cost of perfect information is shown to be zero when a Lagrangian submanifold is invariant for the stochastic characteristics. The LQG problem and a nonlinear anticipative control problem are considered as examples in this framework     

A Type of General Forward-Backward Stochastic Differential Equations and Applications

The authors discuss one type of general forward-backward stochastic differential equations (FBSDEs) with It?o’s stochastic delayed equations as the forward equations and anticipated backward stochastic differential equations as the backward equations. The existence and uniqueness results of the general FBSDEs are obtained. In the framework of the general FBSDEs in this paper, the explicit form of the optimal control for linearquadratic stochastic optimal control problem with delay and the Nash equilibrium point for nonzero sum differential games problem with delay are obtained.     

Backward Stochastic Riccati Equations and Infinite Horizon L-Q Optimal Control with Infinite Dimensional State Space and Random Coefficients

We study the Riccati equation arising in a class of quadratic optimal control problems with infinite dimensional stochastic differential state equation and infinite horizon cost functional. We allow the coefficients, both in the state equation and in the cost, to be random. In such a context backward stochastic Riccati equations are backward stochastic differential equations in the whole positive real axis that involve quadratic non-linearities and take values in a non-Hilbertian space. We prove existence of a minimal non-negative solution and, under additional assumptions, its uniqueness. We show that such a solution allows to perform the synthesis of the optimal control and investigate its attractivity properties. Finally the case where the coefficients are stationary is addressed and an example concerning a controlled wave equation in random media is proposed.     

条件平均场随机微分方程的最优控制问题

作者研究了一个条件平均场随机微分方程的最优控制问题.这种方程和某些部分信息下的随机最优控制问题有关,并且可以看做是平均场随机微分方程的推广.作者以庞特里雅金最大值原理的形式给出最优控制满足的必要和充分条件.此外,文中给出一个线性二次最优控制问题来说明理论结果的应用.     

On the optimal control of stochastic linear systems with contaminated partial observations

Partial information for stochastic control systems with state equations linear in the input are considered. The observation noise process is independent Gaussian and the case of ε-contamination is treated. A robustified version of the Kalman filter gives the update state in the contaminated observations case. The optimal control is obtained and for the cuadratic cost a closed solution is given. This research was supported by CICYT through grand N. TIC93-0702-C02-02     

Ergodic BSDEs under weak dissipative assumptions

In this paper we study ergodic backward stochastic differential equations (EBSDEs) dropping the strong dissipativity assumption needed in Fuhrman et al. (2009) [12]. In other words we do not need to require the uniform exponential decay of the difference of two solutions of the underlying forward equation, which, on the contrary, is assumed to be non-degenerate.We show the existence of solutions by the use of coupling estimates for a non-degenerate forward stochastic differential equation with bounded measurable nonlinearity. Moreover we prove the uniqueness of “Markovian” solutions by exploiting the recurrence of the same class of forward equations.Applications are then given for the optimal ergodic control of stochastic partial differential equations and to the associated ergodic Hamilton-Jacobi-Bellman equations.     

一类新的线性二次随机最优控制器的设计

给出一类正倒向随机微分方程解的存在唯一性结果,应用这个结果研究了一类新的推广的随机线性二次最优控制器的设计问题,得到了由正倒向随机微分方程解所表示的唯一最优控制器的显式结构;在推广的Riccati方程系统基础上,得到最优控制器精确的线性反馈形式.最后,给出了随机线性二次最优控制器的设计算法.     

Linear–quadratic stochastic two-person nonzero-sum differential games: Open-loop and closed-loop Nash equilibria

In this paper, we consider a linear–quadratic stochastic two-person nonzero-sum differential game. Open-loop and closed-loop Nash equilibria are introduced. The existence of the former is characterized by the solvability of a system of forward–backward stochastic differential equations, and that of the latter is characterized by the solvability of a system of coupled symmetric Riccati differential equations. Sometimes, open-loop Nash equilibria admit a closed-loop representation, via the solution to a system of non-symmetric Riccati equations, which could be different from the outcome of the closed-loop Nash equilibria in general. However, it is found that for the case of zero-sum differential games, the Riccati equation system for the closed-loop representation of an open-loop saddle point coincides with that for the closed-loop saddle point, which leads to the conclusion that the closed-loop representation of an open-loop saddle point is the outcome of the corresponding closed-loop saddle point as long as both exist. In particular, for linear–quadratic optimal control problem, the closed-loop representation of an open-loop optimal control coincides with the outcome of the corresponding closed-loop optimal strategy, provided both exist.     

Indifference pricing and hedging in a multiple-priors model with trading constraints

This paper considers utility indifference valuation of derivatives under model uncertainty and trading constraints, where the utility is formulated as an additive stochastic differential utility of both intertemporal consumption and terminal wealth, and the uncertain prospects are ranked according to a multiple-priors model of Chen and Epstein (2002). The price is determined by two optimal stochastic control problems (mixed with optimal stopping time in the case of American option) of forward-backward stochastic differential equations. By means of backward stochastic differential equation and partial differential equation methods, we show that both bid and ask prices are closely related to the Black-Scholes risk-neutral price with modified dividend rates. The two prices will actually coincide with each other if there is no trading constraint or the model uncertainty disappears. Finally, two applications to European option and American option are discussed.