带有交叉项的离散不定随机线性二次控制问题

研究性能指标带有交叉项的离散时间不定随机线性二次(LQ)控制问题，允许权矩阵是不定的。引入一个广义差分Riccati方程，证明了此方程的可解性是LQ问题存在最优控制的一个充分条件，并用方程的解给出了最优控制。推广了[1]的结果。     

Indefinite LQ optimal control with cross term for discrete‐time uncertain systems

Recently, there has been an increasing interest in the study on uncertain optimal control problems. In this paper, a linear quadratic (LQ) optimal control with cross term for discrete‐time uncertain systems is considered, whereas the weighting matrices in the cost function are allowed to be indefinite. Firstly, a recurrence equation for the problem is presented based on Bellman's principle of optimality in dynamic programming. Then, a necessary condition for the existence of an optimal linear state feedback control of the indefinite LQ problem is given by the recurrence equation. Moreover, a sufficient condition of well‐posedness for the indefinite LQ problem is presented by introducing a linear matrix inequality (LMI) condition. Furthermore, it is shown that the well‐posedness of the indefinite LQ problem, the solvability of the indefinite LQ problem, the LMI condition, and the solvability of the constrained difference equation are equivalent to each other. Finally, an example is presented to illustrate the results obtained.     

Indefinite Stochastic Linear Quadratic Control with Markovian Jumps in Infinite Time Horizon

This paper studies a stochastic linear quadratic (LQ) control problem in the infinite time horizon with Markovian jumps in parameter values. In contrast to the deterministic case, the cost weighting matrices of the state and control are allowed to be indinifite here. When the generator matrix of the jump process – which is assumed to be a Markov chain – is known and time-invariant, the well-posedness of the indefinite stochastic LQ problem is shown to be equivalent to the solvability of a system of coupled generalized algebraic Riccati equations (CGAREs) that involves equality and inequality constraints. To analyze the CGAREs, linear matrix inequalities (LMIs) are utilized, and the equivalence between the feasibility of the LMIs and the solvability of the CGAREs is established. Finally, an LMI-based algorithm is devised to slove the CGAREs via a semidefinite programming, and numerical results are presented to illustrate the proposed algorithm.     

Constrained LQ Problem with a Random Jump and Application to Portfolio Selection

This paper deals with a constrained stochastic linear-quadratic(LQ for short)optimal control problem where the control is constrained in a closed cone. The state process is governed by a controlled SDE with random coefficients. Moreover, there is a random jump of the state process. In mathematical finance, the random jump often represents the default of a counter party. Thanks to the It-Tanaka formula, optimal control and optimal value can be obtained by solutions of a system of backward stochastic differential equations(BSDEs for short). The solvability of the BSDEs is obtained by solving a recursive system of BSDEs driven by the Brownian motions. The author also applies the result to the mean variance portfolio selection problem in which the stock price can be affected by the default of a counterparty.     

Backward Stochastic Riccati Equations and Infinite Horizon L-Q Optimal Control with Infinite Dimensional State Space and Random Coefficients

We study the Riccati equation arising in a class of quadratic optimal control problems with infinite dimensional stochastic differential state equation and infinite horizon cost functional. We allow the coefficients, both in the state equation and in the cost, to be random. In such a context backward stochastic Riccati equations are backward stochastic differential equations in the whole positive real axis that involve quadratic non-linearities and take values in a non-Hilbertian space. We prove existence of a minimal non-negative solution and, under additional assumptions, its uniqueness. We show that such a solution allows to perform the synthesis of the optimal control and investigate its attractivity properties. Finally the case where the coefficients are stationary is addressed and an example concerning a controlled wave equation in random media is proposed.     

线性时变系统二次最优控制问题的保辛近似求解

状态空间的最优控制体系是保守的,其近似算法应当保辛．提出了基于分段常值精细积分方法的保辛摄动近似方法,在同一框架下求解了线性时变LQ最优控制中的计算问题,即变系数矩阵Riccati方程和状态反馈方程．该算法是保辛的,具有很好的数值稳定性和精度．算例验证了算法的有效性．     

Stochastic H2/H∞ Control with Random Coefficients

This paper is concerned with the mixed H2/H∞ control for stochastic systems with random coefcients,which is actually a control combining the H2 optimization with the H∞robust performance as the name of H2/H∞ reveals.Based on the classical theory of linear-quadratic(LQ,for short)optimal control,the sufcient and necessary conditions for the existence and uniqueness of the solution to the indefinite backward stochastic Riccati equation(BSRE,for short)associated with H∞ robustness are derived.Then the sufcient and necessary conditions for the existence of the H2/H∞ control are given utilizing a pair of coupled stochastic Riccati equations.     

Robust Stabilization of Linear Systems with Delayed State and Control

Robust stabilization of linear systems with delays on both the state and control input is studied in this paper. Using an improved Lyapunov-Krasovskii functional, we establish new criteria that ensure the robust stability of the closed-loop system with memoryless state feedback controls. The generalized conditions are derived in terms of linear matrix inequalities (LMIs), allowing us to compute simultaneously the two bounds that characterize the exponential stability rate of the solution and can be easily solved by numerical algorithms. This work was supported by the National Basic Program in Natural Sciences. The authors thank the anonymous referees for valuable comments to improve the paper.     

条件平均场随机微分方程的最优控制问题

作者研究了一个条件平均场随机微分方程的最优控制问题.这种方程和某些部分信息下的随机最优控制问题有关,并且可以看做是平均场随机微分方程的推广.作者以庞特里雅金最大值原理的形式给出最优控制满足的必要和充分条件.此外,文中给出一个线性二次最优控制问题来说明理论结果的应用.     

Forward-backward Stochastic Differential Equations and Backward Linear Quadratic Stochastic Optimal Control Problem

In this paper, we use the solutions of forward-backward stochastic differential equations to get the optimal control for backward stochastic linear quadratic optimal control problem. And we also give the linear feedback regulator for the optimal control problem by using the solutions of a group of Riccati equations.     

Well-Posedness and Finite Element Approximations for Elliptic SPDEs with Gaussian Noises

The paper studies the well-posedness and optimal error estimates of spectral finite element approximations for the boundary value problems of semi-linear elliptic SPDEs driven by white or colored Gaussian noises. The noise term is approximated through the spectral projection of the covariance operator, which is not required to be commutative with the Laplacian operator.Through the convergence analysis of SPDEs with the noise terms replaced by the projected noises, the well-posedness of the SPDE is established under certain covariance operator-dependent conditions. These SPDEs with projected noises are then numerically approximated with the finite element method. A general error estimate framework is established for the finite element approximations. Based on this framework, optimal error estimates of finite element approximations for elliptic SPDEs driven by power-law noises are obtained. It is shown that with the proposed approach, convergence order of white noise driven SPDEs is improved by half for one-dimensional problems, and by an infinitesimal factor for higher-dimensional problems.     

在不允许卖空条件下的最优比例再保险投资

假设保险公司的盈余过程服从一个带扰动项的布朗运动,保险公司可以投资一个无风险资产和n个风险资产,还可以购买比例再保险,并且风险市场是不允许卖空的.本文在均值一方差优化准则下研究保险公司的最优投资一再保策略选择问题,利用LQ随机控制方法求解模型,得到了保险公司的最优组合投资策略的解析和保险公司投资的有效投资边界的解析表达...     

Optimal control of backward stochastic heat equation with Neumann boundary control and noise

This paper considers a stochastic control problem in which the dynamic system is a controlled backward stochastic heat equation with Neumann boundary control and boundary noise and the state must coincide with a given random vector at terminal time. Through defining a proper form of the mild solution for the state equation, the existence and uniqueness of the mild solution is given. As a main result, a global maximum principle for our control problem is presented. The main result is also applied to a backward linear-quadratic control problem in which an optimal control is obtained explicitly as a feedback of the solution to a forward–backward stochastic partial differential equation.     

不确定离散时滞控制饱和系统的预测控制

讨论同时具有时滞和控制饱和的离散时间不确定系统鲁棒预测控制问题。     

General Linear Quadratic Optimal Stochastic Control Problem Driven by a Brownian Motion and a Poisson Random Martingale Measure with Random Coefficients

In this article, we consider a linear-quadratic optimal control problem (LQ problem) for a controlled linear stochastic differential equation driven by a multidimensional Browinan motion and a Poisson random martingale measure in the general case, where the coefficients are allowed to be predictable processes or random matrices. By the duality technique, the dual characterization of the optimal control is derived by the optimality system (so-called stochastic Hamilton system), which turns out to be a linear fully coupled forward-backward stochastic differential equation with jumps. Using a decoupling technique, the connection between the stochastic Hamilton system and the associated Riccati equation is established. As a result, the state feedback representation is obtained for the optimal control. As the coefficients for the LQ problem are random, here, the associated Riccati equation is a highly nonlinear backward stochastic differential equation (BSDE) with jumps, where the generator depends on the unknown variables K, L, and H in a quadratic way (see (5.9) herein). For the case where the generator is bounded and is linearly dependent on the unknown martingale terms L and H, the existence and uniqueness of the solution for the associated Riccati equation are established by Bellman's principle of quasi-linearization.     

Robust Reliable Control for Uncertain Time-Delay Systems with IQC Performance

A robust reliable control with integral quadratic constraint (IQC) performance for a class of uncertain systems with state and input delays is considered in this paper. Two classes of failure situations for sensor or actuator are studied. In the first class, a delay-dependent criterion for time-delay systems without perturbations is proposed to design the reliable control with IQC performance. Next, a criterion for uncertain time-delay systems with parameter uncertainties is obtained via simple derivations. The linear matrix inequality (LMI) approach is used to design a robust reliable state feedback control with IQC performance. In the second class, a reliable control with IQC performance is also provided from he previous method. A numerical example is given to illustrate the effectiveness of the procedure. The research reported here was supported by the National Science Council of Taiwan, ROC under Grant NSC 95-2221-E-022-019.     

On State Feedback Stabilization of Singular Systems with Random Abrupt Changes

This paper deals with the class of continuous-time singular linear systems with random abrupt changes. The state feedback stabilization and its robustness for this class of systems with norm-bounded uncertainties are tackled. Sufficient conditions for designing either a stabilizing controller or a robust stabilizing controller are developed in the LMI setting. The developed sufficient conditions are used to synthesize the state feedback controller that guarantees that either the nominal system or the uncertain system is piecewise regular, impulse free and stochastically stable or robust stochastically stable. The research of this author was supported by NSERC, Grant RGPIN36444-02.     

Stochastic Stability Analysis for Switched Genetic Regulatory Networks with Interval Time-Varying Delays Based on Average Dwell Time Approach

In this article, the problem of stochastic stability analysis for switched stochastic genetic regulatory networks with interval time-varying delays based on average dwell time approach is investigated. By constructing the piecewise Lyapunov-Krasovskii functional, delay-dependent stability conditions are derived by using free-weighting matrix and convex combination approach. The derived stability conditions are expressed in terms of linear matrix inequalities which can be easily solved by using the MATLAB LMI control toolbox. Finally, numerical examples are provided to demonstrate the effectiveness and less conservativeness of the proposed theoretical results.     

Ergodic BSDE with unbounded and multiplicative underlying diffusion and application to large time behaviour of viscosity solution of HJB equation

We study ergodic backward stochastic differential equations (EBSDEs), for which the underlying diffusion is assumed to be multiplicative and of linear growth. The fact that the forward process has an unbounded diffusion is balanced with an assumption of weak dissipativity for its drift. Moreover, the forward equation is assumed to be non-degenerate. We study the existence and uniqueness of EBSDEs and we apply our results to an ergodic optimal control problem. In particular, we show the large time behaviour of viscosity solution of Hamilton–Jacobi–Bellman equation with an exponential rate of convergence when the underlying diffusion is multiplicative and unbounded.