带有交叉项的离散不定随机线性二次控制问题

研究性能指标带有交叉项的离散时间不定随机线性二次(LQ)控制问题，允许权矩阵是不定的。引入一个广义差分Riccati方程，证明了此方程的可解性是LQ问题存在最优控制的一个充分条件，并用方程的解给出了最优控制。推广了[1]的结果。     

General Linear Quadratic Optimal Stochastic Control Problem Driven by a Brownian Motion and a Poisson Random Martingale Measure with Random Coefficients

In this article, we consider a linear-quadratic optimal control problem (LQ problem) for a controlled linear stochastic differential equation driven by a multidimensional Browinan motion and a Poisson random martingale measure in the general case, where the coefficients are allowed to be predictable processes or random matrices. By the duality technique, the dual characterization of the optimal control is derived by the optimality system (so-called stochastic Hamilton system), which turns out to be a linear fully coupled forward-backward stochastic differential equation with jumps. Using a decoupling technique, the connection between the stochastic Hamilton system and the associated Riccati equation is established. As a result, the state feedback representation is obtained for the optimal control. As the coefficients for the LQ problem are random, here, the associated Riccati equation is a highly nonlinear backward stochastic differential equation (BSDE) with jumps, where the generator depends on the unknown variables K, L, and H in a quadratic way (see (5.9) herein). For the case where the generator is bounded and is linearly dependent on the unknown martingale terms L and H, the existence and uniqueness of the solution for the associated Riccati equation are established by Bellman's principle of quasi-linearization.     

Stochastic Linear Quadratic Optimal Control Problems

This paper is concerned with the stochastic linear quadratic optimal control problem (LQ problem, for short) for which the coefficients are allowed to be random and the cost functional is allowed to have a negative weight on the square of the control variable. Some intrinsic relations among the LQ problem, the stochastic maximum principle, and the (linear) forward—backward stochastic differential equations are established. Some results involving Riccati equation are discussed as well. Accepted 15 May 2000. Online publication 1 December 2000     

伊藤-泊松型随机微分方程的线性二次控制

本文研究伊藤-泊松型随机微分方程的线性二次控制问题,利用动态规划方法、伊藤公式等技巧,通过解HJB方程,我们得到了随机Riccati方程及另外两个微分方程,求出控制变量,解决了线性二次最优控制最优问题.     

Indefinite stochastic LQ control with cross term via semidefinite programming

An indefinite stochastic linear-quadratic (LQ) optimal control problem with cross term over an infinite time horizon is studied, allowing the weighting matrices to be indefinite. A systematic approach to the problem based on semidefinite programming (SDP) and related duality analysis is developed. Several implication relations among the SDP complementary duality, the existence of the solution to the generalized Riccati equation and the optimality of LQ problem are discussed. Based on these relations, a numerical procedure that provides a thorough treatment of the LQ problem via primal-dual SDP is given: it identifies a stabilizing optimal feedback control or determines the problem has no optimal solution. An example is provided to illustrate the results obtained.     

Indefinite LQ optimal control with cross term for discrete‐time uncertain systems

Recently, there has been an increasing interest in the study on uncertain optimal control problems. In this paper, a linear quadratic (LQ) optimal control with cross term for discrete‐time uncertain systems is considered, whereas the weighting matrices in the cost function are allowed to be indefinite. Firstly, a recurrence equation for the problem is presented based on Bellman's principle of optimality in dynamic programming. Then, a necessary condition for the existence of an optimal linear state feedback control of the indefinite LQ problem is given by the recurrence equation. Moreover, a sufficient condition of well‐posedness for the indefinite LQ problem is presented by introducing a linear matrix inequality (LMI) condition. Furthermore, it is shown that the well‐posedness of the indefinite LQ problem, the solvability of the indefinite LQ problem, the LMI condition, and the solvability of the constrained difference equation are equivalent to each other. Finally, an example is presented to illustrate the results obtained.     

A separation theorem for stochastic singular linear quadratic control problem with partial information

In this paper, we provide a separation theorem for the singular linear quadratic (LQ) control problem of Itô-type linear systems in the case of the state being partially observable. Above all, the Kalman-Bucy filtering of the dynamics is given by means of Girsanov transformation, by which the suboptimal feedback control of the LQ problem is determined. Furthermore, it is shown that the well-posedness of the LQ problem is equivalent to the solvability of a generalized differential Riccati equation (GDRE).     

精细积分区段混合能矩阵的一种计算方法

根据结构力学与最优控制的模拟理论中阐述的各混合能矩阵的力学意义,介绍了一种利用微分方程组的状态转移矩阵计算区段混合能矩阵的方法,其计算结果与泰勒级数展开法是一致的。     

STOCHASTIC LINEAR QUADRATIC OPTIMAL CONTROL PROBLEMS WITH RANDOM COEFFICIENTS

61. IntroductionLet (fi, F, P, {R}tZo) be a complete filtered probability space on which a standard onedimensional Brownian motion w(') is defined such that {R}tZo is the natural filtrationgenerated by w(.), augmented by all the p-null sets in i. We consider the following stateequationwhere T E T[0, TI, the set of all {R}tZo-stopping times taking values in [0, T], (E sigLlt (fi;IR"); A, B, C, D are matrix-valued {R}tZo-adapted bounded processes. In the above, u(.) EU[T, T]gLI(T, T…     

Elliptic partial differential equation and optimal control

The theory of optimal control and the semianalytical method of elliptic partial differential equation (PDE) in a prismatic domain are mutually simulated issues. The simulation of discrete-time linear quadratic (LQ) control with the substructural chain problem in static structural analysis is given first. From the minimum potential energy variational principle of substructural chain, the generalized variational principle with two kinds of variables and the dual equations are derived. The simulation relation is then recognized by comparing the variational principle and dual equations of the LQ control theory. The simulation between elliptic PDE in the prismatic domain and continuous-time LQ control is established in the same way, and the interval energy is naturally introduced, as in the case of substructural chain. The assembling and condensation equations can help one to derive the differential equations of the submatrices of potential energy and mixed energy. The well known Riccati equation is one of them. The interval assembling and condensation algorithm can be used to solve the Riccati equation. Some numerical examples are given to illustrate the method.     

随机线性二次最优控制:从离散到连续时间模型

在一般情形下,分析了离散时间LQ问题与连续时间情形两者之间的自然联系.首先回顾了连续时间和离散时间随机LQ问题及对应Riccati微分/差分方程的相关结论.接下来在假设Riccati微分方程有解的前提下,证明了离散化步长足够小时,Riccati差分方程有解.然后针对连续和离散时间模型,采用配对问题最优控制的反馈形式,分别构造了一个辅助反馈控制,并证明该控制可驱使对应模型的性能指标逼近于配对问题的值函数,以此得到了关于两个模型之间联系的初步结论.最后藉由前述结论以及控制问题的特性,揭晓了连续时间和离散时间模型之间的自然联系,并给出了Riccati差分方程和微分方程的解之间的误差估计.由此联系,可构造相应离散系统和LQ问题,以适当的阶估计连续时间LQ问题的解,抑或为离散时间模型构造一个近似最优控制.无论哪种思路,都旨在降低直接求解原问题的难度和复杂性.     

Quadratic optimal control of stable well-posed linear systems

We consider the infinite horizon quadratic cost minimization problem for a stable time-invariant well-posed linear system in the sense of Salamon and Weiss, and show that it can be reduced to a spectral factorization problem in the control space. More precisely, we show that the optimal solution of the quadratic cost minimization problem is of static state feedback type if and only if a certain spectral factorization problem has a solution. If both the system and the spectral factor are regular, then the feedback operator can be expressed in terms of the Riccati operator, and the Riccati operator is a positive self-adjoint solution of an algebraic Riccati equation. This Riccati equation is similar to the usual algebraic Riccati equation, but one of its coefficients varies depending on the subspace in which the equation is posed. Similar results are true for unstable systems, as we have proved elsewhere.

     

Indefinite stochastic linear-quadratic optimal control problems with random jumps and related stochastic Riccati equations

We discuss the stochastic linear-quadratic (LQ) optimal control problem with Poisson processes under the indefinite case. Based on the wellposedness of the LQ problem, the main idea is expressed by the definition of relax compensator that extends the stochastic Hamiltonian system and stochastic Riccati equation with Poisson processes (SREP) from the positive definite case to the indefinite case. We mainly study the existence and uniqueness of the solution for the stochastic Hamiltonian system and obtain the optimal control with open-loop form. Then, we further investigate the existence and uniqueness of the solution for SREP in some special case and obtain the optimal control in close-loop form.     

LQG量测反馈最优控制的精细积分

对于线性二次型高斯(LQG)量测反馈最优控制问题,提出了精细积分解法。根据分离性原理,LQG控制问题可以分成为最优状态反馈控制问题以及最优状态估计问题,即:离线计算的两套黎卡提微分方程的求解以及状态向量的时变微分方程的在线积分解。该算法不仅适用于求解二点边值问题及其相应的黎卡提微分方程,也适用于求解状态估计的时变微分方程。精细积分高精度的特点,对控制和估计都是有利的。数值算例表明了算法的高精度及有效性。     

Stability analysis and optimal control of stochastic singular systems

In this paper, problems of stability and optimal control for a class of stochastic singular systems are studied. Firstly, under some appropriate assumptions, some new results about mean-square admissibility are developed and the corresponding LMI sufficient condition is given. Secondly, finite-time horizon and infinite-time horizon linear quadratic (LQ) control problems for the stochastic singular system are investigated, in which the coefficients are allowed to be random in control input and quadratic criterion. Some results involving new stochastic generalized Riccati equation are discussed as well. Finally, the proposed LQ control model for stochastic singular systems provides an appropriate and effective framework to study the portfolio selection problem in light of the recent development on general stochastic LQ problems.     

Deterministic optimal control,given only a partial observation of the initial state

The deterministic linear-system, quadratic-cost optimal control problem is considered when the only state information available is a partial linear observation of the initial statex ₀. Thus, it is only known that the initial condition belongs to a particular linear variety. A control function is found which is optimal, in the sense (roughly) that (i) it can be computed using available information aboutx ₀ and (ii) no other control function which can be found using that information gives lower cost than it does for every initial condition that could have given rise to the information. The optimal control can be found easily from the conventional Riccati equation of optimal control. Applications are considered in the presence of unknown exponential disturbances and to the case with a sequence of partial state observations.     

线性时变系统二次最优控制问题的保辛近似求解

状态空间的最优控制体系是保守的,其近似算法应当保辛．提出了基于分段常值精细积分方法的保辛摄动近似方法,在同一框架下求解了线性时变LQ最优控制中的计算问题,即变系数矩阵Riccati方程和状态反馈方程．该算法是保辛的,具有很好的数值稳定性和精度．算例验证了算法的有效性．     

Indefinite Stochastic Linear Quadratic Control with Markovian Jumps in Infinite Time Horizon

This paper studies a stochastic linear quadratic (LQ) control problem in the infinite time horizon with Markovian jumps in parameter values. In contrast to the deterministic case, the cost weighting matrices of the state and control are allowed to be indinifite here. When the generator matrix of the jump process – which is assumed to be a Markov chain – is known and time-invariant, the well-posedness of the indefinite stochastic LQ problem is shown to be equivalent to the solvability of a system of coupled generalized algebraic Riccati equations (CGAREs) that involves equality and inequality constraints. To analyze the CGAREs, linear matrix inequalities (LMIs) are utilized, and the equivalence between the feasibility of the LMIs and the solvability of the CGAREs is established. Finally, an LMI-based algorithm is devised to slove the CGAREs via a semidefinite programming, and numerical results are presented to illustrate the proposed algorithm.     

Optimal State Feedback Input-Output Stabilization of Infinite-Dimensional Discrete Time-Invariant Linear Systems

We study the optimal input-output stabilization of discrete time-invariant linear systems in Hilbert spaces by state feedback. We show that a necessary and sufficient condition for this problem to be solvable is that the transfer function has a right factorization over H-infinity. A necessary and sufficient condition in terms of an (arbitrary) realization is that each state which can be reached in a finite time from the zero initial state has a finite cost. Another equivalent condition is that the control Riccati equation has a solution (in general unbounded and even non densely defined). The optimal state feedback input-output stabilization problem can then be solved explicitly in terms of the smallest solution of this control Riccati equation. We further show that after renorming the state space in terms of the solution of the control Riccati equation, the closed-loop system is not only input-output stable, but also strongly internally stable. Received: July 4, 2007. Revised: October 17, 2007.     

Hilbert空间中具无界控制的无限时区线性二次最优控制问题

本文研究了Hilbert空间中一类由解析半群支配的具无界控制的无限时区线性二次最优控制问题,其中指标中的控制项加权算子要求强制而状态项加权算子可允许为不定号.在指数能稳条件下,证明了任意的最优控制及其最优轨线必定连续,建立了正实引理作为此问题唯一可解的充要条件,并用代数Riccati方程的解给出了最优控制的闭环综合。