Solution of the matrix Riccati equation for the linear quadratic control problems

This paper is concerned with the solution of the matrix Riccati differential equation with a terminal boundary condition. The solution of the matrix Riccati equation is given by using the solution of the algebraic form of the Riccati equation. An illustrative example for the proposed method is given.     

Fourier expansion based recursive algorithms for periodic Riccati and Lyapunov matrix differential equations

Combining Fourier series expansion with recursive matrix formulas, new reliable algorithms to compute the periodic, non-negative, definite stabilizing solutions of the periodic Riccati and Lyapunov matrix differential equations are proposed in this paper. First, periodic coefficients are expanded in terms of Fourier series to solve the time-varying periodic Riccati differential equation, and the state transition matrix of the associated Hamiltonian system is evaluated precisely with sine and cosine series. By introducing the Riccati transformation method, recursive matrix formulas are derived to solve the periodic Riccati differential equation, which is composed of four blocks of the state transition matrix. Second, two numerical sub-methods for solving Lyapunov differential equations with time-varying periodic coefficients are proposed, both based on Fourier series expansion and the recursive matrix formulas. The former algorithm is a dimension expanding method, and the latter one uses the solutions of the homogeneous periodic Riccati differential equations. Finally, the efficiency and reliability of the proposed algorithms are demonstrated by four numerical examples.     

A computational solution for a Matrix Riccati differential equation

Summary This paper is concerned with the solution of the finite time Riccati equation. The solution to the Riccati equation is given in terms of the partition of the transition matrix. Matrix differential equations for the partition of the transition matrix are derived and are solved using computational methods. Examples illustrating the method are presented and the computational algorithms are given.     

一类Riccati矩阵方程广义自反解的双迭代算法

本文研究了一类Riccati矩阵方程广义自反解的数值计算问题.利用牛顿算法将Riccati矩阵方程的广义自反解问题转化为线性矩阵方程的广义自反解或者广义自反最小二乘解问题,再利用修正共轭梯度法计算后一问题,获得了求Riccati矩阵方程的广义自反解的双迭代算法.拓宽了求解非线性矩阵方程的迭代算法.数值算例表明双迭代算法是有效的.     

Sensitivity analysis of the differential matrix Riccati equation based on the associated linear differential system

Perturbation bounds are given for the solution of the nth order differential matrix Riccati equation using the associated linear 2nth order differential system. The new bounds are alternative to those existing in the literature and are sharper in some cases. This revised version was published online in June 2006 with corrections to the Cover Date.     

A generalized structured doubling algorithm for the numerical solution of linear quadratic optimal control problems

We propose a generalization of the structured doubling algorithm to compute invariant subspaces of structured matrix pencils that arise in the context of solving linear quadratic optimal control problems. The new algorithm is designed to attain better accuracy when the classical Riccati equation approach for the solution of the optimal control problem is not well suited because the stable and unstable invariant subspaces are not well separated (because of eigenvalues near or on the imaginary axis) or in the case when the Riccati solution does not exist at all. We analyze the convergence of the method and compare the new method with the classical structured doubling algorithm as well as some structured QR methods. Copyright © 2012 John Wiley & Sons, Ltd.     

Exact slow-fast decomposition of the singularly perturbed matrix differential Riccati equation

In this paper the Hamiltonian matrix formulation of the Riccati equation is used to derive the reduced-order pure-slow and pure-fast matrix differential Riccati equations of singularly perturbed systems. These pure-slow and pure-fast matrix differential Riccati equations are obtained by decoupling the singularly perturbed matrix differential Riccati equation of dimension n₁+n₂ into the pure-slow regular matrix differential Riccati equation of dimension n₁ and the pure-fast stiff matrix differential Riccati equation of dimension n₂. A formula is derived that produces the solution of the original singularly perturbed matrix differential Riccati equation in terms of solutions of the pure-slow and pure-fast reduced-order matrix differential Riccati equations and solutions of two reduced-order initial value problems. In addition to its theoretical importance, the main result of this paper can also be used to implement optimal filtering and control schemes for singularly perturbed linear time-invariant systems independently in pure-slow and pure-fast time scales.     

Solving Differential Matrix Equations using Parareal

Differential matrix equations appear in many applications like optimal control of partial differential equations, balanced truncation model order reduction of linear time varying systems and many more. Here, we will focus on differential Riccati equations (DRE). Solving such matrix-valued ordinary differential equations (ODE) is a highly time consuming process. We present a Parareal based algorithm applied to Rosenbrock methods for the solution of the matrix-valued differential Riccati equations. Considering problems of moderate size, direct matrix equation solvers for the solution of the algebraic Lyapunov equations arising inside the time intgration methods are used. (© 2016 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Error bounds for numerical solutions of ordinary differential equations

Summary An a posteriori error bound, for an approximate solution of a system of ordinary differential equations, is derived as the solution of a Riccati equation. The coefficients of the Riccati equation depend on an eigenvalue of a matrix related to a Jacobian matrix, on a Lipschitz constant for the Jacobian matrix, and on the approximation defect. An upper bound is computable as the formal solution of a sequence of Riccati equations with constant coefficients. This upper bound may sometimes be used to control step length in a numerical method.     

The Inverse Problem Method on the Half-Line and a Nested System of Riccati Equations

A mixed problem for the nonlinear Bogoyavlenskii system on the half-line is studied by the inverse problem method. The solution of the mixed problem is reduced to the solution of the inverse spectral problem of recovering a forth-order differential operator on the half-line from the Weyl matrix. We derive evolution equations for the elements of the Weyl matrix and give an algorithm for the solution of the mixed problem. Evolution equations of the elements of the Weyl matrix are nonlinear. It is shown that they can be reduced to a nested system of three successively solvable matrix Riccati equations.     

The matrix sign function and computations in systems

The matrix sign function has several interesting properties which form the basis of new solution algorithms for problems which occur frequently in systems and control theory applications. Presented in this paper are new algorithms, based on the matrix sign function, for the solution of algebraic matrix Riccati equations, Lyapunov equations, coupled Riccati equations, spectral factorization, matrix square roots, pole assignment, and the algebraic eigenvalue-eigenvector problem. Examples of the application of each algorithm are also presented.     

Smooth factorizations of matrix valued functions and their derivatives

Summary In this paper we study the numerical factorization of matrix valued functions in order to apply them in the numerical solution of differential algebraic equations with time varying coefficients. The main difficulty is to obtain smoothness of the factors and a numerically accessible form of their derivatives. We show how this can be achieved without numerical differentiation if the derivative of the given matrix valued function is known. These results are then applied in the numerical solution of differential algebraic Riccati equations. For this a numerical algorithm is given and its properties are demonstrated by a numerical example.     

Construction and Structure Properties of Solutions of a Periodic Boundary Value Problem for a Generalization of the Matrix Lyapunov and Riccati Equations

We obtain constructive sufficient conditions for the unique solvability of a periodic boundary value problem for a matrix differential equation that generalizes the Lyapunov and Riccati equations, develop an algorithm for constructing the solution of this equation, estimate the domain where the solution is localized, and study the structural properties of the solution.     

Proper deflating subspaces: properties,algorithms and applications

An algorithm for computing proper deflating subspaces with specified spectrum for an arbitrary matrix pencil is presented. The method uses refined algorithms for computing the generalized Schur form of a matrix pencil and enlightens the connection that exists between reducing and proper deflating subspaces. The proposed algorithm can be applied for computing the stabilizing solution of the generalized algebraic Riccati equation, a recently introduced concept which extends the usual algebraic Riccati equation.     

Explicit solutions of Riccati equations appearing in differential games

In this paper an explicit closed form solution of Riccati differential matrix equations appearing in games theory is given.     

Riccati微分方程特解新求法的研究

通过对一般Riccati方程进行初等变换,使之变为特殊的Riccati方程,然后利用公式、观察实验,或利用二阶微分方程的特解,或利用一阶微分方程组的特解等方法,求得这些Riccati方程的特解.     

一类新的线性二次随机最优控制器的设计

给出一类正倒向随机微分方程解的存在唯一性结果,应用这个结果研究了一类新的推广的随机线性二次最优控制器的设计问题,得到了由正倒向随机微分方程解所表示的唯一最优控制器的显式结构;在推广的Riccati方程系统基础上,得到最优控制器精确的线性反馈形式.最后,给出了随机线性二次最优控制器的设计算法.     

Stochastic independent modal-space control of distributed-parameter systems

A method is presented for solving time-varying independent modal-space Kalman filter equations in terms of 2×2 transition matrices, rather than in terms of the more commonly used 4×4 transition matrix solution technique. The basic method consists of replacing the well-known product form solution for the differential matrix Riccati equation with an alternate solution form which consists of a steady-state plus transient term.     

Optimal control for stochastic linear quadratic singular periodic neuro Takagi–Sugeno (T-S) fuzzy system with singular cost using ant colony programming

In this paper, optimal control for stochastic linear singular periodic neuro Takagi–Sugeno (T–S) fuzzy system with singular cost is obtained using ant colony programming (ACP). To obtain the optimal control, the solution of matrix Riccati differential equation (MRDE) is computed by solving differential algebraic equation (DAE) using a novel and nontraditional ACP approach. ACP solution is equivalent or very close to the exact solution of the problem. The ACP solution is compared with the solution of traditional Runge Kutta (RK) method. An illustrative numerical example is presented for the proposed method.     

Analysis of the second order matrix Riccati equations

This paper is concerned with periodic solutions of 2x2 autonomous matrix Riccati differential equations. The author had given a necessary and sufficient condition for periodicity of solutions of matrix Riccati differential equations of general type and some examples. However, it is not so simple to verify whether this condition is satisfied or not. So this paper simplifies the verification by restricting to special cases. In particular, we show that there may exist periodic solutions for any case where the coefficient matrix of the linear part of the equation has complex eigenvalues if we choose an initial value suitably. Many examples having a periodic solution are also shown by systematic analysis; such examples are seldom seen in the literature.