A new two‐phase structure‐preserving doubling algorithm for critically singular M‐matrix algebraic Riccati equations

Among numerous iterative methods for solving the minimal nonnegative solution of an M‐matrix algebraic Riccati equation, the structure‐preserving doubling algorithm (SDA) stands out owing to its overall efficiency as well as accuracy. SDA is globally convergent and its convergence is quadratic, except for the critical case for which it converges linearly with the linear rate 1/2. In this paper, we first undertake a delineatory convergence analysis that reveals that the approximations by SDA can be decomposed into two components: the stable component that converges quadratically and the rank‐one component that converges linearly with the linear rate 1/2. Our analysis also shows that as soon as the stable component is fully converged, the rank‐one component can be accurately recovered. We then propose an efficient hybrid method, called the two‐phase SDA, for which the SDA iteration is stopped as soon as it is determined that the stable component is fully converged. Therefore, this two‐phase SDA saves those SDA iterative steps that previously have to have for the rank‐one component to be computed accurately, and thus essentially, it can be regarded as a quadratically convergent method. Numerical results confirm our analysis and demonstrate the efficiency of the new two‐phase SDA. Copyright © 2015 John Wiley & Sons, Ltd.     

Asymptotic Expansions and a New Numerical Algorithm of the Algebraic Riccati Equation for Multiparameter Singularly Perturbed Systems

In this paper we study a continuous-time multiparameter algebraic Riccati equation (MARE) with an indefinite sign quadratic term. The existence of a unique and bounded solution of the MARE is newly established. We show that the Kleinman algorithm can be used to solve the sign indefinite MARE. The proof of the convergence and the existence of the unique solution of the Kleinman algorithm is done by using the Newton-Kantorovich theorem. Furthermore, we present new algorithms for solving the generalized multiparameter algebraic Lyapunov equation (GMALE) by means of the fixed-point algorithm.     

Proper deflating subspaces: properties,algorithms and applications

An algorithm for computing proper deflating subspaces with specified spectrum for an arbitrary matrix pencil is presented. The method uses refined algorithms for computing the generalized Schur form of a matrix pencil and enlightens the connection that exists between reducing and proper deflating subspaces. The proposed algorithm can be applied for computing the stabilizing solution of the generalized algebraic Riccati equation, a recently introduced concept which extends the usual algebraic Riccati equation.     

On algebraic Riccati equations associated with M-matrices

We consider the algebraic Riccati equation for which the four coefficient matrices form an M-matrix K. When K is a nonsingular M-matrix or an irreducible singular M-matrix, the Riccati equation is known to have a minimal nonnegative solution and several efficient methods are available to find this solution. In this paper we are mainly interested in the case where K is a reducible singular M-matrix. Under a regularity assumption on the M-matrix K, we show that the Riccati equation still has a minimal nonnegative solution. We also study the properties of this particular solution and explain how the solution can be found by existing methods.     

Linearly degenerate Hamiltonian PDEs and a new class of solutions to the WDVV associativity equations

We define a new class of solutions to the WDVV associativity equations. This class is determined by the property that one of the commuting PDEs associated with such a WDVV solution is linearly degenerate. We reduce the problem of classifying such solutions of the WDVV equations to the particular case of the so-called algebraic Riccati equation and, in this way, arrive at a complete classification of irreducible solutions.     

Iterative Methods for a Linearly Perturbed Algebraic Matrix Riccati Equation Arising in Stochastic Control

We start with a discussion of coupled algebraic Riccati equations arising in the study of linear-quadratic optimal control problems for Markov jump linear systems. Under suitable assumptions, this system of equations has a unique positive semidefinite solution, which is the solution of practical interest. The coupled equations can be rewritten as a single linearly perturbed matrix Riccati equation with special structures. We study the linearly perturbed Riccati equation in a more general setting and obtain a class of iterative methods from different splittings of a positive operator involved in the Riccati equation. We prove some special properties of the sequences generated by these methods and determine and compare the convergence rates of these methods. Our results are then applied to the coupled Riccati equations of jump linear systems. We obtain linear convergence of the Lyapunov iteration and the modified Lyapunov iteration, and confirm that the modified Lyapunov iteration indeed has faster convergence than the original Lyapunov iteration.     

A structure-preserving doubling algorithm for nonsymmetric algebraic Riccati equation

In this paper, we propose a structure-preserving doubling algorithm (SDA) for the computation of the minimal nonnegative solution to the nonsymmetric algebraic Riccati equation (NARE), based on the techniques developed for the symmetric cases. This method allows the simultaneous approximation to the minimal nonnegative solutions of the NARE and its dual equation, requiring only the solutions to two linear systems and several matrix multiplications per iteration. Similar to Newton's method and the fixed-point iteration methods for solving NAREs, we also establish global convergence for SDA under suitable conditions, using only elementary matrix theory. We show that sequences of matrices generated by SDA are monotonically increasing and quadratically convergent to the minimal nonnegative solutions of the NARE and its dual equation. Numerical experiments show that the SDA algorithm is feasible and effective, and outperforms Newton's iteration and the fixed-point iteration methods. This research was supported in part by RFDP (20030001103) & NSFC (10571007) of China and the National Center for Theoretical Sciences in Taiwan. This author's research was supported by NSFC grant 1057 1007 and RFDP grant 200300001103 of China.     

Monotone convergence of Newton-like methods for M-matrix algebraic Riccati equations

For the algebraic Riccati equation whose four coefficient matrices form a nonsingular M-matrix or an irreducible singular M-matrix K, the minimal nonnegative solution can be found by Newton’s method and the doubling algorithm. When the two diagonal blocks of the matrix K have both large and small diagonal entries, the doubling algorithm often requires many more iterations than Newton’s method. In those cases, Newton’s method may be more efficient than the doubling algorithm. This has motivated us to study Newton-like methods that have higher-order convergence and are not much more expensive each iteration. We find that the Chebyshev method of order three and a two-step modified Chebyshev method of order four can be more efficient than Newton’s method. For the Riccati equation, these two Newton-like methods are actually special cases of the Newton–Shamanskii method. We show that, starting with zero initial guess or some other suitable initial guess, the sequence generated by the Newton–Shamanskii method converges monotonically to the minimal nonnegative solution.We also explain that the Newton-like methods can be used to great advantage when solving some Riccati equations involving a parameter.     

A New Approach to Linearly Perturbed Riccati Equations Arising in Stochastic Control

In this paper a linearly perturbed version of the well-known matrix Riccati equations which arise in certain stochastic optimal control problems is studied. Via the concepts of mean square stabilizability and mean square detectability we improve previous results on both the convergence properties of the linearly perturbed Riccati differential equation and the solutions of the linearly perturbed algebraic Riccati equation. Furthermore, our approach unifies, in some way, the study for this class of Riccati equations with the one for classical theory, by eliminating a certain inconvenient assumption used in previous works (e.g., [10] and [26]). The results are derived under relatively weaker assumptions and include, inter alia, the following: (a) An extension of Theorem 4.1 of [26] to handle systems not necessarily observable. (b) The existence of a strong solution, subject only to the mean square stabilizability assumption. (c) Conditions for the existence and uniqueness of stabilizing solutions for systems not necessarily detectable. (d) Conditions for the existence and uniqueness of mean square stabilizing solutions instead of just stabilizing. (e) Relaxing the assumptions for convergence of the solution of the linearly perturbed Riccati differential equation and deriving new convergence results for systems not necessarily observable. Accepted 30 July 1996     

Alternately linearized implicit iteration methods for the minimal nonnegative solutions of the nonsymmetric algebraic Riccati equations

For the non‐symmetric algebraic Riccati equations, we establish a class of alternately linearized implicit (ALI) iteration methods for computing its minimal non‐negative solutions by technical combination of alternate splitting and successive approximating of the algebraic Riccati operators. These methods include one iteration parameter, and suitable choices of this parameter may result in fast convergent iteration methods. Under suitable conditions, we prove the monotone convergence and estimate the asymptotic convergence factor of the ALI iteration matrix sequences. Numerical experiments show that the ALI iteration methods are feasible and effective, and can outperform the Newton iteration method and the fixed‐point iteration methods. Besides, we further generalize the known fixed‐point iterations, obtaining an extensive class of relaxed splitting iteration methods for solving the non‐symmetric algebraic Riccati equations. Copyright © 2006 John Wiley & Sons, Ltd.     

A reduction technique for discrete generalized algebraic and difference Riccati equations

This paper proposes a reduction technique for the generalized Riccati difference equation arising in optimal control and optimal filtering. This technique relies on a study on the generalized discrete algebraic Riccati equation. In particular, an analysis on the eigenstructure of the corresponding extended symplectic pencil enables to identify a subspace in which all the solutions of the generalized discrete algebraic Riccati equation are coincident. This subspace is the key to derive a decomposition technique for the generalized Riccati difference equation. This decomposition isolates a “nilpotent” part, which converges to a steady-state solution in a finite number of steps, from another part that can be computed by iterating a reduced-order generalized Riccati difference equation.     

On deflation and singular symmetric positive semi-definite matrices

For various applications, it is well-known that the deflated ICCG is an efficient method for solving linear systems with invertible coefficient matrix. We propose two equivalent variants of this deflated ICCG which can also solve linear systems with singular coefficient matrix, arising from discretization of the discontinuous Poisson equation with Neumann boundary conditions. It is demonstrated both theoretically and numerically that the resulting methods accelerate the convergence of the iterative process.     

A subspace shift technique for nonsymmetric algebraic Riccati equations associated with an M‐matrix

The worst situation in computing the minimal nonnegative solution of a nonsymmetric algebraic Riccati equation associated with an M‐matrix occurs when the corresponding linearizing matrix has two very small eigenvalues, one with positive and one with negative real part. When both eigenvalues are exactly zero, the problem is called critical or null recurrent. Although in this case the problem is ill‐conditioned and the convergence of the algorithms based on matrix iterations is slow, there exist some techniques to remove the singularity and transform the problem to a well‐behaved one. Ill‐conditioning and slow convergence appear also in close‐to‐critical problems, but when none of the eigenvalues is exactly zero, the techniques used for the critical case cannot be applied. In this paper, we introduce a new method to accelerate the convergence properties of the iterations also in close‐to‐critical cases, by working on the invariant subspace associated with the problematic eigenvalues as a whole. We present numerical experiments that confirm the efficiency of the new method.Copyright © 2012 John Wiley & Sons, Ltd.     

On the convergence of inexact Newton methods for discrete-time algebraic Riccati equations

In this paper, we present a convergence analysis of the inexact Newton method for solving Discrete-time algebraic Riccati equations (DAREs) for large and sparse systems. The inexact Newton method requires, at each iteration, the solution of a symmetric Stein matrix equation. These linear matrix equations are solved approximatively by the alternating directions implicit (ADI) or Smith?s methods. We give some new matrix identities that will allow us to derive new theoretical convergence results for the obtained inexact Newton sequences. We show that under some necessary conditions the approximate solutions satisfy some desired properties such as the d-stability. The theoretical results developed in this paper are an extension to the discrete case of the analysis performed by Feitzinger et al. (2009) [8] for the continuous-time algebraic Riccati equations. In the last section, we give some numerical experiments.     

A modified Newton method for solving non-symmetric algebraic Riccati equations arising in transport theory

Liang Bao ^{The non-symmetric algebraic Riccati equation arising in transporttheory can be rewritten as a vector equation and the minimalpositive solution of the non-symmetric algebraic Riccati equationcan be obtained by solving the vector equation. In this paper,we apply the modified Newton method to solve the vector equation.Some convergence results are presented. Numerical tests showthat the modified Newton method is feasible and effective, andoutperforms the Newton method.}     

Algebraic multigrid methods for Laplacians of graphs

Classical algebraic multigrid theory relies on the fact that the system matrix is positive definite. We extend this theory to cover the positive semidefinite case as well, by formulating semiconvergence results for these singular systems. For the class of irreducible diagonal dominant singular M-matrices we show that the requirements of the developed theory hold and that the coarse level systems are still of the same class, if the C/F-splitting is good enough. An important example for matrices that are irreducible diagonal dominant M-matrices are Laplacians of graphs. Recent shape optimizing methods for graph partitioning require to solve singular linear systems involving these Laplacians. We present convergence results as well as experimental results for numerous graphs arising from finite element discretizations with up to 10⁶ vertices.     

A new equation for the linear regulator problem

In this article, a new equation is derived for the optimal feedback gain matrix characterizing the solution of the standard linear regulator problem. It will be seen that, in contrast to the usual algebraic Riccati equation which requires the solution ofn(n + 1)/2 quadratically nonlinear algebraic equations, the new equation requires the solution of onlynm such equations, wherem is the number of system input terminals andn is the dimension of the state vector of the system. Utilizing the new equation, results are presented for the inverse problem of linear control theory.     

Global adapted solution of one-dimensional backward stochastic Riccati equations,with application to the mean–variance hedging

Backward stochastic Riccati equations are motivated by the solution of general linear quadratic optimal stochastic control problems with random coefficients, and the solution has been open in the general case. One distinguishing difficult feature is that the drift contains a quadratic term of the second unknown variable. In this paper, we obtain the global existence and uniqueness result for a general one-dimensional backward stochastic Riccati equation. This solves the one-dimensional case of Bismut–Peng's problem which was initially proposed by Bismut (Lecture Notes in Math. 649 (1978) 180). We use an approximation technique by constructing a sequence of monotone drifts and then passing to the limit. We make full use of the special structure of the underlying Riccati equation. The singular case is also discussed. Finally, the above results are applied to solve the mean–variance hedging problem with general random market conditions.     

Computation of matrix functions with deflated restarting

A deflated restarting Krylov subspace method for approximating a function of a matrix times a vector is proposed. In contrast to other Krylov subspace methods, the performance of the method in this paper is better. We further show that the deflating algorithm inherits the superlinear convergence property of its unrestarted counterpart for the entire function and present the results of numerical experiments.     

Numerical approximation of the LQR problem in a strongly damped wave equation

The aim of this work is to obtain optimal-order error estimates for the LQR (Linear-quadratic regulator) problem in a strongly damped 1-D wave equation. We consider a finite element discretization of the system dynamics and a control law constant in the spatial dimension, which is studied in both point and distributed case. To solve the LQR problem, we seek a feedback control which depends on the solution of an algebraic Riccati equation. Optimal error estimates are proved in the framework of the approximation theory for control of infinite-dimensional systems. Finally, numerical results are presented to illustrate that the optimal rates of convergence are achieved.