Iterative algorithms for solving a class of complex conjugate and transpose matrix equations

This paper is concerned with iterative solutions to a class of complex matrix equations, which include some previously investigated matrix equations as special cases. By applying the hierarchical identification principle, an iterative algorithm is constructed to solve this class of matrix equations. A sufficient condition is presented to guarantee that the proposed algorithm is convergent for an arbitrary initial matrix with a real representation of a complex matrix as tools. By using some properties of the real representation, a convergence condition that is easier to compute is also given in terms of original coefficient matrices. A numerical example is employed to illustrate the effectiveness of the proposed methods.     

基于梯度的Sylvester共轭矩阵方程的迭代解

本文提出了一种基于梯度的Sylvester共轭矩阵方程的迭代算法.通过引入一个松弛参数和采用递阶辨识原理,构造一个迭代算法求解Sylvester矩阵方程.通过应用复矩阵的实数表达以及实数表示的一些性质,收敛性分析表明在一定假设条件下,对于任意初始值,迭代方法均收敛到精确解,数值算例也表明了所给方法的有效性.     

Finite iterative algorithms for a common solution to a group of complex matrix equations

An iterative algorithm is constructed to give a common solution to a group of complex matrix equations. By using the proposed algorithm, the existence of a common solution can be determined automatically. When a common solution exists for this group of matrix equations, it is proven by using a real inner product in complex matrix spaces as a tool that a solution can be obtained within finite iteration steps for any initial values in the absence of round-off errors. The algorithm is also generalized to solve a more general case. A numerical example is given to illustrate the effectiveness of the proposed method.     

Iterative solutions to coupled Sylvester-transpose matrix equations

This note studies the iterative solutions to the coupled Sylvester-transpose matrix equation with a unique solution. By using the hierarchical identification principle, an iterative algorithm is presented for solving this class of coupled matrix equations. It is proved that the iterative solution consistently converges to the exact solution for any initial values. Meanwhile, sufficient conditions are derived to guarantee that the iterative solutions given by the proposed algorithm converge to the exact solution for any initial matrices. Finally, a numerical example is given to illustrate the efficiency of the proposed approach.     

连续Sylvester矩阵方程求解的分裂迭代算法

有效求解连续的Sylvester矩阵方程对于科学和工程计算有着重要的应用价值,因此该文提出了一种可行的分裂迭代算法.该算法的核心思想是外迭代将连续Sylvester矩阵方程的系数矩阵分裂为对称矩阵和反对称矩阵,内迭代求解复对称矩阵方程.相较于传统的分裂算法,该文所提出的分裂迭代算法有效地避免了最优迭代参数的选取,并利用了复对称方程组高效求解的特点,进而提高了算法的易实现性、易操作性.此外,从理论层面进一步证明了该分裂迭代算法的收敛性.最后,通过数值算例表明分裂迭代算法具有良好的收敛性和鲁棒性,同时也证实了分裂迭代算法的收敛性很大程度依赖于内迭代格式的选取.     

Weighted least squares solutions to general coupled Sylvester matrix equations

This paper is concerned with weighted least squares solutions to general coupled Sylvester matrix equations. Gradient based iterative algorithms are proposed to solve this problem. This type of iterative algorithm includes a wide class of iterative algorithms, and two special cases of them are studied in detail in this paper. Necessary and sufficient conditions guaranteeing the convergence of the proposed algorithms are presented. Sufficient conditions that are easy to compute are also given. The optimal step sizes such that the convergence rates of the algorithms, which are properly defined in this paper, are maximized and established. Several special cases of the weighted least squares problem, such as a least squares solution to the coupled Sylvester matrix equations problem, solutions to the general coupled Sylvester matrix equations problem, and a weighted least squares solution to the linear matrix equation problem are simultaneously solved. Several numerical examples are given to illustrate the effectiveness of the proposed algorithms.     

Finite iterative method for solving coupled Sylvester-transpose matrix equations

This paper is concerned with solutions to the so-called coupled Sylvester-transpose matrix equations, which include the generalized Sylvester matrix equation and Lyapunov matrix equation as special cases. By extending the idea of conjugate gradient method, an iterative algorithm is constructed to solve this kind of coupled matrix equations. When the considered matrix equations are consistent, for any initial matrix group, a solution group can be obtained within finite iteration steps in the absence of roundoff errors. The least Frobenius norm solution group of the coupled Sylvester-transpose matrix equations can be derived when a suitable initial matrix group is chosen. By applying the proposed algorithm, the optimal approximation solution group to a given matrix group can be obtained by finding the least Frobenius norm solution group of new general coupled matrix equations. Finally, a numerical example is given to illustrate that the algorithm is effective.     

Finite iterative solutions to coupled Sylvester-conjugate matrix equations

This paper is concerned with solutions to the so-called coupled Sylveter-conjugate matrix equations, which include the generalized Sylvester matrix equation and coupled Lyapunov matrix equation as special cases. An iterative algorithm is constructed to solve this kind of matrix equations. By using the proposed algorithm, the existence of a solution to a coupled Sylvester-conjugate matrix equation can be determined automatically. When the considered matrix equation is consistent, it is proven by using a real inner product in complex matrix spaces as a tool that a solution can be obtained within finite iteration steps for any initial values in the absence of round-off errors. Another feature of the proposed algorithm is that it can be implemented by using original coefficient matrices, and does not require to transform the coefficient matrices into any canonical forms. The algorithm is also generalized to solve a more general case. Two numerical examples are given to illustrate the effectiveness of the proposed methods.     

凸约束伪单调方程组的无导数投影算法

基于HS共轭梯度法的结构，本文在弱假设条件下建立了一种求解凸约束伪单调方程组问题的迭代投影算法.该算法不需要利用方程组的任何梯度或Jacobian矩阵信息，因此它适合求解大规模问题.算法在每一次迭代中都能产生充分下降方向，且不依赖于任何线搜索条件.特别是，我们在不需要假设方程组满足Lipschitz条件下建立了算法的全局收敛性和R-线收敛速度.数值结果表明，该算法对于给定的大规模方程组问题是稳定和有效的.     

Positive operator based iterative algorithms for solving Lyapunov equations for Itô stochastic systems with Markovian jumps

This paper studies the iterative solutions of Lyapunov matrix equations associated with Itô stochastic systems having Markovian jump parameters. For the discrete-time case, when the associated stochastic system is mean square stable, two iterative algorithms with one in direct form and the other one in implicit form are established. The convergence of the implicit iteration is proved by the properties of some positive operators associated with the stochastic system. For the continuous-time case, a transformation is first performed so that it is transformed into an equivalent discrete-time Lyapunov equation. Then the iterative solution can be obtained by applying the iterative algorithm developed for discrete-time Lyapunov equation. Similar to the discrete-time case, an implicit iteration is also proposed for the continuous case. For both discrete-time and continuous-time Lyapunov equations, the convergence rates of the established algorithms are analyzed and compared. Numerical examples are worked out to validate the effectiveness of the proposed algorithms.     

对称线性互补问题的并行Schwarz算法

1引言考虑对称线性互补问题:求x∈R~N使得(1) Ax 6≥0,x≥0,x~T(Ax b)=0其中,A是给定的N×N实对称矩阵,b是N×1向量.目前求解该互补问题的迭代算法有很多(如Mangasarian(1977),Mangasarian,Leone (1987),Cottle(1992),曾金平,李董辉(1994)等).区域分解法以其将大问题化为若干子问     

A Parameterized Class of Complex Nonsymmetric Algebraic Riccati Equations

In this paper, by introducing a definition of parameterized comparison matrix of a given complex square matrix, the solvability of a parameterized class of complex nonsymmetric algebraic Riccati equations (NAREs) is discussed. The existence and uniqueness of the extremal solutions of the NAREs is proved. Some classical numerical methods can be applied to compute the extremal solutions of the NAREs, mainly including the Schur method, the basic fixed-point iterative methods, Newton's method and the doubling algorithms. Furthermore, the linear convergence of the basic fixed-point iterative methods and the quadratic convergence of Newton's method and the doubling algorithms are also shown. Moreover, some concrete parameter selection strategies in complex number field for the doubling algorithms are also given. Numerical experiments demonstrate that our numerical methods are effective.     

求解Sylvester矩阵方程的一种改进的梯度方法

提出了一种改进的梯度迭代算法来求解Sylvester矩阵方程和Lyapunov矩阵方程.该梯度算法是通过构造一种特殊的矩阵分裂,综合利用Jaucobi迭代算法和梯度迭代算法的求解思路.与已知的梯度算法相比,提高了算法的迭代效率.同时研究了该算法在满足初始条件下的收敛性.数值算例验证了该算法的有效性.     

Numerical solution of nonlinear systems by a general class of iterative methods with application to nonlinear PDEs

A general class of multi-step iterative methods for finding approximate real or complex solutions of nonlinear systems is presented. The well-known technique of undetermined coefficients is used to construct the first method of the class while the higher order schemes will be attained by a frozen Jacobian. The point of attraction theory will be taken into account to prove the convergence behavior of the main proposed iterative method. Then, it will be observed that an m-step method converges with 2m-order. A discussion of the computational efficiency index alongside numerical comparisons with the existing methods will be given. Finally, we illustrate the application of the new schemes in solving nonlinear partial differential equations.     

An iterative method for the shape reconstruction of the inverse Euler problem

This article is concerned with the shape reconstruction for the inviscid fluid governed by the Euler equations. By formulating the domain derivative of the Euler equations and applying a regularized Gauss‐Newton iterative algorithm, the numerical examples are given for recovering the shape. The results show that our theory is useful for practical purpose and the proposed algorithm is feasible. © 2011 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 28: 587–596, 2012     

Split Newton iterative algorithm and its application

Inspired by some implicit-explicit linear multistep schemes and additive Runge-Kutta methods, we develop a novel split Newton iterative algorithm for the numerical solution of nonlinear equations. The proposed method improves computational efficiency by reducing the computational cost of the Jacobian matrix. Consistency and global convergence of the new method are also maintained. To test its effectiveness, we apply the method to nonlinear reaction-diffusion equations, such as Burger’s-Huxley equation and fisher’s equation. Numerical examples suggest that the involved iterative method is much faster than the classical Newton’s method on a given time interval.     

Least squares solution with the minimum-norm to general matrix equations via iteration

Two iterative algorithms are presented in this paper to solve the minimal norm least squares solution to a general linear matrix equations including the well-known Sylvester matrix equation and Lyapunov matrix equation as special cases. The first algorithm is based on the gradient based searching principle and the other one can be viewed as its dual form. Necessary and sufficient conditions for the step sizes in these two algorithms are proposed to guarantee the convergence of the algorithms for arbitrary initial conditions. Sufficient condition that is easy to compute is also given. Moreover, two methods are proposed to choose the optimal step sizes such that the convergence speeds of the algorithms are maximized. Between these two methods, the first one is to minimize the spectral radius of the iteration matrix and explicit expression for the optimal step size is obtained. The second method is to minimize the square sum of the F-norm of the error matrices produced by the algorithm and it is shown that the optimal step size exits uniquely and lies in an interval. Several numerical examples are given to illustrate the efficiency of the proposed approach.     

A class of two‐stage iterative methods for systems of weakly nonlinear equations

The discretizations of many differential equations by the finite difference or the finite element methods can often result in a class of system of weakly nonlinear equations. In this paper, by applying the two-tage iteration technique and in accordance with the special properties of this weakly nonlinear system, we first propose a general two-tage iterative method through the two-tage splitting of the system matrix. Then, by applying the accelerated overrelaxation (AOR) technique of the linear iterative methods, we present a two-tage AOR method, which particularly uses the AOR iteration as the inner iteration and is substantially a relaxed variant of the afore-presented method. For these two classes of methods, we establish their local convergence theories, and precisely estimate their asymptotic convergence factors under some suitable assumptions when the involved nonlinear mapping is only B-differentiable. When the system matrix is either a monotone matrix or an H-matrix, and the nonlinear mapping is a P-bounded mapping, we thoroughly set up the global convergence theories of these new methods. Moreover, under the assumptions that the system matrix is monotone and the nonlinear mapping is isotone, we discuss the monotone convergence properties of the new two-tage iteration methods, and investigate the influence of the matrix splittings as well as the relaxation parameters on the convergence behaviours of these methods. Numerical computations show that our new methods are feasible and efficient for solving the system of weakly nonlinear equations. This revised version was published online in June 2006 with corrections to the Cover Date.     

A note on the iterative solutions of general coupled matrix equation

Recently, Ding and Chen [F. Ding, T. Chen, On iterative solutions of general coupled matrix equations, SIAM J. Control Optim. 44 (2006) 2269-2284] developed a gradient-based iterative method for solving a class of coupled Sylvester matrix equations. The basic idea is to regard the unknown matrices to be solved as parameters of a system to be identified, so that the iterative solutions are obtained by applying hierarchical identification principle. In this note, by considering the coupled Sylvester matrix equation as a linear operator equation we give a natural way to derive this algorithm. We also propose some faster algorithms and present some numerical results.     

A new arc algorithm for unconstrained optimization

The gradient path of a real valued differentiable function is given by the solution of a system of differential equations. For a quadratic function the above equations are linear, resulting in a closed form solution. A quasi-Newton type algorithm for minimizing ann-dimensional differentiable function is presented. Each stage of the algorithm consists of a search along an arc corresponding to some local quadratic approximation of the function being minimized. The algorithm uses a matrix approximating the Hessian in order to represent the arc. This matrix is updated each stage and is stored in its Cholesky product form. This simplifies the representation of the arc and the updating process. Quadratic termination properties of the algorithm are discussed as well as its global convergence for a general continuously differentiable function. Numerical experiments indicating the efficiency of the algorithm are presented.