Broyden修正算法

对于求解非线性方程组F (x) =0的Broyden秩1方法的计算格式提出一种修正算法,尝试利用矩阵的奇异值分解求解迭代方程组,并且配合使用加速技巧,从而大大提高了算法的安全性和收敛速度.数值算例表明了新算法的有效性.     

求逆矩阵的快速方法

介绍了求逆矩阵的快速方法,先对矩阵作QR分解,再利用三角形矩阵求逆的迭代算法,得到了求逆矩阵的快速方法.     

基于矩阵奇异值分解的空间直线拟合

讨论空间直线拟合问题,先对已知数据进行中心化处理得到矩阵,对此矩阵进行奇异值分解,直线方程中的系数可由相应的列向量确定.该拟合过程不需迭代,简单易行,结果也比原文更接近真实值.     

迭代求解非Hermitian正定线性方程组的衍生多分裂方法[英文]

本文研究迭代求解非Hermitian正定线性方程组的问题.在系数矩阵HS分裂的基础上,提出了一种新的衍生并行多分裂迭代方法.通过参数调节分配反Hermitian部分给Hermitian部分的多分裂来衍生出非Hermitian正定系数矩阵的并行多分裂迭代格式,并利用优化技巧来获得权矩阵.同时,建立算法的收敛理论.最后用数值实验表明了新方法的有效性和可行性.     

求解Sylvester矩阵方程的一种改进的梯度方法

提出了一种改进的梯度迭代算法来求解Sylvester矩阵方程和Lyapunov矩阵方程.该梯度算法是通过构造一种特殊的矩阵分裂,综合利用Jaucobi迭代算法和梯度迭代算法的求解思路.与已知的梯度算法相比,提高了算法的迭代效率.同时研究了该算法在满足初始条件下的收敛性.数值算例验证了该算法的有效性.     

求解增广线性系统的局部多分裂迭代法

为了在高性能计算机上求解增广线性系统,基于并行多分裂的两种技巧,本文提出一种局部多分裂迭代格式,给出当增广线性系统的矩阵为M-矩阵和H-矩阵时新方法的收敛性理论.并讨论预条件矩阵的特征值情形.     

Transputer上Cholesky分解的并行实现

§1.引言 对称正定矩阵A的Cholesky分解在求解线性系统Ax-b中非常重要,如果R是上三角矩阵,使得A=R~TR,则求解上述方程组可以通过向前及向后迭代来完成。然而求解一个线性系统,主要是计算系数矩阵的分解。这里主要是介绍如何有效地并行求矩阵R。在串行机上,已经有了很好的实现方法,如[1]至于如何在并行机上实现,是本文的目的。 众所周知,在并行机上求解大规模问题是今后科学与工程计算的必然发展方向。然     

广义Nekrasov矩阵的判别法及其迭代算法

对任意给定矩阵,通过对其行下标集不同的递进式划分,结合不等式的放缩技巧,给出广义Nekrasov矩阵的若干判别法,并进而获得广义Nekrasov矩阵的迭代算法,改进和推广了已有相关结果.     

广义Nekrasov矩阵的判别法及其迭代算法北大核心

对任意给定矩阵,通过对其行下标集不同的递进式划分,结合不等式的放缩技巧,给出广义Nekrasov矩阵的若干判别法,并进而获得广义Nekrasov矩阵的迭代算法,改进和推广了已有相关结果.     

连续Sylvester矩阵方程求解的分裂迭代算法

有效求解连续的Sylvester矩阵方程对于科学和工程计算有着重要的应用价值,因此该文提出了一种可行的分裂迭代算法.该算法的核心思想是外迭代将连续Sylvester矩阵方程的系数矩阵分裂为对称矩阵和反对称矩阵,内迭代求解复对称矩阵方程.相较于传统的分裂算法,该文所提出的分裂迭代算法有效地避免了最优迭代参数的选取,并利用了复对称方程组高效求解的特点,进而提高了算法的易实现性、易操作性.此外,从理论层面进一步证明了该分裂迭代算法的收敛性.最后,通过数值算例表明分裂迭代算法具有良好的收敛性和鲁棒性,同时也证实了分裂迭代算法的收敛性很大程度依赖于内迭代格式的选取.     

A class of two‐stage iterative methods for systems of weakly nonlinear equations

The discretizations of many differential equations by the finite difference or the finite element methods can often result in a class of system of weakly nonlinear equations. In this paper, by applying the two-tage iteration technique and in accordance with the special properties of this weakly nonlinear system, we first propose a general two-tage iterative method through the two-tage splitting of the system matrix. Then, by applying the accelerated overrelaxation (AOR) technique of the linear iterative methods, we present a two-tage AOR method, which particularly uses the AOR iteration as the inner iteration and is substantially a relaxed variant of the afore-presented method. For these two classes of methods, we establish their local convergence theories, and precisely estimate their asymptotic convergence factors under some suitable assumptions when the involved nonlinear mapping is only B-differentiable. When the system matrix is either a monotone matrix or an H-matrix, and the nonlinear mapping is a P-bounded mapping, we thoroughly set up the global convergence theories of these new methods. Moreover, under the assumptions that the system matrix is monotone and the nonlinear mapping is isotone, we discuss the monotone convergence properties of the new two-tage iteration methods, and investigate the influence of the matrix splittings as well as the relaxation parameters on the convergence behaviours of these methods. Numerical computations show that our new methods are feasible and efficient for solving the system of weakly nonlinear equations. This revised version was published online in June 2006 with corrections to the Cover Date.     

A modified damped Newton method for linear complementarity problems

We present a modified damped Newton method for solving large sparse linear complementarity problems, which adopts a new strategy for determining the stepsize at each Newton iteration. The global convergence of the new method is proved when the system matrix is a nondegenerate matrix. We then apply the matrix splitting technique to this new method, deriving an inexact splitting method for the linear complementarity problems. The global convergence of the resulting inexact splitting method is proved, too. Numerical results show that the new methods are feasible and effective for solving the large sparse linear complementarity problems.     

低秩稀疏矩阵恢复的快速非单调交替极小化方法

针对低秩稀疏矩阵恢复问题的一个非凸优化模型,本文提出了一种快速非单调交替极小化方法.主要思想是对低秩矩阵部分采用交替极小化方法,对稀疏矩阵部分采用非单调线搜索技术来分别进行迭代更新.非单调线搜索技术是将单步下降放宽为多步下降,从而提高了计算效率.文中还给出了新算法的收敛性分析.最后,通过数值实验的比较表明,矩阵恢复的非单调交替极小化方法比原单调类方法更有效.     

解大型无约束优化的新的非单调简单模型BB-TR方法（英文）

The trust region(TR) method for optimization is a class of effective methods.The conic model can be regarded as a generalized quadratic model and it possesses the good convergence properties of the quadratic model near the minimizer.The Barzilai and Borwein(BB) gradient method is also an effective method,it can be used for solving large scale optimization problems to avoid the expensive computation and storage of matrices.In addition,the BB stepsize is easy to determine without large computational efforts.In this paper,based on the conic trust region framework,we employ the generalized BB stepsize,and propose a new nonmonotone adaptive trust region method based on simple conic model for large scale unconstrained optimization.Unlike traditional conic model,the Hessian approximation is an scalar matrix based on the generalized BB stepsize,which resulting a simple conic model.By adding the nonmonotone technique and adaptive technique to the simple conic model,the new method needs less storage location and converges faster.The global convergence of the algorithm is established under certain conditions.Numerical results indicate that the new method is effective and attractive for large scale unconstrained optimization problems.     

Parallel multisplitting two-stage iterative methods for large sparse systems of weakly nonlinear equations

The finite difference or the finite element discretizations of many differential or integral equations often result in a class of systems of weakly nonlinear equations. In this paper, by reasonably applying both the multisplitting and the two-stage iteration techniques, and in accordance with the special properties of this system of weakly nonlinear equations, we first propose a general multisplitting two-stage iteration method through the two-stage multiple splittings of the system matrix. Then, by applying the accelerated overrelaxation (AOR) technique of the linear iterative methods, we present a multisplitting two-stage AOR method, which particularly uses the AOR-like iteration as inner iteration and is substantially a relaxed variant of the afore-presented method. These two methods have a forceful parallel computing function and are much more suitable to the high-speed multiprocessor systems. For these two classes of methods, we establish their local convergence theories, and precisely estimate their asymptotic convergence factors under some suitable assumptions when the involved nonlinear mapping is only directionally differentiable. When the system matrix is either an H-matrix or a monotone matrix, and the nonlinear mapping is a P-bounded mapping, we thoroughly set up the global convergence theories of these new methods. Moreover, under the assumptions that the system matrix is monotone and the nonlinear mapping is isotone, we discuss the monotone convergence properties of the new multisplitting two-stage iteration methods, and investigate the influence of the multiple splittings as well as the relaxation parameters upon the convergence behaviours of these methods. Numerical computations show that our new methods are feasible and efficient for parallel solving of the system of weakly nonlinear equations. This revised version was published online in August 2006 with corrections to the Cover Date.     

Convergence of skew-symmetric iterative methods

We propose a new technique for studying the convergence of triangular skew-symmetric and product triangular skew-symmetric iterative methods (introduced earlier by the first author) based on the notion of a field of values of a matrix. We obtain formulas connecting the field of values of the initial matrix, that of the matrix which determines the iterative method, and eigenvalues of the iterative matrix. We prove that the mentioned methods can converge even if the initial matrix is not dissipative.     

Convergence acceleration of preconditioned conjugate gradient solver based on error vector sampling for a sequence of linear systems

In this article, we focus on solving a sequence of linear systems that have identical (or similar) coefficient matrices. For this type of problem, we investigate subspace correction (SC) and deflation methods, which use an auxiliary matrix (subspace) to accelerate the convergence of the iterative method. In practical simulations, these acceleration methods typically work well when the range of the auxiliary matrix contains eigenspaces corresponding to small eigenvalues of the coefficient matrix. We develop a new algebraic auxiliary matrix construction method based on error vector sampling in which eigenvectors with small eigenvalues are efficiently identified in the solution process. We use the generated auxiliary matrix for convergence acceleration in the following solution step. Numerical tests confirm that both SC and deflation methods with the auxiliary matrix can accelerate the solution process of the iterative solver. Furthermore, we examine the applicability of our technique to the estimation of the condition number of the coefficient matrix. We also present the algorithm of the preconditioned conjugate gradient method with condition number estimation.     

Acceleration of Convergence of Static and Dynamic Iterations

A new technique for acceleration of convergence of static and dynamic iterations for systems of linear equations and systems of linear differential equations is proposed. This technique is based on splitting the matrix of the system in such a way that the resulting iteration matrix has a minimal spectral radius for linear systems and a minimal spectral radius for some value of a parameter in Laplace transform domain for linear differential systems.This revised version was published online in October 2005 with corrections to the Cover Date.     

Analysis on a superlinearly convergent augmented Lagrangian method

The augmented Lagrangian method is a classical method for solving constrained optimization.Recently,the augmented Lagrangian method attracts much attention due to its applications to sparse optimization in compressive sensing and low rank matrix optimization problems.However,most Lagrangian methods use first order information to update the Lagrange multipliers,which lead to only linear convergence.In this paper,we study an update technique based on second order information and prove that superlinear convergence can be obtained.Theoretical properties of the update formula are given and some implementation issues regarding the new update are also discussed.     

Exponential Convergence of Time-Delay Systems in the Presence of Bounded Disturbances

In this paper, the problem of control design for exponential convergence of state/input delay systems with bounded disturbances is considered. Based on the Lyapunov–Krasovskii method combining with the delay-decomposition technique, a new sufficient condition is proposed for the existence of a state feedback controller, which guarantees that all solutions of the closed-loop system converge exponentially (with a pre-specified convergence rate) within a ball whose radius is minimized. The obtained condition is given in terms of matrix inequalities with one parameter needing to be tuned, which can be solved by using a one-dimensional search method with Matlab’s LMI Toolbox to minimize the radius of the ball. Two numerical examples are given to illustrate the superiority of the proposed method.