Computational Variants of the Lanczos Method for the Eigenproblem

^* Present address: School of Computer Science, McGill University, Montreal 101, Quebec, Canada. The Lanczos process is theoretically ideal for finding severalextreme eigenvalues of large sparse symmetric matrices, butbecause of loss of orthogonality in practice it has largelybeen ignored, or used with re-orthogonalization. Here it isshown that it can still be an extremely efficient and accuratealgorithm if used in an iterative manner. An error analysisis given showing the most accurate algorithms, and the conclusionsare supported by computational results.     

矩阵方程AXB+CYD=E对称最小范数最小二乘解的极小残差法

<正>1引言本文用R~(n×m)表示全体n×m实矩阵集合,用SR~(n×n)表示全体n×n实对称矩阵集合,OR~(n×n)表示全体n×n实正交矩阵集合.用I_n表示n阶单位矩阵,用A*B表示矩阵A与B的Hadamard乘积.对任意矩阵A,B∈R~(n×m),定义内积〈A,B〉=tr(B~T A),其中     

一类非线性矩阵方程对称解的双迭代算法

利用逆矩阵的Neumann级数形式,将在Schur插值问题中遇到的含未知矩阵二次项之逆的非线性矩阵方程转化为高次多项式矩阵方程,然后采用牛顿算法求高次多项式矩阵方程的对称解,并采用修正共轭梯度法求由牛顿算法每一步迭代计算导出的线性矩阵方程的对称解或者对称最小二乘解,建立求非线性矩阵方程的对称解的双迭代算法.双迭代算法仅要求非线性矩阵方程有对称解,不要求它的对称解唯一,也不对它的系数矩阵做附加限定.数值算例表明,双迭代算法是有效的.     

一类Riccati方程组对称自反解的两种迭代算法

针对源于Markov跳变线性二次控制问题中的一类对偶代数Riccati方程组,分别采用修正共轭梯度算法和正交投影算法作为非精确Newton算法的内迭代方法,建立求其对称自反解的非精确Newton-MCG算法和非精确Newton-OGP算法.两种迭代算法仅要求Riccati方程组存在对称自反解,对系数矩阵等没有附加限定.数值算例表明,两种迭代算法是有效的.     

实规范矩阵的特征值问题

实对称矩阵的特征值问题,无论是低阶稠密矩阵的全部特征值问题,或高阶稀疏矩阵的部分特征值问题,都已有许多有效的计算方法,迄今最重要的一些成果已总结在[5]中。本文利用规范矩阵的一些重要性质将对于Hermite矩阵(特别是对弥矩阵)特征值问题的一些有效算法推广到规范矩阵的特征值问题,由于对复规范阵的推广是简单的,而且实际上常遇到的是实矩阵(这时常要求只用实运算),因此我们着重讨论实规范矩阵的特征值问题。     

A parallel balance scheme for banded linear systems

A parallel algorithm is proposed for the solution of narrow banded non‐symmetric linear systems. The linear system is partitioned into blocks of rows with a small number of unknowns common to multiple blocks. Our technique yields a reduced system defined only on these common unknowns which can then be solved by a direct or iterative method. A projection based extension to this approach is also proposed for computing the reduced system implicitly, which gives rise to an inner–outer iteration method. In addition, the product of a vector with the reduced system matrix can be computed efficiently on a multiprocessor by concurrent projections onto subspaces of block rows. Scalable implementations of the algorithm can be devized for hierarchical parallel architectures by exploiting the two‐level parallelism inherent in the method. Our experiments indicate that the proposed algorithm is a robust and competitive alternative to existing methods, particularly for difficult problems with strong indefinite symmetric part. Copyright © 2001 John Wiley & Sons, Ltd.     

AOR方法的收敛性

A.Hadjidimos在[1]中提出一个迭代求解线性方程组的 AOR方法(Accelerated Overre-laxation Method),并在方程组的系数矩阵为不可约弱对角优势、L-矩阵和相容有序矩阵的条件下,讨论了此方法的收敛性.在这篇文章里,我们将考虑系数矩阵是H-矩阵、正定矩阵以及L-矩阵的情况.所得结果表明,可以放宽在[1]的3,4两节中对参数所加的限制.     

正交平衡区组设计统计模型中的方差分析

正交平衡区组设计(或广义正交表)的数据分析类似于正交拉丁方(或正交表)的数据分析.利用类似于正交表数据分析中的投影矩阵的正交分解技术,研究正交平衡区组设计的统计分析模型,给出了方差分析中的二次型以及各因子的二次型的分布性质,从而给出正交平衡区组设计统计模型中的方差分析方法.     

Reflection-Projection Method for Convex Feasibility Problems with an Obtuse Cone

The convex feasibility problem asks to find a point in the intersection of finitely many closed convex sets in Euclidean space. This problem is of fundamental importance in the mathematical and physical sciences, and it can be solved algorithmically by the classical method of cyclic projections.In this paper, the case where one of the constraints is an obtuse cone is considered. Because the nonnegative orthant as well as the set of positive-semidefinite symmetric matrices form obtuse cones, we cover a large and substantial class of feasibility problems. Motivated by numerical experiments, the method of reflection-projection is proposed: it modifies the method of cyclic projections in that it replaces the projection onto the obtuse cone by the corresponding reflection.This new method is not covered by the standard frameworks of projection algorithms because of the reflection. The main result states that the method does converge to a solution whenever the underlying convex feasibility problem is consistent. As prototypical applications, we discuss in detail the implementation of two-set feasibility problems aiming to find a nonnegative [resp. positive semidefinite] solution to linear constraints in ⁿ [resp. in , the space of symmetric n×n matrices] and we report on numerical experiments. The behavior of the method for two inconsistent constraints is analyzed as well.     

An iterative method for updating gyroscopic systems based on measured modal data

An efficient iterative method for updating the mass, gyroscopic and stiffness matrices simultaneously using a few of complex measured modal data is developed. By using the proposed iterative method, the unique symmetric solution can be obtained within finite iteration steps in the absence of roundoff errors by choosing a special kind of initial matrices. Numerical results show that the presented method can be used to update finite element models to get better agreement between analytical and experimental modal parameters.     

LSQR iterative method for generalized coupled Sylvester matrix equations

An iterative method is proposed to solve generalized coupled Sylvester matrix equations, based on a matrix form of the least-squares QR-factorization (LSQR) algorithm. By this iterative method on the selection of special initial matrices, we can obtain the minimum Frobenius norm solutions or the minimum Frobenius norm least-squares solutions over some constrained matrices, such as symmetric, generalized bisymmetric and (R, S)-symmetric matrices. Meanwhile, the optimal approximate solutions to the given matrices can be derived by solving the corresponding new generalized coupled Sylvester matrix equations. Finally, numerical examples are given to illustrate the effectiveness of the present method.     

An algorithm for approximating the singular triplets of complex symmetric matrices

We present an algorithm for the approximation of the dominant singular values and corresponding right and left singular vectors of a complex symmetric matrix. The method is based on two short-term recurrences first proposed by Saunders, Simon and Yip [24] for a non-Hermitian linear system solver. With symmetric matrices, the recurrence can be modified so as to generate a tridiagonal symmetric matrix from which the original triplets can be approximated. The recurrence formally resembles the Lanczos method, in spite of substantial differences which make usual convergence results inapplicable. Implementation aspects are discussed, such as re-orthogonalization and the use of alternative representation matrices. The method is very efficient over existing approaches which do not exploit the symmetry of the problem. Numerical experiments on application problems validate the analysis, while showing satisfactory results, especially on dense matrices. © 1997 by John Wiley & Sons, Ltd.     

双变量矩阵方程组对称最小二乘解的迭代算法

本文研究了求双变量线性矩阵方程组的对称最小二乘解的问题.利用求解线性代数方程组的共轭梯度法的基本思想,通过对有关矩阵和系数的变形与近似处理,建立了一种迭代算法.拓宽了共轭梯度法的适用范围.算例表明,迭代算法是有效的.     

Preconditioned iterative methods for a class of nonlinear eigenvalue problems

This paper proposes new iterative methods for the efficient computation of the smallest eigenvalue of symmetric nonlinear matrix eigenvalue problems of large order with a monotone dependence on the spectral parameter. Monotone nonlinear eigenvalue problems for differential equations have important applications in mechanics and physics. The discretization of these eigenvalue problems leads to nonlinear eigenvalue problems with very large sparse ill-conditioned matrices monotonically depending on the spectral parameter. To compute the smallest eigenvalue of large-scale matrix nonlinear eigenvalue problems, we suggest preconditioned iterative methods: preconditioned simple iteration method, preconditioned steepest descent method, and preconditioned conjugate gradient method. These methods use only matrix-vector multiplications, preconditioner-vector multiplications, linear operations with vectors, and inner products of vectors. We investigate the convergence and derive grid-independent error estimates for these methods. Numerical experiments demonstrate the practical effectiveness of the proposed methods for a model problem.     

A globally convergent non-interior point algorithm with full Newton step for second-order cone programming

A non-interior point algorithm based on projection for second-order cone programming problems is proposed and analyzed. The main idea of the algorithm is that we cast the complementary equation in the primal-dual optimality conditions as a projection equation. By using this reformulation, we only need to solve a system of linear equations with the same coefficient matrix and compute two simple projections at each iteration, without performing any line search. This algorithm can start from an arbitrary point, and does not require the row vectors of A to be linearly independent. We prove that our algorithm is globally convergent under weak conditions. Preliminary numerical results demonstrate the effectiveness of our algorithm.     

A projection method and Kronecker product preconditioner for solving Sylvester tensor equations

The preconditioned iterative solvers for solving Sylvester tensor equations are considered in this paper.By fully exploiting the structure of the tensor equation,we propose a projection method based on the tensor format,which needs less flops and storage than the standard projection method.The structure of the coefficient matrices of the tensor equation is used to design the nearest Kronecker product(NKP) preconditioner,which is easy to construct and is able to accelerate the convergence of the iterative solver.Numerical experiments are presented to show good performance of the approaches.     

An iterative procedure for determining an unknown spacewise-dependent coefficient in a parabolic equation

An inverse problem for the determination of an unknown spacewise-dependent coefficient in a parabolic equation is considered. The problem is reformulated as a nonclassical parabolic equation along with the initial and boundary conditions. The iterative fixed point projection method is applied to solve the reformulated problem. The comparison analysis of proposed method with a least square method and some numerical examples are presented.     

Analysis of the symmetric Lanczos algorithm with reorthogonalization methods

We present an error analysis of the symmetric Lanczos algorithm in finite precision arithmetic. The loss of orthogonality among the computed Lanczos vectors is explained with the help of a recurrence formula. A backward error analysis shows that semiorthogonality among the Lanczos vectors is enough to guarantee the accuracy of the computed quantities up to machine precision. The results of this analysis are then extended to the more general case of the Lanczos algorithm with a semiorthogonalization strategy. Based on the recurrence formula, a new reorthogonalization method called partial reorthogonalization is introduced. We show that both partial reorthogonalization and selective orthogonalization as introduced by Parlett and Scott [15] are semiorthogonalization strategies. Finally we discuss the application of our results to the solution of linear systems of equations and to the eigenvalue problem.     

矩阵方程AXB+CYD=E的M对称解的迭代算法

在共轭梯度思想的启发下,结合线性投影算子,给出迭代算法求解了线性矩阵方程AXB+CYD=E的M对称解[X,Y]及其最佳逼近.当矩阵方程AXB+CYD=E有M对称解时,应用迭代算法,在有限的误差范围内,对任意初始M对称矩阵对[X_,Y_1],经过有限步迭代可得到矩阵方程的M对称解;选取合适的初始迭代矩阵,还可得到极小范数M对称解.而且,对任意给定的矩阵对[X,Y],矩阵方程AXB+CYD=E的最佳逼近可以通过迭代求解新的矩阵方程AXB+CYD=E的极小范数M对称解得到.文中的数值例子证实了该算法的有效性.     

An iterative scheme for variational inequalities

In this paper we introduce and study a general iterative scheme for the numerical solution of finite dimensional variational inequalities. This iterative scheme not only contains, as special cases the projection, linear approximation and relaxation methods but also induces new algorithms. Then, we show that under appropriate assumptions the proposed iterative scheme converges by establishing contraction estimates involving a sequence of norms in Eⁿ induced by symmetric positive definite matrices G_m. Thus, in contrast to the above mentioned methods, this technique allows the possibility of adjusting the norm at each step of the algorithm. This flexibility will generally yield convergence under weaker assumptions.