求解大规模非对称矩阵特征问题的精化双正交Lanczos算法

We combine Lanczos algorithm with the thought of the refined projection method using QR factorization and propose the refined biothogonalization Lanczos method for computing the desired eigenvalues of large unsymmetric matrix. With low cost of work space and flops the algorithm cures the disease that the Ritz vectors may not converge when the Ritz values converge usingthe Lanczos method. Numerical experiments show our algorithm is considerably more stable and efficient than its counterpart.     

An Implicitly Restarted Block Arnoldi Method in a Vector-Wise Fashion

In this paper, we develop an implicitly restarted block Arnoldi algorithm in a vector-wise fashion. The vector-wise construction greatly simplifies both the detection of necessary deflation and the actual deflation itself, so it is preferable to the block-wise construction. The numerical experiment shows that our algorithm is effective.     

A QUASI-REFINED ITERATIVE ALGORITHM BASED ON THE LANCZOS BIORTHOGONALIZATION PROCEDURE FOR LARGE EIGENPROBLEMS

The two-sided Lanczos method is popular for computing a few selected eigentriplets of large non-Hermitian matrices. However, it has been revealed that theRitz vectors gained by this method may not converge even if the subspaces are good enough and the associated eigenvalues converge. In order to remedy this drawback, a novel method is proposed which is based on the refined strategy, the quasi-refined ideaand the Lanczos biothogonalization procedure, the resulting algorithm is presented. Therelationship between the new method and the classical oblique projection technique isalso established. We report some numericalwith the conventional one, the results showthe latter.experiments and compare the new algorithmthat the former is often more powerful than     

CONVERGENCE OF INEXACT CONIC NEWTON METHODS

A conic Newton method is attractive because it converges to a local minimizzer rapidly from any sufficiently good initial guess. However, it may be expensive to solve the conic Newton equation at each iterate. In this paper we consider an inexact conic Newton method, which solves the couic Newton equation oldy approximately and in sonm unspecified manner. Furthermore, we show that such method is locally convergent and characterizes the order of convergence in terms of the rate of convergence of the relative residuals.     

ROBUST HIGH ORDER CONVERGENCE OF AN OVERLAPPING SCHWARZ METHOD FOR SINGULARLY PERTURBED SEMILINEAR REACTION-DIFFUSION PROBLEMS

In this article we propose an overlapping Schwarz domain decomposition method for solving a singularly perturbed semilinear reaction-diffusion problem. The solution to this problem exhibits boundary layers of width O（√ε ln（1/√ε）） at both ends of the domain due to the presence of singular perturbation parameter ε. The method splits the domain into three overlapping subdomains, and uses the Numerov or Hermite scheme with a uniform mesh on two boundary layer subdomains and a hybrid scheme with a uniform mesh on the interior subdomain. The numerical approximations obtained from this method are proved to be almost fourth order uniformly convergent （in the maximum norm） with respect to the singular perturbation parameter. Furthermore, it is proved that, for small ε, one iteration is sufficient to achieve almost fourth order uniform convergence. Numerical experiments are given to illustrate the theoretical order of convergence established for the method.     

精化的二次残量迭代法

According to the refined projection principle advocated by Jia[8], we improve the residual iteration method of quadratic eigenvalue problems and propose a refined residual iteration method. We study the restarting issue of the method and develop a practical algorithm. Preliminary numerical examples illustrate the efficiency of the method.     

求解两块可分离凸极小化问题的惯性交替方向乘子法

The alternating direction method of multipliers(ADMM)is a widely used method for solving many convex minimization models arising in signal and image processing.In this paper,we propose an inertial ADMM for solving a two-block separable convex minimization problem with linear equality constraints.This algorithm is obtained by making use of the inertial Douglas-Rachford splitting algorithm to the corresponding dual of the primal problem.We study the convergence analysis of the proposed algorithm in infinite-dimensional Hilbert spaces.Furthermore,we apply the proposed algorithm on the robust principal component analysis problem and also compare it with other state-of-the-art algorithms.Numerical results demonstrate the advantage of the proposed algorithm.     

AN ADAPTIVE TRUST-REGION METHOD FOR GENERALIZED EIGENVALUES OF SYMMETRIC TENSORS

For symmetric tensors,computing generalized eigenvalues is equivalent to a homogenous polynomial optimization over the unit sphere.In this paper,we present an adaptive trustregion method for generalized eigenvalues of symmetric tensors.One of the features is that the trust-region radius is automatically updated by the adaptive technique to improve the algorithm performance.The other one is that a projection scheme is used to ensure the feasibility of all iteratives.Global convergence and local quadratic convergence of our algorithm are established,respectively.The preliminary numerical results show the efficiency of the proposed algorithm.     

求解非线性规划的原始对偶内点法(英文)

In this paper, we propose a primal-dual interior point method for solving general constrained nonlinear programming problems. To avoid the situation that the algorithm we use may converge to a saddle point or a local maximum, we utilize a merit function to guide the iterates toward a local minimum. Especially, we add the parameter ε to the Newton system when calculating the decrease directions. The global convergence is achieved by the decrease of a merit function. Furthermore, the numerical results confirm that the algorithm can solve this kind of problems in an efficient way.     

Verified Computation of Eigenpairs in the Generalized Eigenvalue Problem for Nonsquare Matrix Pencils

Consider an optimization problem arising from the generalized eigenvalue problem Ax=λBx,where A,B∈Cm×n and m>n.Ito et al.showed that the optimization problem can be solved by utilizing right singular vectors of C:=[B,A].In this paper,we focus on computing intervals containing the solution.When some singular values of C are multiple or nearly multiple,we can enclose bases of corresponding invariant subspaces of CHC,where CH denotes the conjugate transpose of C,but cannot enclose the corresponding right singular vectors.The purpose of this paper is to prove that the solution can be obtained even when we utilize the bases instead of the right singular vectors.Based on the proved result,we propose an algorithm for computing the intervals.Numerical results show property of the algorithm.     

计算最小奇异组的一个精化调和 Lanczos双对角化方法

在很多实际应用中需要计算大规模矩阵的若干个最小奇异组.调和投影方法是计算内部特征对的常用方法,其原理可用于求解大规模奇异值分解问题.本文证明了,当投影空间足够好时,该方法得到的近似奇异值收敛,但近似奇异向量可能收敛很慢甚至不收敛.根据第二作者近年来提出的精化投影方法的原理,本文提出一种精化的调和Lanczos双对角化方法,证明了它的收敛性.然后将该方法与Sorensen提出的隐式重新启动技术相结合,开发出隐式重新启动的调和Lanczos双对角化算法(IRHLB)和隐式重新启动的精化调和Lanczos双对角化算法(IRRHLB).位移的合理选取是算法成功的关键之一,本文对精化算法提出了一种新的位移策略,称之为"精化调和位移".理论分析表明,精化调和位移比IRHLB中所用的调和位移要好,且可以廉价可靠地计算出来.数值实验表明,IRRHLB比IRHLB要显著优越,而且比目前常用的隐式重新启动的Lanczos双对角化方法(IRLB)和精化算法IRRLB更有效.     

计算大规模矩阵最大最小奇异值和奇异向量的两个精化Lanczos算法

1.引言 在科学工程计算中经常需要计算大规模矩阵的少数最大或最小的奇异值及其所对应的奇异子空间。例如图像处理中要计算矩阵端部奇异值之比作为图像的分辨率,诸如此类的问题还存在于最小二乘问题、控制理论、量子化学中等等。然而大多实际问题中的矩阵是大型稀疏矩阵,且需要的是矩阵的部分奇异对。如果计算A的完全奇异值分解(SVD),则运算量和存储量极大,甚至不可能。因此必须寻求其它有效可靠的算法。 假设A的SVD为     

Dealing with linear dependence during the iterations of the restarted block Lanczos methods

The Lanczos method can be generalized to block form to compute multiple eigenvalues without the need of any deflation techniques. The block Lanczos method reduces a general sparse symmetric matrix to a block tridiagonal matrix via a Gram–Schmidt process. During the iterations of the block Lanczos method an off-diagonal block of the block tridiagonal matrix may become singular, implying that the new set of Lanczos vectors are linearly dependent on the previously generated vectors. Unlike the single vector Lanczos method, this occurrence of linearly dependent vectors may not imply an invariant subspace has been computed. This difficulty of a singular off-diagonal block is easily overcome in non-restarted block Lanczos methods, see [12,30]. The same schemes applied in non-restarted block Lanczos methods can also be applied in restarted block Lanczos methods. This allows the largest possible subspace to be built before restarting. However, in some cases a modification of the restart vectors is required or a singular block will continue to reoccur. In this paper we examine the different schemes mentioned in [12,30] for overcoming a singular block for the restarted block Lanczos methods, namely the restarted method reported in [12] and the Implicitly Restarted Block Lanczos (IRBL) method developed by Baglama et al. [3]. Numerical examples are presented to illustrate the different strategies discussed.     

隐式重启精化全局Lanczos方法

The numerical methods for solving large symmetric eigenvalue problems are considered in this paper.Based on the global Lanczos process,a global Lanczos method for solving large symmetric eigenvalue problems is presented.In order to accelerate the convergence of the F-Ritz vectors,the refined global Lanczos method is developed.Combining the implicitly restarted strategy with the deflation technique,an implicitly restarted and refined global Lanczos method for computing some eigenvalues of large symmetric matrices is proposed.Numerical results show that the proposed methods are efficient.     

Restarted block Lanczos bidiagonalization methods

The problem of computing a few of the largest or smallest singular values and associated singular vectors of a large matrix arises in many applications. This paper describes restarted block Lanczos bidiagonalization methods based on augmentation of Ritz vectors or harmonic Ritz vectors by block Krylov subspaces. Research supported in part by NSF grant DMS-0107858, NSF grant DMS-0311786, and an OBR Research Challenge Grant.     

Harmonic and Refined Extraction Methods for the Singular Value Problem,with Applications in Least Squares Problems

For the accurate approximation of the minimal singular triple (singular value and left and right singular vector) of a large sparse matrix, we may use two separate search spaces, one for the left, and one for the right singular vector. In Lanczos bidiagonalization, for example, such search spaces are constructed. In SIAM J. Sci. Comput., 23(2) (2002), pp. 606–628, the author proposes a Jacobi–Davidson type method for the singular value problem, where solutions to certain correction equations are used to expand the search spaces. As noted in the mentioned paper, the standard Galerkin subspace extraction works well for the computation of large singular triples, but may lead to unsatisfactory approximations to small and interior triples. To overcome this problem for the smallest triples, we propose three harmonic and a refined approach. All methods are derived in a number of different ways. Some of these methods can also be applied when we are interested in the largest or interior singular triples. Theoretical results as well as numerical experiments indicate that the results of the alternative extraction processes are often better than the standard approach. We show that when Lanczos bidiagonalization is used for the subspace expansion, the standard, harmonic, and refined extraction methods are all essentially equivalent. This gives more insight in the success of Lanczos bidiagonalization to find the smallest singular triples. Finally, we show that the extraction processes for the smallest singular values may give an approximation to a least squares problem at low additional costs. The truncated SVD is also discussed in this context. AMS subject classification (2000) 65F15, 65F50, (65F35, 93E24).Submitted December 2002. Accepted October 2004. Communicated by Haesun Park.M. E. Hochstenbach: The research of this author was supported in part by NSF grant DMS-0405387. Part of this work was done when the author was at Utrecht University.     

求解陀螺系统特征值问题的收缩二阶Lanczos方法

本文研究陀螺系统特征值问题的数值解法,利用反对称矩阵Lanczos算法,提出了求解陀螺系统特征值问题的二阶Lanczos方法.基于提出的陀螺系统特征值问题的非等价低秩收缩技术,给出了计算陀螺系统极端特征值的收缩二阶Lanczos方法.数值结果说明了算法的有效性.