Ritz and harmonic Ritz values and the convergence of FOM and GMRES

The Ritz and harmonic Ritz values are approximate eigenvalues, which can be computed cheaply within the FOM and GMRES Krylov subspace iterative methods for solving non‐symmetric linear systems. They are also the zeros of the residual polynomials of FOM and GMRES, respectively. In this paper we show that the Walker–Zhou interpretation of GMRES enables us to formulate the relation between the harmonic Ritz values and GMRES in the same way as the relation between the Ritz values and FOM. We present an upper bound for the norm of the difference between the matrices from which the Ritz and harmonic Ritz values are computed. The differences between the Ritz and harmonic Ritz values enable us to describe the breakdown of FOM and stagnation of GMRES. Copyright © 1999 John Wiley & Sons, Ltd.     

A note on harmonic Ritz values and their reciprocals

This note summarizes an investigation of harmonic Ritz values to approximate the interior eigenvalues of a real symmetric matrix A while avoiding the explicit use of the inverse A^?1. We consider a bounded functional ψ that yields the reciprocals of the harmonic Ritz values of a symmetric matrix A. The crucial observation is that with an appropriate residual s, many results from Rayleigh quotient and Rayleigh–Ritz theory naturally extend. The same is true for the generalization to matrix pencils (A, B) when B is symmetric positive definite. These observations have an application in the computation of eigenvalues in the interior of the spectrum of a large sparse matrix. The minimum and maximum of ψ correspond to the eigenpairs just to the left and right of zero (or a chosen shift). As a spectral transformation, this distinguishes ψ from the original harmonic approach where an interior eigenvalue remains at the interior of the transformed spectrum. As a consequence, ψ is a very attractive vehicle for a matrix‐free, optimization‐based eigensolver. Instead of computing the smallest/largest eigenvalues by minimizing/maximizing the Rayleigh quotient, one can compute interior eigenvalues as the minimum/maximum of ψ. Copyright © 2009 John Wiley & Sons, Ltd.     

A numerical technique for solving fractional variational problems

This paper presents an accurate numerical method for solving a class of fractional variational problems (FVPs). The fractional derivative in these problems is in the Caputo sense. The proposed method is called fractional Chebyshev finite difference method. In this technique, we approximate FVPs and end up with a finite‐dimensional problem. The method is based on the combination of the useful properties of Chebyshev polynomials approximation and finite difference method. The Caputo fractional derivative is replaced by a difference quotient and the integral by a finite sum. The fractional derivative approximation using Clenshaw and Curtis formula introduced here, along with Clenshaw and Curtis procedure for the numerical integration of a non‐singular functions and the Rayleigh–Ritz method for the constrained extremum, is considered. By this method, the given problem is reduced to the problem for solving a system of algebraic equations, and by solving this system, we obtain the solution of FVPs. Special attention is given to study the convergence analysis and evaluate an error upper bound of the obtained approximate formula. Illustrative examples are included to demonstrate the validity and applicability of the proposed technique. A comparison with another method is given. Copyright © 2012 John Wiley & Sons, Ltd.     

A new framework for implicit restarting of the Krylov–Schur algorithm

This paper introduces a new framework for implicit restarting of the Krylov–Schur algorithm. It is shown that restarting with arbitrary polynomial filter is possible by reassigning some of the eigenvalues of the Rayleigh quotient through a rank‐one correction, implemented using only the elementary transformations (translation and similarity) of the Krylov decomposition. This framework includes the implicitly restarted Arnoldi (IRA) algorithm and the Krylov–Schur algorithm with implicit harmonic restart as special cases. Further, it reveals that the IRA algorithm can be turned into an eigenvalue assignment method. Copyright © 2014 John Wiley & Sons, Ltd.     

Some well-posed results on the time-fractional Rayleigh–Stokes problem with polynomial and gradient nonlinearities

In this work, we ponder on a Cauchy problem for the Rayleigh–Stokes equation accompanied by polynomial and gradient nonlinearities. We particularly concern about the behavior of mild solutions for the different instances of the nonlinear source term. In the case of polynomial nonlinearities, we present the local-in-time existence and uniqueness of the mild solution. Moreover, we claim that either it is the global-in-time or it blows up at a finite time. With reference to the case that the source function is global Lipschitzian, we observe that the solution always uniquely exists for a finite time and is continuously dependent. Eventually, we establish some regularity results for the mild solution.     

Subspace methods for three‐parameter eigenvalue problems

We propose subspace methods for three‐parameter eigenvalue problems. Such problems arise when separation of variables is applied to separable boundary value problems; a particular example is the Helmholtz equation in ellipsoidal and paraboloidal coordinates. While several subspace methods for two‐parameter eigenvalue problems exist, their extensions to a three‐parameter setting seem challenging. An inherent difficulty is that, while for two‐parameter eigenvalue problems, we can exploit a relation to Sylvester equations to obtain a fast Arnoldi‐type method, such a relation does not seem to exist when there are three or more parameters. Instead, we introduce a subspace iteration method with projections onto generalized Krylov subspaces that are constructed from scratch at every iteration using certain Ritz vectors as the initial vectors. Another possibility is a Jacobi–Davidson‐type method for three or more parameters, which we generalize from its two‐parameter counterpart. For both approaches, we introduce a selection criterion for deflation that is based on the angles between left and right eigenvectors. The Jacobi–Davidson approach is devised to locate eigenvalues close to a prescribed target; yet, it often also performs well when eigenvalues are sought based on the proximity of one of the components to a prescribed target. The subspace iteration method is devised specifically for the latter task. The proposed approaches are suitable especially for problems where the computation of several eigenvalues is required with high accuracy. MATLAB implementations of both methods have been made available in the package MultiParEig (see http://www.mathworks.com/matlabcentral/fileexchange/47844-multipareig ).     

调和Arnoldi方法的一种变形

讨论求解大规模非对称矩阵内部特征问题的一种方法,与标准的调和A rnold i方法相比,该方法仍用调和R itz值作为特征值的近似,而在近似特征向量选取方面,我们充分利用A rnold i过程所提供的最末一个基向量的信息,在多1维K ry lov子空间中选取一个向量-称之为改进的调和R itz向量-作为所求的特征向量的近似.理论分析和数值试验均表明这种变形的调和A rnold i方法的可行性和有效性.     

Computation of the eigenvalues of Fredholm–Stieltjes integral equations

The Rayleigh–Ritz and the inverse iteration methods are used in order to compute the eigenvalues of Fredholm–Stieltjes integral equations, i.e. Fredholm equations with respect to suitable Stieltjes-type measures. Some applications to the so-called ‘charged’ (in German ‘belastete’) integral equation, and particularly the problem of computing the eigenvalues of a string charged by a finite number of cursors are given.     

Block triangular preconditioners for linearization schemes of the Rayleigh–Bénard convection problem

In this paper, we compare two block triangular preconditioners for different linearizations of the Rayleigh–Bénard convection problem discretized with finite element methods. The two preconditioners differ in the nested or nonnested use of a certain approximation of the Schur complement associated to the Navier–Stokes block. First, bounds on the generalized eigenvalues are obtained for the preconditioned systems linearized with both Picard and Newton methods. Then, the performance of the proposed preconditioners is studied in terms of computational time. This investigation reveals some inconsistencies in the literature that are hereby discussed. We observe that the nonnested preconditioner works best both for the Picard and for the Newton cases. Therefore, we further investigate its performance by extending its application to a mixed Picard–Newton scheme. Numerical results of two‐ and three‐dimensional cases show that the convergence is robust with respect to the mesh size. We also give a characterization of the performance of the various preconditioned linearization schemes in terms of the Rayleigh number.     

Efficient computation of the exponential operator for large,sparse, symmetric matrices

In this paper we compare Krylov subspace methods with Chebyshev series expansion for approximating the matrix exponential operator on large, sparse, symmetric matrices. Experimental results upon negative‐definite matrices with very large size, arising from (2D and 3D) FE and FD spatial discretization of linear parabolic PDEs, demonstrate that the Chebyshev method can be an effective alternative to Krylov techniques, especially when memory bounds do not allow the storage of all Ritz vectors. We also discuss the sensitivity of Chebyshev convergence to extreme eigenvalue approximation, as well as the reliability of various a priori and a posteriori error estimates for both methods. Copyright © 2000 John Wiley & Sons, Ltd.     

A posteriori estimates for eigenvalue/vector approximations

We combine abstract eigenvalue/eigenvector estimates (from our earlier work) with a saturation assumption for finite element solution of associated stationary problem to obtain a posteriori estimates of the accuracy of finite element Rayleigh–Ritz approximations. Attention will be payed to the interplay between the accuracy estimate for the finite element method and a strategy for generating an adapted mesh. The obtained results use a preconditioned residuum of Neymeyr and extend his study of eigenvalue approximations with eigenvector estimates. We also prove that this eigenvalue estimator is equivalent to the global error. (© 2006 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

A numerical solution of the constrained weighted energy problem

A numerical algorithm is presented to solve the constrained weighted energy problem from potential theory. As one of the possible applications of this algorithm, we study the convergence properties of the rational Lanczos iteration method for the symmetric eigenvalue problem. The constrained weighted energy problem characterizes the region containing those eigenvalues that are well approximated by the Ritz values. The region depends on the distribution of the eigenvalues, on the distribution of the poles, and on the ratio between the size of the matrix and the number of iterations. Our algorithm gives the possibility of finding the boundary of this region in an effective way.We give numerical examples for different distributions of poles and eigenvalues and compare the results of our algorithm with the convergence behavior of the explicitly performed rational Lanczos algorithm.     

Tuned preconditioners for inexact two‐sided inverse and Rayleigh quotient iteration

Convergence results are provided for inexact two‐sided inverse and Rayleigh quotient iteration, which extend the previously established results to the generalized non‐Hermitian eigenproblem and inexact solves with a decreasing solve tolerance. Moreover, the simultaneous solution of the forward and adjoint problem arising in two‐sided methods is considered, and the successful tuning strategy for preconditioners is extended to two‐sided methods, creating a novel way of preconditioning two‐sided algorithms. Furthermore, it is shown that inexact two‐sided Rayleigh quotient iteration and the inexact two‐sided Jacobi‐Davidson method (without subspace expansion) applied to the generalized preconditioned eigenvalue problem are equivalent when a certain number of steps of a Petrov–Galerkin–Krylov method is used and when this specific tuning strategy is applied. Copyright © 2014 John Wiley & Sons, Ltd.     

求解大规模Hamilton矩阵特征问题的辛Lanczos算法的误差分析

对求解大规模稀疏Hamilton矩阵特征问题的辛Lanczos算法给出了舍入误差分析.分析表明辛Lanczos算法在无中断时,保Hamilton结构的限制没有破坏非对称Lanczos算法的本质特性.本文还讨论了辛Lanczos算法计算出的辛Lanczos向量的J一正交性的损失与Ritz值收敛的关系.结论正如所料,当某些Ritz值开始收敛时.计算出的辛Lanczos向量的J-正交性损失是必然的.以上结果对辛Lanczos算法的改进具有理论指导意义.     

Convergence estimates of nonrestarted and restarted block‐Lanczos methods

The block‐Lanczos method serves to compute a moderate number of eigenvalues and the corresponding invariant subspace of a symmetric matrix. In this paper, the convergence behavior of nonrestarted and restarted versions of the block‐Lanczos method is analyzed. For the nonrestarted version, we improve an estimate by Saad by means of a change of the auxiliary vector so that the new estimate is much more accurate in the case of clustered or multiple eigenvalues. For the restarted version, an estimate by Knyazev is generalized by extending our previous results on block steepest descent iterations and single‐vector restarted Krylov subspace iterations. The new estimates can also be reformulated and applied to invert‐block‐Lanczos methods for solving generalized matrix eigenvalue problems.     

Polynomial splines and eigenvalue approximations on quantum graphs

A notion of splines is introduced on a quantum graph Γ. It is shown that eigen values of a Hamiltonian on a finite graph Γ can be determined as limits of eigenvalues of certain finite-dimensional operators in spaces of polynomial splines on Γ. In particular, a bounded set of eigenvalues can be determined using a space of such polynomial splines with a fixed set of singularities. It is also shown that corresponding eigenfunctions can be reconstructed as uniform limits of the same polynomial splines with appropriate fixed set of singularities.     

Krylov eigenvalue strategy using the FEAST algorithm with inexact system solves

The FEAST eigenvalue algorithm is a subspace iteration algorithm that uses contour integration to obtain the eigenvectors of a matrix for the eigenvalues that are located in any user‐defined region in the complex plane. By computing small numbers of eigenvalues in specific regions of the complex plane, FEAST is able to naturally parallelize the solution of eigenvalue problems by solving for multiple eigenpairs simultaneously. The traditional FEAST algorithm is implemented by directly solving collections of shifted linear systems of equations; in this paper, we describe a variation of the FEAST algorithm that uses iterative Krylov subspace algorithms for solving the shifted linear systems inexactly. We show that this iterative FEAST algorithm (which we call IFEAST) is mathematically equivalent to a block Krylov subspace method for solving eigenvalue problems. By using Krylov subspaces indirectly through solving shifted linear systems, rather than directly using them in projecting the eigenvalue problem, it becomes possible to use IFEAST to solve eigenvalue problems using very large dimension Krylov subspaces without ever having to store a basis for those subspaces. IFEAST thus combines the flexibility and power of Krylov methods, requiring only matrix–vector multiplication for solving eigenvalue problems, with the natural parallelism of the traditional FEAST algorithm. We discuss the relationship between IFEAST and more traditional Krylov methods and provide numerical examples illustrating its behavior.     

Error Estimates for Rayleigh–Ritz Approximations of Eigenvalues and Eigenfunctions of the Mathieu and Spheroidal Wave Equation

Error estimates are derived for the computation of eigenvalues and eigenvectors of infinite tridiagonal matrices by the Rayleigh–Ritz method. The results are applied to the Mathieu and spheroidal wave equation.     

A block Arnoldi-type contour integral spectral projection method for solving generalized eigenvalue problems

For generalized eigenvalue problems, we consider computing all eigenvalues located in a certain region and their corresponding eigenvectors. Recently, contour integral spectral projection methods have been proposed for solving such problems. In this study, from the analysis of the relationship between the contour integral spectral projection and the Krylov subspace, we conclude that the Rayleigh–Ritz-type of the contour integral spectral projection method is mathematically equivalent to the Arnoldi method with the projected vectors obtained from the contour integration. By this Arnoldi-based interpretation, we then propose a block Arnoldi-type contour integral spectral projection method for solving the eigenvalue problem.     

Interaction of faults under slip‐dependent friction. Non‐linear eigenvalue analysis

We analyse the evolution of a system of finite faults by considering the non‐linear eigenvalue problems associated to static and dynamic solutions on unbounded domains. We restrict our investigation to the first eigenvalue (Rayleigh quotient). We point out its physical significance through a stability analysis and we give an efficient numerical algorithm able to compute it together with the corresponding eigenfunction. We consider the anti‐plane shearing on a system of finite faults under a slip‐dependent friction in a linear elastic domain, not necessarily bounded. The static problem is formulated in terms of local minima of the energy functional. We introduce the non‐linear (static) eigenvalue problem and we prove the existence of a first eigenvalue/eigenfunction characterizing the isolated local minima. For the dynamic problem, we discuss the existence of solutions with an exponential growth, to deduce a (dynamic) non‐linear eigenvalue problem. We prove the existence of a first dynamic eigenvalue and we analyse its behaviour with respect to the friction parameter. We deduce a mixed finite element discretization of the non‐linear spectral problem and we give a numerical algorithm to approach the first eigenvalue/eigenfunction. Finally we give some numerical results which include convergence tests, on a single fault and a two‐faults system, and a comparison between the non‐linear spectral results and the time evolution results. Copyright © 2004 John Wiley & Sons, Ltd.