Computational Krylov‐based methods for large‐scale differential Sylvester matrix problems

In the present paper, we propose Krylov‐based methods for solving large‐scale differential Sylvester matrix equations having a low‐rank constant term. We present two new approaches for solving such differential matrix equations. The first approach is based on the integral expression of the exact solution and a Krylov method for the computation of the exponential of a matrix times a block of vectors. In the second approach, we first project the initial problem onto a block (or extended block) Krylov subspace and get a low‐dimensional differential Sylvester matrix equation. The latter problem is then solved by some integration numerical methods such as the backward differentiation formula or Rosenbrock method, and the obtained solution is used to build the low‐rank approximate solution of the original problem. We give some new theoretical results such as a simple expression of the residual norm and upper bounds for the norm of the error. Some numerical experiments are given in order to compare the two approaches.     

Implementation of exponential Rosenbrock-type integrators

In this paper, we present a variable step size implementation of exponential Rosenbrock-type methods of orders 2, 3 and 4. These integrators require the evaluation of exponential and related functions of the Jacobian matrix. To this aim, the Real Leja Points Method is used. It is shown that the properties of this method combine well with the particular requirements of Rosenbrock-type integrators. We verify our implementation with some numerical experiments in MATLAB, where we solve semilinear parabolic PDEs in one and two space dimensions. We further present some numerical experiments in FORTRAN, where we compare our method with other methods from literature. We find a great potential of our method for non-normal matrices. Such matrices typically arise in parabolic problems with large advection in combination with moderate diffusion and mildly stiff reactions.     

A high order discontinuous Galerkin Nitsche method for elliptic problems with fictitious boundary

We present a discontinuous Galerkin method, based on the classical method of Nitsche, for elliptic problems with an immersed boundary representation on a structured grid. In such methods very small elements typically occur at the boundary, leading to breakdown of the discrete coercivity as well as numerical instabilities. In this work we propose a method that avoids using very small elements on the boundary by associating them to a neighboring element with a sufficiently large intersection with the domain. This construction allows us to prove the crucial inverse inequality that leads to a coercive bilinear form and as a consequence we obtain optimal order a priori error estimates. Furthermore, we prove a bound of the condition number of the stiffness matrix. All the results are valid for polynomials of arbitrary order. We also discuss the implementation of the method and present numerical examples in three dimensions.     

A practical method for solving large-scale TRS

We present a nearly-exact method for the large scale trust region subproblem (TRS) based on the properties of the minimal-memory BFGS method. Our study is concentrated in the case where the initial BFGS matrix can be any scaled identity matrix. The proposed method is a variant of the Moré–Sorensen method that exploits the eigenstructure of the approximate Hessian B, and incorporates both the standard and the hard case. The eigenvalues of B are expressed analytically, and consequently a direction of negative curvature can be computed immediately by performing a sequence of inner products and vector summations. Thus, the hard case is handled easily while the Cholesky factorization is completely avoided. An extensive numerical study is presented, for covering all the possible cases arising in the TRS with respect to the eigenstructure of B. Our numerical experiments confirm that the method is suitable for very large scale problems.     

A preconditioned block Arnoldi method for large scale Lyapunov and algebraic Riccati equations

In the present paper, we propose a preconditioned Newton–Block Arnoldi method for solving large continuous time algebraic Riccati equations. Such equations appear in control theory, model reduction, circuit simulation amongst other problems. At each step of the Newton process, we solve a large Lyapunov matrix equation with a low rank right hand side. These equations are solved by using the block Arnoldi process associated with a preconditioner based on the alternating direction implicit iteration method. We give some theoretical results and report numerical tests to show the effectiveness of the proposed approach.     

A black-box rational Arnoldi variant for Cauchy–Stieltjes matrix functions

Rational Arnoldi is a powerful method for approximating functions of large sparse matrices times a vector. The selection of asymptotically optimal parameters for this method is crucial for its fast convergence. We present and investigate a novel strategy for the automated parameter selection when the function to be approximated is of Cauchy–Stieltjes (or Markov) type, such as the matrix square root or the logarithm. The performance of this approach is demonstrated by numerical examples involving symmetric and nonsymmetric matrices. These examples suggest that our black-box method performs at least as well, and typically better, as the standard rational Arnoldi method with parameters being manually optimized for a given matrix.     

Automated parameter selection for rational Arnoldi approximation of Markov functions

Rational Arnoldi is a powerful method for approximating functions of large sparse matrices times a vector. The selection of asymptotically optimal parameters for this method is crucial for its fast convergence. We present a heuristic for the automated pole selection when the function to be approximated is of Markov type, such as the matrix square root. The performance of this approach is demonstrated at several numerical examples. (© 2011 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Quadrature methods for highly oscillatory linear and non-linear systems of ordinary differential equations: part II

In this paper we present efficient numerical approximation for systems of highly oscillatory ordinary differential equations with matrices of variable coefficients. We assume that the spectrum of the matrix is purely imaginary and the frequency of oscillation grows large. We develop the asymptotic and the Filon-type methods for linear systems with time dependent matrices and we integrate oscillatory quadrature rules with waveform relaxation methods employing the WRF method for non-linear systems. We solve matrix exponential in Lie groups employing Magnus expansion. The methods are illustrated in several numerical examples of interest.     

Optimal matrix-segmentation by rectangles

We study the problem of decomposing a nonnegative matrix into a nonnegative combination of 0-1-matrices whose ones form a rectangle such that the sum of the coefficients is minimal. We present for the case of two rows an easy algorithm that provides an optimal solution which is integral if the given matrix is integral. An additional integrality constraint makes the problem more difficult if the matrix has more than two rows. An algorithm that is based on the revised simplex method and uses only very few Gomory cuts yields exact integral solutions for integral matrices of reasonable size in a short time. For matrices of large dimension we propose a special greedy algorithm that provides sufficiently good results in numerical experiments.     

Weighted and deflated global GMRES algorithms for solving large Sylvester matrix equations

The solution of a large-scale Sylvester matrix equation plays an important role in control and large scientific computations. In this paper, we are interested in the large Sylvester matrix equation with large dimensionA and small dimension B, and a popular approach is to use the global Krylov subspace method. In this paper, we propose three new algorithms for this problem. We first consider the global GMRES algorithm with weighting strategy, which can be viewed as a precondition method. We present three new schemes to update the weighting matrix during iterations. Due to the growth of memory requirements and computational cost, it is necessary to restart the algorithm effectively. The deflation strategy is efficient for the solution of large linear systems and large eigenvalue problems; to the best of our knowledge, little work is done on applying deflation to the (weighted) global GMRES algorithm for large Sylvester matrix equations. We then consider how to combine the weighting strategy with deflated restarting, and propose a weighted global GMRES algorithm with deflation for solving large Sylvester matrix equations. In particular, we are interested in the global GMRES algorithm with deflation, which can be viewed as a special case when the weighted matrix is chosen as the identity. Theoretical analysis is given to show rationality of the new algorithms. Numerical experiments illustrate the numerical behavior of the proposed algorithms.

     

On the convergence of inexact Newton methods for discrete-time algebraic Riccati equations

In this paper, we present a convergence analysis of the inexact Newton method for solving Discrete-time algebraic Riccati equations (DAREs) for large and sparse systems. The inexact Newton method requires, at each iteration, the solution of a symmetric Stein matrix equation. These linear matrix equations are solved approximatively by the alternating directions implicit (ADI) or Smith?s methods. We give some new matrix identities that will allow us to derive new theoretical convergence results for the obtained inexact Newton sequences. We show that under some necessary conditions the approximate solutions satisfy some desired properties such as the d-stability. The theoretical results developed in this paper are an extension to the discrete case of the analysis performed by Feitzinger et al. (2009) [8] for the continuous-time algebraic Riccati equations. In the last section, we give some numerical experiments.     

A comparison of iterative methods to solve complex valued linear algebraic systems

Complex valued linear algebraic systems arise in many important applications. We present analytical and extensive numerical comparisons of some available numerical solution methods. It is advocated, in particular for large scale ill-conditioned problems, to rewrite the complex-valued system in real valued form leading to a two-by-two block system of particular form, for which it is shown that a very efficient and robust preconditioned iterative solution method can be constructed. Alternatively, in many cases it turns out that a simple preconditioner in the form of the sum of the real and the imaginary part of the matrix also works well but involves complex arithmetic.     

A randomized tensor singular value decomposition based on the t‐product

The tensor SVD (t‐SVD) for third‐order tensors, previously proposed in the literature, has been applied successfully in many fields, such as computed tomography, facial recognition, and video completion. In this paper, we propose a method that extends a well‐known randomized matrix method to the t‐SVD. This method can produce a factorization with similar properties to the t‐SVD, but it is more computationally efficient on very large data sets. We present details of the algorithms and theoretical results and provide numerical results that show the promise of our approach for compressing and analyzing image‐based data sets. We also present an improved analysis of the randomized and simultaneous iteration for matrices, which may be of independent interest to the scientific community. We also use these new results to address the convergence properties of the new and randomized tensor method as well.     

On the parallel GSAOR method for block diagonally dominant matrices

In this paper we consider the parallel generalized SAOR iterative method based on the generalized AOR iterative method presented by James for solving large nonsingular system. We obtain some convergence theorems for the case when coefficient matrix is a block diagonally dominant matrix or a generalized block diagonal dominant matrix. A numerical example is given to illustrate to our results.     

A SMALLEST SINGULAR VALUE METHOD FOR SOLVING INVERSE EIGENVALUE PROBLEMS

1.IntroductionConsiderthefollowinginverseeigenvalueproblem:ProblemG.LetA(x)ERnxn5earealanalyticmatrix-valuedfunctionofxeR".Findapointx*eR"suchthatthematrixA(x*)ha8agiven8Pectral8etL={Al,'tA.}.HereA1,'1A.aregivencomPlexnum6ersandclosedundercomplexconjugation.Thiskindofproblemarisesofteninvariousareasofapplications(seeFreidlandetal.(1987)andreferencescontainedtherein).ThetwospecialcasesofProblemG,whicharefrequentlyencountered,arethefollowingproblemsproposedbyDowningandHouseholder(19…     

A curvilinear method based on minimal-memory BFGS updates

We present a new matrix-free method for the computation of negative curvature directions based on the eigenstructure of minimal-memory BFGS matrices. We determine via simple formulas the eigenvalues of these matrices and we compute the desirable eigenvectors by explicit forms. Consequently, a negative curvature direction is computed in such a way that avoids the storage and the factorization of any matrix. We propose a modification of the L-BFGS method in which no information is kept from old iterations, so that memory requirements are minimal. The proposed algorithm incorporates a curvilinear path and a linesearch procedure, which combines two search directions; a memoryless quasi-Newton direction and a direction of negative curvature. Results of numerical experiments for large scale problems are also presented.     

Multiparameter regularization for Volterra kernel identification via multiscale collocation methods

Identification of the Volterra system is an ill-posed problem. We propose a regularization method for solving this ill-posed problem via a multiscale collocation method with multiple regularization parameters corresponding to the multiple scales. Many highly nonlinear problems such as flight data analysis demand identifying the system of a high order. This task requires huge computational costs due to processing a dense matrix of a large order. To overcome this difficulty a compression strategy is introduced to approximate the full matrix resulted in collocation of the Volterra kernel by an appropriate sparse matrix. A numerical quadrature strategy is designed to efficiently compute the entries of the compressed matrix. Finally, numerical results of three simulation experiments are presented to demonstrate the accuracy and efficiency of the proposed method.     

A modified Newton’s method for best rank-one approximation to tensors

In this paper, a modified Newton’s method for the best rank-one approximation problem to tensor is proposed. We combine the iterative matrix of Jacobi-Gauss-Newton (JGN) algorithm or Alternating Least Squares (ALS) algorithm with the iterative matrix of GRQ-Newton method, and present a modified version of GRQ-Newton algorithm. A line search along the projective direction is employed to obtain the global convergence. Preliminary numerical experiments and numerical comparison show that our algorithm is efficient.     

A method of solving systems of nonlinear equations of large dimension with banded Jacobian matrix

We consider the concept of bandedness in a matrix. We study iterative methods of solving systems of linear and nonlinear equations of large dimension with a banded Jacobian matrix. We propose a method of computing the row submatrix of a certain full Jacobian matrix that is efficient in a certain sense for numerical differentiation of a vector-valued function of several arguments.Translated fromMatematicheskie Metody i Fiziko-Mekhanicheskie Polya, Issue 36, 1992, pp. 21–24.