A high-dimensional test for the equality of the smallest eigenvalues of a covariance matrix

For the test of sphericity, Ledoit and Wolf [Ann. Statist. 30 (2002) 1081-1102] proposed a statistic which is robust against high dimensionality. In this paper, we consider a natural generalization of their statistic for the test that the smallest eigenvalues of a covariance matrix are equal. Some inequalities are obtained for sums of eigenvalues and sums of squared eigenvalues. These bounds permit us to obtain the asymptotic null distribution of our statistic, as the dimensionality and sample size go to infinity together, by using distributional results obtained by Ledoit and Wolf [Ann. Statist. 30 (2002) 1081-1102]. Some empirical results comparing our test with the likelihood ratio test are also given.     

The study of Jacobi and cyclic Jacobi matrix eigenvalue problems using Sturm-Liouville theory

We study the eigenvalues of matrix problems involving Jacobi and cyclic Jacobi matrices as functions of certain entries. Of particular interest are the limits of the eigenvalues as these entries approach infinity. Our approach is to use the recently discovered equivalence between these problems and a class of Sturm-Liouville problems and then to apply the Sturm-Liouville theory.     

On a class of Jacobi-like procedures for diagonalising arbitrary real matrices

Summary A new class of elementary matrices is presented which are convenient in Jacobi-like diagonalisation methods for arbitrary real matrices. It is shown that the presented transformations possess the normreducing property and that they produce an ultimate quadratic convergence even in the case of complex eigenvalues. Finally, a quadratically convergent Jacobi-like algorithm for real matrices with complex eigenvalues is presented.     

Rank-one modification of the symmetric eigenproblem

Summary An algorithm is presented for computing the eigensystem of the rank-one modification of a symmetric matrix with known eigensystem. The explicit computation of the updated eigenvectors and the treatment of multiple eigenvalues are discussed. The sensitivity of the computed eigenvectors to errors in the updated eigenvalues is shown by a perturbation analysis.Support for this research was provided by NSF grants MCS 75-06510 and MCS 76-03139Support for this research was provided by the Applied Mathematics Division, Argonne National Laboratory, Argonne, IL 60439, USA     

An eigenvalue localization theorem for pentadiagonal symmetric Toeplitz matrices

We express the eigenvalues of a pentadiagonal symmetric Toeplitz matrix as the zeros of explicitly given rational functions.     

Instability indices for matrix polynomials

There is a well-established instability index theory for linear and quadratic matrix polynomials for which the coefficient matrices are Hermitian and skew-Hermitian. This theory relates the number of negative directions for the matrix coefficients which are Hermitian to the total number of unstable eigenvalues for the polynomial. Herein we extend the theory to ?-even matrix polynomials of any finite degree. In particular, unlike previously known cases we show that the instability index depends upon the size of the matrices when the degree of the polynomial is greater than two. We also consider Hermitian matrix polynomials, and derive an index which counts the number of eigenvalues with nonpositive imaginary part. The results are refined if we consider the Hermitian matrix polynomial to be a perturbation of a ?-even polynomials; however, this refinement requires additional assumptions on the matrix coefficients.     

Distribution of eigenvalues and eigenvectors of Wishart matrix when the population eigenvalues are infinitely dispersed and its application to minimax estimation of covariance matrix

We consider the asymptotic joint distribution of the eigenvalues and eigenvectors of Wishart matrix when the population eigenvalues become infinitely dispersed. We show that the normalized sample eigenvalues and the relevant elements of the sample eigenvectors are asymptotically all mutually independently distributed. The limiting distributions of the normalized sample eigenvalues are chi-squared distributions with varying degrees of freedom and the distribution of the relevant elements of the eigenvectors is the standard normal distribution. As an application of this result, we investigate tail minimaxity in the estimation of the population covariance matrix of Wishart distribution with respect to Stein's loss function and the quadratic loss function. Under mild regularity conditions, we show that the behavior of a broad class of tail minimax estimators is identical when the sample eigenvalues become infinitely dispersed.     

Generalized even and odd totally positive matrices

A generalization of the definition of an oscillatory matrix based on the theory of cones is given in this paper. The positivity and simplicity of all the eigenvalues of a generalized oscillatory matrix are proved. Classes of generalized even and odd oscillatory matrices are introduced. Spectral properties of the obtained matrices are studied. Criteria of generalized even and odd oscillation are given. Examples of generalized even and odd oscillatory matrices are presented.     

Eigenvalues of a symmetric tridiagonal matrix: A divide-and-conquer approach

Summary The Symmetric Tridiagonal Eigenproblem has been the topic of some recent work. Many methods have been advanced for the computation of the eigenvalues of such a matrix. In this paper, we present a divide-and-conquer approach to the computation of the eigenvalues of a symmetric tridiagonal matrix via the evaluation of the characteristic polynomial. The problem of evaluation of the characteristic polynomial is partitioned into smaller parts which are solved and these solutions are then combined to form the solution to the original problem. We give the update equations for the characteristic polynomial and certain auxiliary polynomials used in the computation. Furthermore, this set of recursions can be implemented on a regulartree structure. If the concurrency exhibited by this algorithm is exploited, it can be shown that thetime for computation of all the eigenvalues becomesO(nlogn) instead ofO(n ²) as is the case for the approach where the order is increased by only one at every step. We address the numerical problems associated with the use of the characteristic polynomial and present a numerically stable technique for the eigenvalue computation.     

On the global convergence of the Eberlein method for real matrices

Summary The global convergence proof of the column-and row-cyclic Eberlein diagonalization process for real matrices is given. The convergence to a fixed matrix in Murnaghan form is obtained with the well-known exception of complex-conjugate pairs of eigenvalues whose real parts are more than double.     

A numerically stable, structure preserving method for computing the eigenvalues of real Hamiltonian or symplectic pencils

A new method is presented for the numerical computation of the generalized eigenvalues of real Hamiltonian or symplectic pencils and matrices. The method is numerically backward stable and preserves the structure (i.e., Hamiltonian or symplectic). In the case of a Hamiltonian matrix the method is closely related to the square reduced method of Van Loan, but in contrast to that method which may suffer from a loss of accuracy of order , where is the machine precision, the new method computes the eigenvalues to full possible accuracy. Received April 8, 1996 / Revised version received December 20, 1996     

Eigenvalues of graded matrices and the condition numbers of a multiple eigenvalue

Summary This paper concerns two closely related topics: the behavior of the eigenvalues of graded matrices and the perturbation of a nondefective multiple eigenvalue. We will show that the eigenvalues of a graded matrix tend to share the graded structure of the matrix and give precise conditions insuring that this tendency is realized. These results are then applied to show that the secants of the canonical angles between the left and right invariant of a multiple eigenvalue tend to characterize its behavior when its matrix is slightly perturbed.This work was supported in part by the Air Force Office of Sponsored Research under Contract AFOSR-87-0188     

The Lidskii-Mirsky-Wielandt theorem – additive and multiplicative versions

Summary. We use a simple matrix splitting technique to give an elementary new proof of the Lidskii-Mirsky-Wielandt Theorem and to obtain a multiplicative analog of the Lidskii-Mirsky-Wielandt Theorem, which we argue is the fundamental bound in the study of relative perturbation theory for eigenvalues of Hermitian matrices and singular values of general matrices. We apply our bound to obtain numerous bounds on the matching distance between the eigenvalues and singular values of matrices. Our results strengthen and generalize those in the literature. Received November 20, 1996 / Revised version received January 27, 1998     

An accelerated bisection method for the calculation of eigenvalues of a symmetric tridiagonal matrix

Summary We present a method for the determination of eigenvalues of a symmetric tridiagonal matrix which combines Givens' Sturm bisection [4, 5] with interpolation, to accelerate convergence in high precision cases. By using an appropriate root of the absolute value of the determinant to derive the interpolation weight, results are obtained which compare favorably with the Barth, Martin, Wilkinson algorithm [1].     

Some high-dimensional tests for a one-way MANOVA

A statistic is proposed for testing the equality of the mean vectors in a one-way multivariate analysis of variance. The asymptotic null distribution of this statistic, as both the sample size and the number of variables go to infinity, is shown to be normal. Thus, this test can be used when the number of variables is not small relative to the sample size. In particular, it can be used when the number of variables exceeds the degrees of freedom for error, a situation in which standard MANOVA tests are invalid. A related statistic, also having an asymptotic normal distribution, is developed for tests concerning the dimensionality of the hyperplane formed by the population mean vectors. The finite sample size performances of the normal approximations are evaluated in a simulation study.     

On a model selection problem from high-dimensional sample covariance matrices

Modern random matrix theory indicates that when the population size p is not negligible with respect to the sample size n, the sample covariance matrices demonstrate significant deviations from the population covariance matrices. In order to recover the characteristics of the population covariance matrices from the observed sample covariance matrices, several recent solutions are proposed when the order of the underlying population spectral distribution is known. In this paper, we deal with the underlying order selection problem and propose a solution based on the cross-validation principle. We prove the consistency of the proposed procedure.     

Sum rules for hitting times of Markov chains

Using matrix algebra we obtain a general equation for the sum, normalized with suitable constants, of all the expected hitting times in an ergodic Markov chain. This equation yields as corollaries, among others, Broder and Karlin’s formula, Foster’s nth formula and an expression of the Kirchhoff index in terms of the eigenvalues of the Laplacian.     

Numerical methods for finding multiple eigenvalues of matrices depending on parameters

Summary. Let be a square matrix dependent on parameters and , of which we choose as the eigenvalue parameter. Many computational problems are equivalent to finding a point such that has a multiple eigenvalue at . An incomplete decomposition of a matrix dependent on several parameters is proposed. Based on the developed theory two new algorithms are presented for computing multiple eigenvalues of with geometric multiplicity . A third algorithm is designed for the computation of multiple eigenvalues with geometric multiplicity but which also appears to have local quadratic convergence to semi-simple eigenvalues. Convergence analyses of these methods are given. Several numerical examples are presented which illustrate the behaviour and applications of our methods. Received December 19, 1994 / Revised version received January 18, 1996     

Bounds on the error of an approximate invariant subspace for non-self-adjoint matrices

Summary. Suppose one approximates an invariant subspace of an matrix in which in not necessarily self--adjoint. Suppose that one also has an approximation for the corresponding eigenvalues. We consider the question of how good the approximations are. Specifically, we develop bounds on the angle between the approximating subspace and the invariant subspace itself. These bounds are functions of the following three terms: (1) the residual of the approximations; (2) singular--value separation in an associated matrix; and (3) the goodness of the approximations to the eigenvalues. Received December 1, 1992 / Revised version received October 20, 1993