Nonnull distribution of likelihood ratio criterion for reality of covariance matrix

In this paper the distribution of the likelihood ratio test for testing the reality of the covariance matrix of a complex multivariate normal distribution is investigated. Some simplifications in the noncentral distribution are made and the noncentral distribution is derived for the special case where the rank of the noncentrality matrix is two. In the null case exact expressions for the distribution are given up to p = 6, and percentage points are tabulated. These percentage points were compared with percentage points derived from an asymptotic expansion of the distribution, and the accuracy of the approximation was found to be sufficient for several practical situations.     

Asymptotic theory for maximum deviations of sample covariance matrix estimates

We consider asymptotic distributions of maximum deviations of sample covariance matrices, a fundamental problem in high-dimensional inference of covariances. Under mild dependence conditions on the entries of the data matrices, we establish the Gumbel convergence of the maximum deviations. Our result substantially generalizes earlier ones where the entries are assumed to be independent and identically distributed, and it provides a theoretical foundation for high-dimensional simultaneous inference of covariances.     

Asymptotic nonnull distributions of certain test criteria for a covariance matrix

Asymptotic expansions of the distributions of two test criteria concerning a covariance matrix are derived under local alternatives in terms of noncentral χ² variates, and under the fixed alternative in terms of standard normal distribution function and its derivatives, respectively. Some numerical comparisons with the likelihood ratio criteria are made with these test criteria.     

A high-dimensional test for the equality of the smallest eigenvalues of a covariance matrix

For the test of sphericity, Ledoit and Wolf [Ann. Statist. 30 (2002) 1081-1102] proposed a statistic which is robust against high dimensionality. In this paper, we consider a natural generalization of their statistic for the test that the smallest eigenvalues of a covariance matrix are equal. Some inequalities are obtained for sums of eigenvalues and sums of squared eigenvalues. These bounds permit us to obtain the asymptotic null distribution of our statistic, as the dimensionality and sample size go to infinity together, by using distributional results obtained by Ledoit and Wolf [Ann. Statist. 30 (2002) 1081-1102]. Some empirical results comparing our test with the likelihood ratio test are also given.     

Some tests for the covariance matrix with fewer observations than the dimension under non-normality

This article analyzes whether some existing tests for the p×p covariance matrix Σ of the N independent identically distributed observation vectors work under non-normality. We focus on three hypotheses testing problems: (1) testing for sphericity, that is, the covariance matrix Σ is proportional to an identity matrix I_p; (2) the covariance matrix Σ is an identity matrix I_p; and (3) the covariance matrix is a diagonal matrix. It is shown that the tests proposed by Srivastava (2005) for the above three problems are robust under the non-normality assumption made in this article irrespective of whether N≤p or N≥p, but (N,p)→∞, and N/p may go to zero or infinity. Results are asymptotic and it may be noted that they may not hold for finite (N,p).     

Third-order power comparisons for a class of tests for multivariate linear hypothesis under general distributions

The purpose of this paper is, in multivariate linear regression model (Part I) and GMANOVA model (Part II), to investigate the effect of nonnormality upon the nonnull distributions of some multivariate test statistics under normality. It is shown that whatever the underlying distributions, the difference of local powers up to order N⁻¹ after either Bartlett’s type adjustment or Cornish-Fisher’s type size adjustment under nonnormality coincides with that in Anderson [An Introduction to Multivariate Statistical Analysis, 2nd ed. and 3rd ed., Wiley, New York, 1984, 2003] under normality. The derivation of asymptotic expansions is based on the differential operator associated with the multivariate linear regression model under general distributions. The performance of higher-order results in finite samples, including monotone Bartlett’s type adjustment and monotone Cornish-Fisher’s type size adjustment, is examined using simulation studies.     

Asymptotic distributions of the latent roots of the covariance matrix with multiple population roots

An asymptotic expansion for large sample size n is derived by a partial differential equation method, up to and including the term of order n^?2, for the ₀F₀ function with two argument matrices which arise in the joint density function of the latent roots of the covariance matrix, when some of the population latent roots are multiple. Then we derive asymptotic expansions for the joint and marginal distributions of the sample roots in the case of one multiple root.     

A comparison of higher-order local powers of a class of one-way MANOVA tests under general distributions

The purpose of this paper is to investigate the effect of nonnormality upon the nonnull distributions of some MANOVA test statistics under normality. It is shown that whatever the underlying distributions, the difference of the local powers up to order N^-1 (N is the total number of observations) after either Bartlett's type adjustment or Cornish-Fisher's type adjustment under nonnormality coincides with that in Anderson [An Introduction to Multivariate Statistical Analysis, second ed., 1984 and third ed., 2003, Wiley, New York] under normality. The performance of higher-order results in finite samples is examined using simulation studies.     

Some high-dimensional tests for a one-way MANOVA

A statistic is proposed for testing the equality of the mean vectors in a one-way multivariate analysis of variance. The asymptotic null distribution of this statistic, as both the sample size and the number of variables go to infinity, is shown to be normal. Thus, this test can be used when the number of variables is not small relative to the sample size. In particular, it can be used when the number of variables exceeds the degrees of freedom for error, a situation in which standard MANOVA tests are invalid. A related statistic, also having an asymptotic normal distribution, is developed for tests concerning the dimensionality of the hyperplane formed by the population mean vectors. The finite sample size performances of the normal approximations are evaluated in a simulation study.     

Near-exact distributions for the independence and sphericity likelihood ratio test statistics

In this paper we show how, based on a decomposition of the likelihood ratio test for sphericity into two independent tests and a suitably developed decomposition of the characteristic function of the logarithm of the likelihood ratio test statistic to test independence in a set of variates, we may obtain extremely well-fitting near-exact distributions for both test statistics. Since both test statistics have the distribution of the product of independent Beta random variables, it is possible to obtain near-exact distributions for both statistics in the form of Generalized Near-Integer Gamma distributions or mixtures of these distributions. For the independence test statistic, numerical studies and comparisons with asymptotic distributions proposed by other authors show the extremely high accuracy of the near-exact distributions developed as approximations to the exact distribution. Concerning the sphericity test statistic, comparisons with formerly developed near-exact distributions show the advantages of these new near-exact distributions.     

On the evaluation of some distributions that arise in simultaneous tests for the equality of the latent roots of the covariance matrix

In this paper, the authors consider the evaluation of the distribution functions of the ratios of the intermediate roots to the trace of the real Wishart matrix as well as the ratios of the individual roots to the trace of the complex Wishart matrix. In addition, the authors consider the evaluation of the distribution functions of the ratios of the extreme roots of the Wishart matrix in the real and complex cases. Some applications and tables of the above distributions are also given.     

The likelihood ratio tests for the dimensionality of regression coefficients

In this paper we give a unified derivation of the likelihood ratio (LR) statistics for testing the hypothesis on the dimensionality of regression coefficients under a usual MANOVA model. We also derive the LR statistics under a general MANOVA model and study their asymptotic null and nonnull distributions. Further it is shown that the test statistic used by Bartlett [4] for testing the hypothesis that the last p?k canonical correlations are all zero is the LR statistic.     

On testing for clusters using the sample covariance

This paper analyzes the problem of using the sample covariance matrix to detect the presence of clustering in p-variate data in the special case when the component covariance matrices are known up to a constant multiplier. For the case of testing one population against a mixture of two populations, tests are derived and shown to be optimal in a certain sense. Some of their distribution properties are derived exactly. Some remarks on the extensions of these tests to mixtures of k ≤ p populations are included. The paper is essentially a formal treatment (in a special case) of some well-known procedures. The methods used in deriving the distribution properties are applicable to a variety of other situations involving mixtures.     

On the distribution of the ratio of the largest eigenvalue to the trace of a Wishart matrix

The ratio of the largest eigenvalue divided by the trace of a p×p random Wishart matrix with n degrees of freedom and an identity covariance matrix plays an important role in various hypothesis testing problems, both in statistics and in signal processing. In this paper we derive an approximate explicit expression for the distribution of this ratio, by considering the joint limit as both p,n→∞ with p/n→c. Our analysis reveals that even though asymptotically in this limit the ratio follows a Tracy-Widom (TW) distribution, one of the leading error terms depends on the second derivative of the TW distribution, and is non-negligible for practical values of p, in particular for determining tail probabilities. We thus propose to explicitly include this term in the approximate distribution for the ratio. We illustrate empirically using simulations that adding this term to the TW distribution yields a quite accurate expression to the empirical distribution of the ratio, even for small values of p,n.     

Asymptotic distribution of Wishart matrix for block-wise dispersion of population eigenvalues

This paper deals with the asymptotic distribution of Wishart matrix and its application to the estimation of the population matrix parameter when the population eigenvalues are block-wise infinitely dispersed. We show that the appropriately normalized eigenvectors and eigenvalues asymptotically generate two Wishart matrices and one normally distributed random matrix, which are mutually independent. For a family of orthogonally equivariant estimators, we calculate the asymptotic risks with respect to the entropy or the quadratic loss function and derive the asymptotically best estimator among the family. We numerically show (1) the convergence in both the distributions and the risks are quick enough for a practical use, (2) the asymptotically best estimator is robust against the deviation of the population eigenvalues from the block-wise infinite dispersion.     

Asymptotic expansions for distributions of latent roots in multivariate analysis

Asymptotic expansions are given for the distributions of latent roots of matrices in three multivariate situations. The distribution of the roots of the matrix S₁(S₁ + S₂)^?1, where S₁ is $\text{W}{}_{\mathrm{<mtext>m</mtext>}}\text{(n}{}_1\text{, Σ, Ω)}$ and S₂ is W_m(n₂, Σ), is studied in detail and asymptotic series for the distribution are obtained which are valid for some or all of the roots of the noncentrality matrix Ω large. These expansions are obtained using partial-differential equations satisfied by the distribution. Asymptotic series are also obtained for the distributions of the roots of n^?1S, where S in W_m(n, Σ), for large n, and S₁S₂^?1, where S₁ is W_m(n₁, Σ) and S₂ is W_m(n₂, Σ), for large n₁ + n₂.     

Asymptotic expansions of the distributions of estimators in canonical correlation analysis under nonnormality

Asymptotic expansions of the distributions of typical estimators in canonical correlation analysis under nonnormality are obtained. The expansions include the Edgeworth expansions up to order O(1/n) for the parameter estimators standardized by the population standard errors, and the corresponding expansion by Hall's method with variable transformation. The expansions for the Studentized estimators are also given using the Cornish-Fisher expansion and Hall's method. The parameter estimators are dealt with in the context of estimation for the covariance structure in canonical correlation analysis. The distributions of the associated statistics (the structure of the canonical variables, the scaled log likelihood ratio and Rozeboom's between-set correlation) are also expanded. The robustness of the normal-theory asymptotic variances of the sample canonical correlations and associated statistics are shown when a latent variable model holds. Simulations are performed to see the accuracy of the asymptotic results in finite samples.     

Power comparisons of two-sided tests of equality of two covariance matrices based on six criteria

Power studies of tests of equality of covariance matrices of twop-variate normal populations Σ₁=Σ₂ against two-sided alternatives have been made based on the following six criteria: 1) Roy's largest root, 2) Hotelling's trace, 3) Pillai's trace, 4) Wilks' criterion, 5) Roy's largest-smallest roots and 6) modified likelihood ratio. A general theorem has been proved establishing the local unbiasedness conditions connecting the two critical values for tests 1) to 5). Extensive unbiased power tabulations have been made forp=2, for various values ofn ₁,n ₂, λ₁ and λ₂ wheren _i is the df of the SP matrix from theith sample and λ _i is theith latent root of Σ₁Σ ₂ ⁻¹ (i=1,2). Further, comparisons of powers of tests 1) to 5) have been made with those of the modified likelihood ratio after obtaining the exact distribution of the latter forn ₂=2n ₁ andp=2. Equal tail areas approach has also been used further to compute powers of tests 1) to 4) forp=2 for studying the bias. Again, a separate study has been made to compare the powers of the largest-smallest roots test with its three biased approximate approaches as well as the largest root. Since the largest root test was observed to have some advantage over the others, critical values were also obtained for this test in the unbiased as well as equal tail areas case forp=3. This research was supported by David Ross Grant from Purdue University. S. Sylvia Chu is now with Northwestern University.