Testing the equality of several covariance matrices with fewer observations than the dimension

For normally distributed data from the k populations with m×m covariance matrices Σ₁,…,Σ_k, we test the hypothesis H:Σ₁=?=Σ_k vs the alternative A≠H when the number of observations N_i, i=1,…,k from each population are less than or equal to the dimension m, N_i≤m, i=1,…,k. Two tests are proposed and compared with two other tests proposed in the literature. These tests, however, do not require that N_i≤m, and thus can be used in all situations, including when the likelihood ratio test is available. The asymptotic distributions of the test statistics are given, and the power compared by simulations with other test statistics proposed in the literature. The proposed tests perform well and better in several cases than the other two tests available in the literature.     

Characterization of Wishart-Laplace distributions via Jordan algebra homomorphisms

For a real, Hermitian, or quaternion normal random matrix Y with mean zero, necessary and sufficient conditions for a quadratic form Q(Y) to have a Wishart-Laplace distribution (the distribution of the difference of two independent central Wishart W_p(m_i,Σ) random matrices) are given in terms of a certain Jordan algebra homomorphism ρ. Further, it is shown that {Q_k(Y)} is independent Laplace-Wishart if and only if in addition to the aforementioned conditions, the images ρ_k(Σ⁺) of the Moore-Penrose inverse Σ⁺ of Σ are mutually orthogonal: ρ_k(Σ⁺)ρ_?(Σ⁺)=0 for k≠?.     

The asymptotic distribution of a goodness of fit statistic for factorial invariance

Suppose that random factor models with k factors are assumed to hold for m, p-variate populations. A model for factorial invariance has been proposed wherein the covariance or correlation matrices can be written as Σ_i = LC_iL′ + σ_i²I, where C_i is the covariance matrix of factor variables and L is a common factor loading matrix, i = 1,…, m. Also a goodness of fit statistic has been proposed for this model. The asymptotic distribution of this statistic is shown to be that of a quadratic form in normal variables. An approximation to this distribution is given and thus a test for goodness of fit is derived. The problem of dimension is considered and a numerical example is given to illustrate the results.     

Asymptotic expansions for distributions of latent roots in multivariate analysis

Asymptotic expansions are given for the distributions of latent roots of matrices in three multivariate situations. The distribution of the roots of the matrix S₁(S₁ + S₂)^?1, where S₁ is $\text{W}{}_{\mathrm{<mtext>m</mtext>}}\text{(n}{}_1\text{, Σ, Ω)}$ and S₂ is W_m(n₂, Σ), is studied in detail and asymptotic series for the distribution are obtained which are valid for some or all of the roots of the noncentrality matrix Ω large. These expansions are obtained using partial-differential equations satisfied by the distribution. Asymptotic series are also obtained for the distributions of the roots of n^?1S, where S in W_m(n, Σ), for large n, and S₁S₂^?1, where S₁ is W_m(n₁, Σ) and S₂ is W_m(n₂, Σ), for large n₁ + n₂.     

An asymptotic expansion of the distribution of Rao's U-statistic under a general condition

In this paper we consider the problem of testing the hypothesis about the sub-mean vector. For this propose, the asymptotic expansion of the null distribution of Rao's U-statistic under a general condition is obtained up to order of n^-1. The same problem in the k-sample case is also investigated. We find that the asymptotic distribution of generalized U-statistic in the k-sample case is identical to that of the generalized Hotelling's T² distribution up to n^-1. A simulation experiment is carried out and its results are presented. It shows that the asymptotic distributions have significant improvement when comparing with the limiting distributions both in the small sample case and the large sample case. It also demonstrates the equivalence of two testing statistics mentioned above.     

Asymptotic joint distribution of the largest roots of several multivariate F matrices I. Quasi-independent case

An asymptotic expansion of the joint distribution of k largest characteristic roots C_M⁽ⁱ⁾(S_iS₀^?1), i = 1,…, k, is given, where S'_is and S₀ are independent Wishart matrices with common covariance matrix Σ. The modified second-approximation procedure to the upper percentage points of the maximum of C_M⁽ⁱ⁾(S_iS₀^?1), i = 1,…, k, is also considered. The evaluation of the expansion is based on the idea for studentization due to Welch and James with the use of differential operators and of the perturbation procedure.     

Asymptotic distributions of robust shape matrices and scales

It has been frequently observed in the literature that many multivariate statistical methods require the covariance or dispersion matrix Σ of an elliptical distribution only up to some scaling constant. If the topic of interest is not the scale but only the shape of the elliptical distribution, it is not meaningful to focus on the asymptotic distribution of an estimator for Σ or another matrix Γ∝Σ. In the present work, robust estimators for the shape matrix and the associated scale are investigated. Explicit expressions for their joint asymptotic distributions are derived. It turns out that if the joint asymptotic distribution is normal, the estimators presented are asymptotically independent for one and only one specific choice of the scale function. If it is non-normal (this holds for example if the estimators for the shape matrix and scale are based on the minimum volume ellipsoid estimator) only the scale function presented leads to asymptotically uncorrelated estimators. This is a generalization of a result obtained by Paindaveine [D. Paindaveine, A canonical definition of shape, Statistics and Probability Letters 78 (2008) 2240-2247] in the context of local asymptotic normality theory.     

Asymptotically efficient two-sample rank tests for modal directions on spheres

A general class of optimal and distribution-free rank tests for the two-sample modal directions problem on (hyper-) spheres is proposed, along with an asymptotic distribution theory for such spherical rank tests. The asymptotic optimality of the spherical rank tests in terms of power-equivalence to the spherical likelihood ratio tests is studied, while the spherical Wilcoxon rank test, an important case for the class of spherical rank tests, is further investigated. A data set is reanalyzed and some errors made in previous studies are corrected. On the usual sphere, a lower bound on the asymptotic Pitman relative efficiency relative to Hotelling’s T²-type test is established, and a new distribution for which the spherical Wilcoxon rank test is optimal is also introduced.     

Error bounds for asymptotic expansions of Wilks’ lambda distribution

Let Λ=|S_e|/|S_e+S_h|, where S_h and S_e are independently distributed as Wishart distributions W_p(q,Σ) and W_p(n,Σ), respectively. Then Λ has Wilks’ lambda distribution Λ_p,q,n which appears as the distributions of various multivariate likelihood ratio tests. This paper is concerned with theoretical accuracy for asymptotic expansions of the distribution of T=-nlogΛ. We derive error bounds for the approximations. It is necessary to underline that our error bounds are given in explicit and computable forms.     

On the structure of the Wishart distribution

In this paper it is shown that every nonnegative definite symmetric random matrix with independent diagonal elements and at least one nondegenerate nondiagonal element has a noninfinitely divisible distribution. Using this result it is established that every Wishart distribution W_p(k, Σ, M) with both p and rank (Σ) ≥ 2 is noninfinitely divisible. The paper also establishes that any Wishart matrix having distribution W_p(k, Σ, 0) has the joint distribution of its elements in the rth row and rth column to be infinitely divisible for every r = 1,2,…,p.     

Invariant scale matrix hypothesis tests under elliptical symmetry

The usual assumption in multivariate hypothesis testing is that the sample consists of n independent, identically distributed Gaussian m-vectors. In this paper this assumption is weakened by considering a class of distributions for which the vector observations are not necessarily either Gaussian or independent. This class contains the elliptically symmetric laws with densities of the form f(X(n × m)) = ψ[tr(X ? M)′ (X ? M)Σ^?1]. For testing the equality of k scale matrices and for the sphericity hypothesis it is shown, by using the structure of the underlying distribution rather than any specific form of the density, that the usual invariant normal-theory tests are exactly robust, for both the null and non-null cases, under this wider class.     

Some tests for the covariance matrix with fewer observations than the dimension under non-normality

This article analyzes whether some existing tests for the p×p covariance matrix Σ of the N independent identically distributed observation vectors work under non-normality. We focus on three hypotheses testing problems: (1) testing for sphericity, that is, the covariance matrix Σ is proportional to an identity matrix I_p; (2) the covariance matrix Σ is an identity matrix I_p; and (3) the covariance matrix is a diagonal matrix. It is shown that the tests proposed by Srivastava (2005) for the above three problems are robust under the non-normality assumption made in this article irrespective of whether N≤p or N≥p, but (N,p)→∞, and N/p may go to zero or infinity. Results are asymptotic and it may be noted that they may not hold for finite (N,p).     

Representations for eigenfunctions of expected value operators in the Wishart distribution

Recent articles by Kushner and Meisner (1980) and Kushner, Lebow and Meisner (1981) have posed the problem of characterising the ‘EP’ functions f(S) for which Ef(S) for which E(f(S)) = λ_nf(Σ) for some λ_n ? $\text{R}$, whenever the m × m matrix S has the Wishart distribution W(m, n, Σ). In this article we obtain integral representations for all nonnegative EP functions. It is also shown that any bounded EP function is harmonic, and that EP polynomials may be used to approximate the functions in certain L^p spaces.     

Multivariate analysis of variance with fewer observations than the dimension

In this article, we consider the problem of testing a linear hypothesis in a multivariate linear regression model which includes the case of testing the equality of mean vectors of several multivariate normal populations with common covariance matrix Σ, the so-called multivariate analysis of variance or MANOVA problem. However, we have fewer observations than the dimension of the random vectors. Two tests are proposed and their asymptotic distributions under the hypothesis as well as under the alternatives are given under some mild conditions. A theoretical comparison of these powers is made.     

Optimum two level fractional factorial plans for model identification and discrimination

Model identification and discrimination are two major statistical challenges. In this paper we consider a set of models M_k for factorial experiments with the parameters representing the general mean, main effects, and only k out of all two-factor interactions. We consider the class D of all fractional factorial plans with the same number of runs having the ability to identify all the models in M_k, i.e., the full estimation capacity.The fractional factorial plans in D with the full estimation capacity for k?2 are able to discriminate between models in M_u for u?k^*, where k^*=(k/2) when k is even, k^*=((k-1)/2) when k is odd. We obtain fractional factorial plans in D satisfying the six optimality criterion functions AD, AT, AMCR, GD, GT, and GMCR for 2^m factorial experiments when m=4 and 5. Both single stage and multi-stage (hierarchical) designs are given. Some results on estimation capacity of a fractional factorial plan for identifying models in M_k are also given. Our designs D4.1 and D10 stand out in their performances relative to the designs given in Li and Nachtsheim [Model-robust factorial designs, Technometrics 42(4) (2000) 345-352.] for m=4 and 5 with respect to the criterion functions AD, AT, AMCR, GD, GT, and GMCR. Our design D4.2 stands out in its performance relative the Li-Nachtsheim design for m=4 with respect to the four criterion functions AT, AMCR, GT, and GMCR. However, the Li-Nachtsheim design for m=4 stands out in its performance relative to our design D4.2 with respect to the criterion functions AD and GD. Our design D14 does have the full estimation capacity for k=5 but the twelve run Li-Nachtsheim design does not have the full estimation capacity for k=5.     

Nonparametric estimation of mixed partial derivatives of a multivariate density

On the basis of a random sample of size n on an m-dimensional random vector X, this note proposes a class of estimators f_n^(p) of f^(p), where f is a density of X w.r.t. a σ-finite measure dominated by the Lebesgue measure on R^m, p = (p₁,…,p_m), p_j ≥ 0, fixed integers, and for x = (x₁,…,x_m) in R^m, f^(p)(x) = ?^p₁+…+p_m f(x)/(?^p₁x₁ … ?^p_mx_m). Asymptotic unbiasedness as well as both almost sure and mean square consistencies of f_n^(p) are examined. Further, a necessary and sufficient condition for uniform asymptotic unbisedness or for uniform mean square consistency of f_n^(p) is given. Finally, applications of estimators of this note to certain statistical problems are pointed out.     

Asymptotic confidence intervals for Poisson regression

Let (X,Y) be a R^d×N₀-valued random vector where the conditional distribution of Y given X=x is a Poisson distribution with mean m(x). We estimate m by a local polynomial kernel estimate defined by maximizing a localized log-likelihood function. We use this estimate of m(x) to estimate the conditional distribution of Y given X=x by a corresponding Poisson distribution and to construct confidence intervals of level α of Y given X=x. Under mild regularity conditions on m(x) and on the distribution of X we show strong convergence of the integrated L₁ distance between Poisson distribution and its estimate. We also demonstrate that the corresponding confidence interval has asymptotically (i.e., for sample size tending to infinity) level α, and that the probability that the length of this confidence interval deviates from the optimal length by more than one converges to zero with the number of samples tending to infinity.     

Nonparametric methods for unbalanced multivariate data and many factor levels

We propose different nonparametric tests for multivariate data and derive their asymptotic distribution for unbalanced designs in which the number of factor levels tends to infinity (large a, small n_i case). Quasi gratis, some new parametric multivariate tests suitable for the large a asymptotic case are also obtained. Finite sample performances are investigated and compared in a simulation study. The nonparametric tests are based on separate rankings for the different variables. In the presence of outliers, the proposed nonparametric methods have better power than their parametric counterparts. Application of the new tests is demonstrated using data from plant pathology.     

Unbiased invariant minimum norm estimation in generalized growth curve model

This paper considers the generalized growth curve model subject to R(X_m)⊆R(X_m-1)⊆?⊆R(X₁), where B_i are the matrices of unknown regression coefficients, X_i,Z_i and U are known covariate matrices, i=1,2,…,m, and E splits into a number of independently and identically distributed subvectors with mean zero and unknown covariance matrix Σ. An unbiased invariant minimum norm quadratic estimator (MINQE(U,I)) of tr(CΣ) is derived and the conditions for its optimality under the minimum variance criterion are investigated. The necessary and sufficient conditions for MINQE(U,I) of tr(CΣ) to be a uniformly minimum variance invariant quadratic unbiased estimator (UMVIQUE) are obtained. An unbiased invariant minimum norm quadratic plus linear estimator (MINQLE(U,I)) of is also given. To compare with the existing maximum likelihood estimator (MLE) of tr(CΣ), we conduct some simulation studies which show that our proposed estimator performs very well.     

A multidimensional Newton-Raphson method and its applications to the existence of asymptotic Fn-estimators and their stochastic expansions

Given a suitable function F_n we define a class of estimators called asymptotic F_n-estimators (i.e., estimators which approximate the solution of F_n(θ) = 0). It is proved that this class is nonvoid if appropriate regularity conditions are fulfilled and if one has at hand a suitable initial estimator. Furthermore, it is shown that F_n-estimators admit a stochastic expansion (which enables to give results on asymptotic expansions for the distribution of these estimators).