Asymptotic expansions for the distributions of functions of a correlation matrix

This paper deals with asymptotic expansions for the non-null distributions of certain test statistics concerning a correlation matrix in a multivariate normal distribution. For this purpose an asymptotic expansion is given for the distribution of a function of the sample correlation matrix. As special cases of the resulting expansion, asymptotic expansions for the distributions of the sample correlation coefficient, Fisher's z-transformation and arcsine transformation are also given.     

Asymptotic distributions for the elementary symmetric functions of two matrices under the assumption of linearity

The asymptotic distributions of the elementary symmetric functions (esf's) of the characteristic roots of a noncentral multivariate beta matrix and of the generalized correlation matrix (noncentral under the assumption of linearity) are derived.     

Noncentral matrix quadratic forms of the skew elliptical variables

In this paper, the noncentral matrix quadratic forms of the skew elliptical variables are studied. A family of the matrix variate noncentral generalized Dirichlet distributions is introduced as the extension of the noncentral Wishart distributions, the Dirichlet distributions and the noncentral generalized Dirichlet distributions. Main distributional properties are investigated. These include probability density and closure property under linear transformation and marginalization, the joint distribution of the sub-matrices of the matrix quadratic forms in the skew elliptical variables and the moment generating functions and Bartlett's decomposition of the matrix quadratic forms in the skew normal variables. Two versions of the noncentral Cochran's Theorem for the matrix variate skew normal distributions are obtained, providing sufficient and necessary conditions for the quadratic forms in the skew normal variables to have the matrix variate noncentral generalized Dirichlet distributions. Applications include the properties of the least squares estimation in multivariate linear model and the robustness property of the Wilk's likelihood ratio statistic in the family of the matrix variate skew elliptical distributions.     

Asymptotic distributions of functions of the eigenvalues of some random matrices for nonnormal populations

The authors investigated the asymptotic joint distributions of certain functions of the eigenvalues of the sample covariance matrix, correlation matrix, and canonical correlation matrix in nonnull situations when the population eigenvalues have multiplicities. These results are derived without assuming that the underlying distribution is multivariate normal. In obtaining these expressions, Edgeworth type expansions were used.     

Some tests for the covariance matrix with fewer observations than the dimension under non-normality

This article analyzes whether some existing tests for the p×p covariance matrix Σ of the N independent identically distributed observation vectors work under non-normality. We focus on three hypotheses testing problems: (1) testing for sphericity, that is, the covariance matrix Σ is proportional to an identity matrix I_p; (2) the covariance matrix Σ is an identity matrix I_p; and (3) the covariance matrix is a diagonal matrix. It is shown that the tests proposed by Srivastava (2005) for the above three problems are robust under the non-normality assumption made in this article irrespective of whether N≤p or N≥p, but (N,p)→∞, and N/p may go to zero or infinity. Results are asymptotic and it may be noted that they may not hold for finite (N,p).     

Inequalities associated with intra-inter-class correlation matrices

This paper complements the results of Tong (Ann. Statist. 17 (1989) 429), Shaked and Tong (Ann. Statist. 20 (1992) 614) and Eaton (in: Stochastic Inequalities, IMS Lecture Notes Monograph Series, Vol. 22, 1993, 76) by deriving some monotonicity results associated with intra-inter-class correlation matrices. In Section 2, we consider the problem of comparing these matrices in terms of the orderings induced by several subgroups of the orthogonal group. Section 3 is devoted to deriving some probability inequalities for normal random variables whose correlation matrix is of the intra-inter-class correlation structure.     

Second-order accurate inference on eigenvalues of covariance and correlation matrices

Edgeworth expansions and saddlepoint approximations for the distributions of estimators of certain eigenfunctions of covariance and correlation matrices are developed. These expansions depend on second-, third-, and fourth-order moments of the sample covariance matrix. Expressions for and estimators of these moments are obtained. The expansions and moment expressions are used to construct second-order accurate confidence intervals for the eigenfunctions. The expansions are illustrated and the results of a small simulation study that evaluates the finite-sample performance of the confidence intervals are reported.     

Exact nonnull distribution of Wilks’ statistic: The ratio and product of independent components

The study of the noncentral matrix variate beta type distributions has been sidelined because the final expressions for the densities depend on an integral that has not been resolved in an explicit way. We derive an exact expression for the nonnull distribution of Wilks’ statistic and precise expressions for the densities of the ratio and product of two independent components of matrix variates where one matrix variate has the noncentral matrix variate beta type I distribution and the other has the matrix variate beta type I distribution. We provide the expressions for the densities of the determinant of the ratio and the product of these two components. These distributions play a fundamental role in various areas of statistics, for example in the criteria proposed by Wilks.     

On the distribution of the ratio of the largest eigenvalue to the trace of a Wishart matrix

The ratio of the largest eigenvalue divided by the trace of a p×p random Wishart matrix with n degrees of freedom and an identity covariance matrix plays an important role in various hypothesis testing problems, both in statistics and in signal processing. In this paper we derive an approximate explicit expression for the distribution of this ratio, by considering the joint limit as both p,n→∞ with p/n→c. Our analysis reveals that even though asymptotically in this limit the ratio follows a Tracy-Widom (TW) distribution, one of the leading error terms depends on the second derivative of the TW distribution, and is non-negligible for practical values of p, in particular for determining tail probabilities. We thus propose to explicitly include this term in the approximate distribution for the ratio. We illustrate empirically using simulations that adding this term to the TW distribution yields a quite accurate expression to the empirical distribution of the ratio, even for small values of p,n.     

Eigenvectors of a kurtosis matrix as interesting directions to reveal cluster structure

In this paper we study the properties of a kurtosis matrix and propose its eigenvectors as interesting directions to reveal the possible cluster structure of a data set. Under a mixture of elliptical distributions with proportional scatter matrix, it is shown that a subset of the eigenvectors of the fourth-order moment matrix corresponds to Fisher’s linear discriminant subspace. The eigenvectors of the estimated kurtosis matrix are consistent estimators of this subspace and its calculation is easy to implement and computationally efficient, which is particularly favourable when the ratio n/p is large.     

Multivariate analysis of variance with fewer observations than the dimension

In this article, we consider the problem of testing a linear hypothesis in a multivariate linear regression model which includes the case of testing the equality of mean vectors of several multivariate normal populations with common covariance matrix Σ, the so-called multivariate analysis of variance or MANOVA problem. However, we have fewer observations than the dimension of the random vectors. Two tests are proposed and their asymptotic distributions under the hypothesis as well as under the alternatives are given under some mild conditions. A theoretical comparison of these powers is made.     

Kronecker product permutation matrices and their application to moment matrices of the normal distribution

In this paper, we consider the matrix which transforms a Kronecker product of vectors into the average of all vectors obtained by permuting the vectors involved in the Kronecker product. An explicit expression is given for this matrix, and some of its properties are derived. It is shown that this matrix is particularly useful in obtaining compact expressions for the moment matrices of the normal distribution. The utility of these expressions is illustrated through some examples.     

Completion problem with partial correlation vines

This paper extends the results in [D. Kurowicka, R.M. Cooke, A parametrization of positive definite matrices in terms of partial correlation vines, Linear Algebra Appl. 372 (2003) 225-251]. We show that a partial correlation vine represents a factorization of the determinant of the correlation matrix. We show that the graph of an incompletely specified correlation matrix is chordal if and only if it can be represented as an m-saturated incomplete vine, that is, an incomplete vine for which all edges corresponding to membership-descendents (m-descendents for short) of a specified edge are specified. This enables us to find the set of completions, and also the completion with maximal determinant for matrices corresponding to chordal graphs.     

The Matsumoto-Yor property and the structure of the Wishart distribution

This paper establishes a link between a generalized matrix Matsumoto-Yor (MY) property and the Wishart distribution. This link highlights certain conditional independence properties within blocks of the Wishart and leads to a new characterization of the Wishart distribution similar to the one recently obtained by Geiger and Heckerman but involving independences for only three pairs of block partitionings of the random matrix.In the process, we obtain two other main results. The first one is an extension of the MY independence property to random matrices of different dimensions. The second result is its converse. It extends previous characterizations of the matrix generalized inverse Gaussian and Wishart seen as a couple of distributions.We present two proofs for the generalized MY property. The first proof relies on a new version of Herz's identity for Bessel functions of matrix arguments. The second proof uses a representation of the MY property through the structure of the Wishart.     

Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data

In this article, the Stein-Haff identity is established for a singular Wishart distribution with a positive definite mean matrix but with the dimension larger than the degrees of freedom. This identity is then used to obtain estimators of the precision matrix improving on the estimator based on the Moore-Penrose inverse of the Wishart matrix under the Efron-Morris loss function and its variants. Ridge-type empirical Bayes estimators of the precision matrix are also given and their dominance properties over the usual one are shown using this identity. Finally, these precision estimators are used in a quadratic discriminant rule, and it is shown through simulation that discriminant methods based on the ridge-type empirical Bayes estimators provide higher correct classification rates.     

A multivariate correlation ratio

A multivariate correlation ratio of a random vector $\text{Y}$ upon a random vector $\text{X}$ is defined by

$\text{η}{}_{\mathrm{\delta }}\text{(Y;X)={}\text{tr}\text{(δ}{}^{\mathrm{<mtext>?1\; </mtext><mtext>Cov</mtext><mtext>E(Y|X))\}</mtext>}}\text{1}\text{2}\text{{}\text{tr}\text{(δ}{}^{\mathrm{?1}}\text{∑}{}_{\mathrm{Y}}\text{)}}{}^{\mathrm{<mtext>?1</mtext><mtext>2</mtext>}}$

where Λ, a fixed positive definite matrix, is related to the relative importance of predictability for the entries of $\text{Y}$. The properties of η_Λ are discussed, with particular attention paid to a ‘correlation-maximizing’ property. Given are applications of η_Λ to the elliptically symmetric family of distributions and the multinomial distribution. Also discussed is the problem of finding those r linear functions of $\text{Y}$ that are most predictable (in a correlation ratio sense) from $\text{X}$.     

Sparse principal component analysis via regularized low rank matrix approximation

Principal component analysis (PCA) is a widely used tool for data analysis and dimension reduction in applications throughout science and engineering. However, the principal components (PCs) can sometimes be difficult to interpret, because they are linear combinations of all the original variables. To facilitate interpretation, sparse PCA produces modified PCs with sparse loadings, i.e. loadings with very few non-zero elements. In this paper, we propose a new sparse PCA method, namely sparse PCA via regularized SVD (sPCA-rSVD). We use the connection of PCA with singular value decomposition (SVD) of the data matrix and extract the PCs through solving a low rank matrix approximation problem. Regularization penalties are introduced to the corresponding minimization problem to promote sparsity in PC loadings. An efficient iterative algorithm is proposed for computation. Two tuning parameter selection methods are discussed. Some theoretical results are established to justify the use of sPCA-rSVD when only the data covariance matrix is available. In addition, we give a modified definition of variance explained by the sparse PCs. The sPCA-rSVD provides a uniform treatment of both classical multivariate data and high-dimension-low-sample-size (HDLSS) data. Further understanding of sPCA-rSVD and some existing alternatives is gained through simulation studies and real data examples, which suggests that sPCA-rSVD provides competitive results.     

Efficiency of test for independence after Box-Cox transformation

We consider the efficiency and the power of the normal theory test for independence after a Box-Cox transformation. We obtain an expression for the correlation between the variates after a Box-Cox transformation in terms of the correlation on the normal scale. We discuss the efficiency of test of independence after a Box-Cox transformation and show that for the family considered it is always more efficient to conduct the test of independence based on Pearson correlation coefficient after transformation to normality. Power of test of independence before and after a Box-Cox transformation is studied for a finite sample size using Monte Carlo simulation. Our results show that we can increase the power of the normal-theory test for independence after estimating the transformation parameter from the data. The procedure has application for generating non-negative random variables with prescribed correlation.     

Dimension estimation in sufficient dimension reduction: A unifying approach

Sufficient Dimension Reduction (SDR) in regression comprises the estimation of the dimension of the smallest (central) dimension reduction subspace and its basis elements. For SDR methods based on a kernel matrix, such as SIR and SAVE, the dimension estimation is equivalent to the estimation of the rank of a random matrix which is the sample based estimate of the kernel. A test for the rank of a random matrix amounts to testing how many of its eigen or singular values are equal to zero. We propose two tests based on the smallest eigen or singular values of the estimated matrix: an asymptotic weighted chi-square test and a Wald-type asymptotic chi-square test. We also provide an asymptotic chi-square test for assessing whether elements of the left singular vectors of the random matrix are zero. These methods together constitute a unified approach for all SDR methods based on a kernel matrix that covers estimation of the central subspace and its dimension, as well as assessment of variable contribution to the lower-dimensional predictor projections with variable selection, a special case. A small power simulation study shows that the proposed and existing tests, specific to each SDR method, perform similarly with respect to power and achievement of the nominal level. Also, the importance of the choice of the number of slices as a tuning parameter is further exhibited.     

Robust factor analysis

Our aim is to construct a factor analysis method that can resist the effect of outliers. For this we start with a highly robust initial covariance estimator, after which the factors can be obtained from maximum likelihood or from principal factor analysis (PFA). We find that PFA based on the minimum covariance determinant scatter matrix works well. We also derive the influence function of the PFA method based on either the classical scatter matrix or a robust matrix. These results are applied to the construction of a new type of empirical influence function (EIF), which is very effective for detecting influential data. To facilitate the interpretation, we compute a cutoff value for this EIF. Our findings are illustrated with several real data examples.