An alternative method for computing mean and covariance matrix of some multivariate distributions

Computing the mean and covariance matrix of some multivariate distributions, in particular, multivariate normal distribution and Wishart distribution are considered in this article. It involves a matrix transformation of the normal random vector into a random vector whose components are independent normal random variables, and then integrating univariate integrals for computing the mean and covariance matrix of a multivariate normal distribution. Moment generating function technique is used for computing the mean and covariances between the elements of a Wishart matrix. In this article, an alternative method that uses matrix differentiation and differentiation of the determinant of a matrix is presented. This method does not involve any integration.     

Asymptotic distribution of Wishart matrix for block-wise dispersion of population eigenvalues

This paper deals with the asymptotic distribution of Wishart matrix and its application to the estimation of the population matrix parameter when the population eigenvalues are block-wise infinitely dispersed. We show that the appropriately normalized eigenvectors and eigenvalues asymptotically generate two Wishart matrices and one normally distributed random matrix, which are mutually independent. For a family of orthogonally equivariant estimators, we calculate the asymptotic risks with respect to the entropy or the quadratic loss function and derive the asymptotically best estimator among the family. We numerically show (1) the convergence in both the distributions and the risks are quick enough for a practical use, (2) the asymptotically best estimator is robust against the deviation of the population eigenvalues from the block-wise infinite dispersion.     

正态-逆Wishart先验下多元线性模型中经验Bayes估计的优良性

在正态-逆Wishart先验下研究了多元线性模型中参数的经验Bayes估计及其优良性问题.当先验分布中含有未知参数时,构造了回归系数矩阵和误差方差矩阵的经验Bayes估计,并在Bayes均方误差(简称BMSE)准则和Bayes均方误差阵(简称BMSEM)准则下,证明了经验Bayes估计优于最小二乘估计.最后,进行了Monte Carlo模拟研究,进一步验证了理论结果.     

Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data

In this article, the Stein-Haff identity is established for a singular Wishart distribution with a positive definite mean matrix but with the dimension larger than the degrees of freedom. This identity is then used to obtain estimators of the precision matrix improving on the estimator based on the Moore-Penrose inverse of the Wishart matrix under the Efron-Morris loss function and its variants. Ridge-type empirical Bayes estimators of the precision matrix are also given and their dominance properties over the usual one are shown using this identity. Finally, these precision estimators are used in a quadratic discriminant rule, and it is shown through simulation that discriminant methods based on the ridge-type empirical Bayes estimators provide higher correct classification rates.     

Bayesian Influence Assessment in the Growth Curve Model with Unstructured Covariance

From a Bayesian point of view, in this paper we discuss the influence of a subset of observations on the posterior distributions of parameters in a growth curve model with unstructured covariance. The measure used to assess the influence is based on a Bayesian entropy, namely Kullback-Leibler divergence (KLD). Several new properties of the Bayesian entropy are studied, and analytically closed forms of the KLD measurement both for the matrix-variate normal distribution and the Wishart distribution are established. In the growth curve model, the KLD measurements for all combinations of the parameters are also studied. For illustration, a practical data set is analyzed using the proposed approach, which shows that the diagnostics measurements are useful in practice.     

A power function of statistical tests dependent on elementary symmetric polynomials

Statistical tests not changed under an affine change of coordinate system are considered in the multivariate analysis. In the case of a multivariate linear model and a model using the canonical correlation analysis, these tests are functions of eigenvalues of matrices following a Wishart distribution. In this paper we prove the monotonicity property of test power functions being functions of elementary symmetric polynomials of eigenvalues of a matrix following a noncentral Wishart distribution.     

The Matsumoto-Yor property and the structure of the Wishart distribution

This paper establishes a link between a generalized matrix Matsumoto-Yor (MY) property and the Wishart distribution. This link highlights certain conditional independence properties within blocks of the Wishart and leads to a new characterization of the Wishart distribution similar to the one recently obtained by Geiger and Heckerman but involving independences for only three pairs of block partitionings of the random matrix.In the process, we obtain two other main results. The first one is an extension of the MY independence property to random matrices of different dimensions. The second result is its converse. It extends previous characterizations of the matrix generalized inverse Gaussian and Wishart seen as a couple of distributions.We present two proofs for the generalized MY property. The first proof relies on a new version of Herz's identity for Bessel functions of matrix arguments. The second proof uses a representation of the MY property through the structure of the Wishart.     

Approximating by the Wishart distribution

Approximations of density functions are considered in the multivariate case. The results are presented with the help of matrix derivatives, powers of Kronecker products and Taylor expansions of functions with matrix argument. In particular, an approximation by the Wishart distribution is discussed. It is shown that in many situations the distributions should be centred. The results are applied to the approximation of the distribution of the sample covariance matrix and to the distribution of the non-central Wishart distribution.     

On the evaluation of some distributions that arise in simultaneous tests for the equality of the latent roots of the covariance matrix

In this paper, the authors consider the evaluation of the distribution functions of the ratios of the intermediate roots to the trace of the real Wishart matrix as well as the ratios of the individual roots to the trace of the complex Wishart matrix. In addition, the authors consider the evaluation of the distribution functions of the ratios of the extreme roots of the Wishart matrix in the real and complex cases. Some applications and tables of the above distributions are also given.     

Improved estimators for the GMANOVA problem with application to Monte Carlo simulation

The problem of finding classes of estimators which improve upon the usual (e.g., ML, LS) estimator of the parameter matrix in the GMANOVA model under (matrix) quadratic loss is considered. Classes of improved estimators are obtained via combining integration-by-parts methods for normal and Wishart distributions. Also considered is the application of control variates to achieve better efficiency in multipopulation multivariate simulation studies.     

Improved Estimation of Parameter Matrices in a One-Sample and Two-Sample Problems

In this paper, the problems of estimating the covariance matrix in a Wishart distribution (refer as one-sample problem) and the scale matrix in a multi-variate F distribution (which arise naturally from a two-sample setting) are considered. A new class of estimators which shrink the eigenvalues towards their harmonic mean is proposed. It is shown that the new estimator dominates the best linear estimator under two scale invariant loss functions.     

Expectations of Functions of Complex Wishart Matrix

In this article, we study lower and upper triangular factorizations of the complex Wishart matrix. Further, using these factorizations, we obtain several expected values of scalar and matrix valued functions of the complex Wishart matrix. We also generalize Muirhead’s identity for the complex case which gives a number of interesting special cases.     

Use of the hyperbolic differential operator to find a scalar statistic which has constant regression on the mean of a sample of Wishart matrices

Scalar polynomial statistics are found which have constant regression on the mean of a sample of Wishart matrices. The method used is to differentiate the characteristic function associated with the Wishart distribution, thus expressing the constant regression condition as a differential equation which is satisfied by the Wishart characteristic function. In this respect, use is made of the hyperbolic differential operator.     

Growth Curve Model with Hierarchical Within-Individuals Design Matrices

This paper deals with some inferential problems under an extended growth curve model with several hierarchical within-individuals design matrices. The model includes the one whose mean structure consists of polynomial growth curves with different degrees. First we consider the case when the covariance matrix is unknown positive definite. We derive a LR test for examining the hierarchical structure for within individuals design matrices and a model selection criterion. Next we consider the case when a random coefficients covariance structure is assumed, under certain assumption of between-individual design matrices. Similar inferential problems are also considered. The dental measurement data (see, e.g., Potthoff and Roy (1964, Biometrika, 51, 313-326)) is reexamined, based on extended growth curve models.     

The inverted complex Wishart distribution and its application to spectral estimation

The inverted complex Wishart distribution and its use for the construction of spectral estimates are studied. The density, some marginals of the distribution, and the first- and second-order moments are given. For a vector-valued time series, estimation of the spectral density at a collection of frequencies and estimation of the increments of the spectral distribution function in each of a set of frequency bands are considered. A formal procedure applies Bayes theorem, where the complex Wishart is used to represent the distribution of an average of adjacent periodogram values. A conjugate prior distribution for each parameter is an inverted complex Wishart distribution. Use of the procedure for estimation of a 2 × 2 spectral density matrix is discussed.     

General Moments of the Inverse Real Wishart Distribution and Orthogonal Weingarten Functions

We study a random positive definite symmetric matrix distributed according to a real Wishart distribution. We compute general moments of the random matrix and of its inverse explicitly. To do so, we employ the orthogonal Weingarten function, which was recently introduced in the study of Haar-distributed orthogonal matrices. As applications, we give formulas for moments of traces of a Wishart matrix and its inverse.     

On Wishart distribution: Some extensions

This paper proposes a unified approach that enables the Wishart distribution to be studied simultaneously in the real, complex, quaternion and octonion cases under elliptical models. In particular, the matrix multivariate elliptical distribution, the noncentral generalised Wishart distribution, the joint density of the eigenvalues and the distribution of the maximum eigenvalue are obtained for real normed division algebras.     

Estimation of the Scale Matrix and its Eigenvalues in the Wishart and the Multivariate F Distributions

In this paper, the problem of estimating the scale matrix and their eigenvalues in a Wishart distribution and in a multivariate F distribution (which arise naturally from a two-sample setting) are considered. A new class of estimators which shrink the eigenvalues towards their arithmetic mean are proposed. It is shown that the new estimator which dominates the usual unbiased estimator under the squared error loss function. A simulation study was carried out to study the performance of these estimators.     

Expressions for some hypergeometric functions of matrix argument with applications

Reasonably simple expressions are given for some hypergeometric functions when the size of the argument matrix or matrices is two. Applications of these expressions in connection with the distributions of the latent roots of a 2 × 2 Wishart matrix are also given.     

Simulation from Wishart Distributions with Eigenvalue Constraints

Abstract

This article provides an efficient algorithm for generating a random matrix according to a Wishart distribution, but with eigenvalues constrained to be less than a given vector of positive values. The procedure of Odell and Feiveson provides a guide, but the modifications here ensure that the diagonal elements of a candidate matrix are less than the corresponding elements of the constraint vector, thus greatly improving the chances that the matrix will be acceptable. The Normal hierarchical model with vector outcomes and the multivariate random effects model provide motivating applications.