Singular random matrix decompositions: distributions

Assuming that Y has a singular matrix variate elliptically contoured distribution with respect to the Hausdorff measure, the distributions of several matrices associated to QR, modified QR, SV and polar decompositions of matrix Y are determined, for central and non-central, non-singular and singular cases, as well as their relationship to the Wishart and pseudo-Wishart generalized singular and non-singular distributions. Some of these results are also applied to two particular subfamilies of elliptical distributions, the singular matrix variate normal distribution and the singular matrix variate symmetric Pearson type VII distribution.     

Predictivistic characterizations of multivariate student-t models

De Finetti style theorems characterize models (predictive distributions) as mixtures of the likelihood function and the prior distribution, beginning from some judgment of invariance about observable quantities. The likelihood function generally has its functional form identified from invariance assumptions only. However, we need additional conditions on observable quantities (typically, assumptions on conditional expectations) to identify the prior distribution. In this paper, we consider some well-known invariance assumptions and establish additional conditions on observable quantities in order to obtain a predictivistic characterization of the multivariate and matrix-variate Student-t distributions as well as for the Student-t linear model. As a byproduct, a characterization for the Pearson type II distribution is provided.     

Principal points of a multivariate mixture distribution

A set of n-principal points of a distribution is defined as a set of n points that optimally represent the distribution in terms of mean squared distance. It provides an optimal n-point-approximation of the distribution. However, it is in general difficult to find a set of principal points of a multivariate distribution. Tarpey et al. [T. Tarpey, L. Li, B. Flury, Principal points and self-consistent points of elliptical distributions, Ann. Statist. 23 (1995) 103-112] established a theorem which states that any set of n-principal points of an elliptically symmetric distribution is in the linear subspace spanned by some principal eigenvectors of the covariance matrix. This theorem, called a “principal subspace theorem”, is a strong tool for the calculation of principal points. In practice, we often come across distributions consisting of several subgroups. Hence it is of interest to know whether the principal subspace theorem remains valid even under such complex distributions. In this paper, we define a multivariate location mixture model. A theorem is established that clarifies a linear subspace in which n-principal points exist.     

Wishart ratios with dependent structure: New members of the bimatrix beta type IV

In multivariate statistics under normality, the problems of interest are random covariance matrices (known as Wishart matrices) and “ratios” of Wishart matrices that arise in multivariate analysis of variance (MANOVA) (see 24). The bimatrix variate beta type IV distribution (also known in the literature as bimatrix variate generalised beta; matrix variate generalization of a bivariate beta type I) arises from “ratios” of Wishart matrices. In this paper, we add a further independent Wishart random variate to the “denominator” of one of the ratios; this results in deriving the exact expression for the density function of the bimatrix variate extended beta type IV distribution. The latter leads to the proposal of the bimatrix variate extended F distribution. Some interesting characteristics of these newly introduced bimatrix distributions are explored. Lastly, we focus on the bivariate extended beta type IV distribution (that is an extension of bivariate Jones’ beta) with emphasis on P(X₁<X₂) where X₁ is the random stress variate and X₂ is the random strength variate.     

Peaks-over-threshold stability of multivariate generalized Pareto distributions

It is well-known that the univariate generalized Pareto distributions (GPD) are characterized by their peaks-over-threshold (POT) stability. We extend this result to multivariate GPDs.It is also shown that this POT stability is asymptotically shared by distributions which are in a certain neighborhood of a multivariate GPD. A multivariate extreme value distribution is a typical example.The usefulness of the results is demonstrated by various applications. We immediately obtain, for example, that the excess distribution of a linear portfolio with positive weights a_i, i≤d, is independent of the weights, if (U₁,…,U_d) follows a multivariate GPD with identical univariate polynomial or Pareto margins, which was established by Macke [On the distribution of linear combinations of multivariate EVD and GPD distributed random vectors with an application to the expected shortfall of portfolios, Diploma Thesis, University of Würzburg, 2004, (in German)] and Falk and Michel [Testing for tail independence in extreme value models. Ann. Inst. Statist. Math. 58 (2006) 261-290]. This implies, for instance, that the expected shortfall as a measure of risk fails in this case.     

New families of estimators and test statistics in log-linear models

In this paper we consider categorical data that are distributed according to a multinomial, product-multinomial or Poisson distribution whose expected values follow a log-linear model and we study the inference problem of hypothesis testing in a log-linear model setting. The family of test statistics considered is based on the family of ?-divergence measures. The unknown parameters in the log-linear model under consideration are also estimated using ?-divergence measures: Minimum ?-divergence estimators. A simulation study is included to find test statistics that offer an attractive alternative to the Pearson chi-square and likelihood-ratio test statistics.     

Consistency of the generalized MLE of a joint distribution function with multivariate interval-censored data

Wong and Yu [Generalized MLE of a joint distribution function with multivariate interval-censored data, J. Multivariate Anal. 69 (1999) 155-166] discussed generalized maximum likelihood estimation of the joint distribution function of a multivariate random vector whose coordinates are subject to interval censoring. They established uniform consistency of the generalized MLE (GMLE) of the distribution function under the assumption that the random vector is independent of the censoring vector and that both of the vector distributions are discrete. We relax these assumptions and establish consistency results of the GMLE under a multivariate mixed case interval censorship model. van der Vaart and Wellner [Preservation theorems for Glivenko-Cantelli and uniform Glivenko-Cantelli class, in: E. Gine, D.M. Mason, J.A. Wellner (Eds.), High Dimensional Probability, vol. II, Birkhäuser, Boston, 2000, pp. 115-133] and Yu [Consistency of the generalized MLE with multivariate mixed case interval-censored data, Ph.D Dissertation, Binghamton University, 2000] independently proved strong consistency of the GMLE in the L₁(μ)-topology, where μ is a measure derived from the joint distribution of the censoring variables. We establish strong consistency of the GMLE in the topologies of weak convergence and pointwise convergence, and eventually uniform convergence under appropriate distributional assumptions and regularity conditions.     

Equivalent conditions for noncentral generalized Laplacianness and independence of matrix quadratic forms

Let Y be an n×p multivariate normal random matrix with general covariance Σ_Y and W be a symmetric matrix. In the present article, the property that a matrix quadratic form Y^′WY is distributed as a difference of two independent (noncentral) Wishart random matrices is called the (noncentral) generalized Laplacianness (GL). Then a set of algebraic results are obtained which will give the necessary and sufficient conditions for the (noncentral) GL of a matrix quadratic form. Further, two extensions of Cochran’s theorem concerning the (noncentral) GL and independence of a family of matrix quadratic forms are developed.     

Nonparametric tests of independence between random vectors

A nonparametric test of the mutual independence between many numerical random vectors is proposed. This test is based on a characterization of mutual independence defined from probabilities of half-spaces in a combinatorial formula of Möbius. As such, it is a natural generalization of tests of independence between univariate random variables using the empirical distribution function. If the number of vectors is p and there are n observations, the test is defined from a collection of processes R_n,A, where A is a subset of {1,…,p} of cardinality |A|>1, which are asymptotically independent and Gaussian. Without the assumption that each vector is one-dimensional with a continuous cumulative distribution function, any test of independence cannot be distribution free. The critical values of the proposed test are thus computed with the bootstrap which is shown to be consistent. Another similar test, with the same asymptotic properties, for the serial independence of a multivariate stationary sequence is also proposed. The proposed test works when some or all of the marginal distributions are singular with respect to Lebesgue measure. Moreover, in singular cases described in Section 4, the test inherits useful invariance properties from the general affine invariance property.     

Maximum entropy characterizations of the multivariate Liouville distributions

A random vector X=(X₁,X₂,…,X_n) with positive components has a Liouville distribution with parameter θ=(θ₁,θ₂,…,θ_n) if its joint probability density function is proportional to , θ_i>0 [R.D. Gupta, D.S.P. Richards, Multivariate Liouville distributions, J. Multivariate Anal. 23 (1987) 233-256]. Examples include correlated gamma variables, Dirichlet and inverted Dirichlet distributions. We derive appropriate constraints which establish the maximum entropy characterization of the Liouville distributions among all multivariate distributions. Matrix analogs of the Liouville distributions are considered. Some interesting results related to I-projection from a Liouville distribution are presented.     

Third-order power comparisons for a class of tests for multivariate linear hypothesis under general distributions

The purpose of this paper is, in multivariate linear regression model (Part I) and GMANOVA model (Part II), to investigate the effect of nonnormality upon the nonnull distributions of some multivariate test statistics under normality. It is shown that whatever the underlying distributions, the difference of local powers up to order N⁻¹ after either Bartlett’s type adjustment or Cornish-Fisher’s type size adjustment under nonnormality coincides with that in Anderson [An Introduction to Multivariate Statistical Analysis, 2nd ed. and 3rd ed., Wiley, New York, 1984, 2003] under normality. The derivation of asymptotic expansions is based on the differential operator associated with the multivariate linear regression model under general distributions. The performance of higher-order results in finite samples, including monotone Bartlett’s type adjustment and monotone Cornish-Fisher’s type size adjustment, is examined using simulation studies.     

Characterization of the p-generalized normal distribution

It is a well known fact that invariance under the orthogonal group and marginal independence uniquely characterizes the isotropic normal distribution. Here, a similar characterization is provided for the more general class of differentiable bounded L_p-spherically symmetric distributions: Every factorial distribution in this class is necessarily p-generalized normal.     

Invariant scale matrix hypothesis tests under elliptical symmetry

The usual assumption in multivariate hypothesis testing is that the sample consists of n independent, identically distributed Gaussian m-vectors. In this paper this assumption is weakened by considering a class of distributions for which the vector observations are not necessarily either Gaussian or independent. This class contains the elliptically symmetric laws with densities of the form f(X(n × m)) = ψ[tr(X ? M)′ (X ? M)Σ^?1]. For testing the equality of k scale matrices and for the sphericity hypothesis it is shown, by using the structure of the underlying distribution rather than any specific form of the density, that the usual invariant normal-theory tests are exactly robust, for both the null and non-null cases, under this wider class.     

Wishartness and independence of matrix quadratic forms in a normal random matrix

Let Y be an n×p multivariate normal random matrix with general covariance Σ_Y. The general covariance Σ_Y of Y means that the collection of all np elements in Y has an arbitrary np×np covariance matrix. A set of general, succinct and verifiable necessary and sufficient conditions is established for matrix quadratic forms Y^′W_iY's with the symmetric W_i's to be an independent family of random matrices distributed as Wishart distributions. Moreover, a set of general necessary and sufficient conditions is obtained for matrix quadratic forms Y^′W_iY's to be an independent family of random matrices distributed as noncentral Wishart distributions. Some usual versions of Cochran's theorem are presented as the special cases of these results.     

Multivariate measures of skewness for the skew-normal distribution

The main objective of this work is to calculate and compare different measures of multivariate skewness for the skew-normal family of distributions. For this purpose, we consider the Mardia (1970) [10], Malkovich and Afifi (1973) [9], Isogai (1982) [17], Srivastava (1984) [15], Song (2001) [14], Móri et al. (1993) [11], Balakrishnan et al. (2007) [3] and Kollo (2008) [7] measures of skewness. The exact expressions of all measures of skewness, except for Song’s, are derived for the family of skew-normal distributions, while Song’s measure of shape is approximated by the use of delta method. The behavior of these measures, their similarities and differences, possible interpretations, and their practical use in testing for multivariate normal are studied by evaluating their power in the case of some specific members of the multivariate skew-normal family of distributions.     

On the singularity of multivariate skew-symmetric models

In recent years, the skew-normal models introduced by Azzalini (1985) [1]-and their multivariate generalizations from Azzalini and Dalla Valle (1996) [4]-have enjoyed an amazing success, although an important literature has reported that they exhibit, in the vicinity of symmetry, singular Fisher information matrices and stationary points in the profile log-likelihood function for skewness, with the usual unpleasant consequences for inference. It has been shown (DiCiccio and Monti (2004) [23], DiCiccio and Monti (2009) [24] and Gómez et al. (2007) [25]) that these singularities, in some specific parametric extensions of skew-normal models (such as the classes of skew-t or skew-exponential power distributions), appear at skew-normal distributions only. Yet, an important question remains open: in broader semiparametric models of skewed distributions (such as the general skew-symmetric and skew-elliptical ones), which symmetric kernels lead to such singularities? The present paper provides an answer to this question. In very general (possibly multivariate) skew-symmetric models, we characterize, for each possible value of the rank of Fisher information matrices, the class of symmetric kernels achieving the corresponding rank. Our results show that, for strictly multivariate skew-symmetric models, not only Gaussian kernels yield singular Fisher information matrices. In contrast, we prove that systematic stationary points in the profile log-likelihood functions are obtained for (multi)normal kernels only. Finally, we also discuss the implications of such singularities on inference.     

A test of uniformity on shape spaces

A test of uniformity on the shape space Σ_m^k is presented, together with modifications of the test statistic which bring its null distribution close to the large-sample asymptotic distribution. The asymptotic distribution under suitable local alternatives to uniformity is given. A family of distributions on Σ_m^k is proposed, which is suitable for modelling shapes given by landmarks which are almost collinear.     

Error bounds for asymptotic expansions of Wilks’ lambda distribution

Let Λ=|S_e|/|S_e+S_h|, where S_h and S_e are independently distributed as Wishart distributions W_p(q,Σ) and W_p(n,Σ), respectively. Then Λ has Wilks’ lambda distribution Λ_p,q,n which appears as the distributions of various multivariate likelihood ratio tests. This paper is concerned with theoretical accuracy for asymptotic expansions of the distribution of T=-nlogΛ. We derive error bounds for the approximations. It is necessary to underline that our error bounds are given in explicit and computable forms.     

Moment properties of multivariate infinitely divisible laws and criteria for multivariate self-decomposability

Ramachandran (1969) [9, Theorem 8] has shown that for any univariate infinitely divisible distribution and any positive real number α, an absolute moment of order α relative to the distribution exists (as a finite number) if and only if this is so for a certain truncated version of the corresponding Lévy measure. A generalized version of this result in the case of multivariate infinitely divisible distributions, involving the concept of g-moments, was given by Sato (1999) [6, Theorem 25.3]. We extend Ramachandran’s theorem to the multivariate case, keeping in mind the immediate requirements under appropriate assumptions of cumulant studies of the distributions referred to; the format of Sato’s theorem just referred to obviously varies from ours and seems to have a different agenda. Also, appealing to a further criterion based on the Lévy measure, we identify in a certain class of multivariate infinitely divisible distributions the distributions that are self-decomposable; this throws new light on structural aspects of certain multivariate distributions such as the multivariate generalized hyperbolic distributions studied by Barndorff-Nielsen (1977) [12] and others. Various points relevant to the study are also addressed through specific examples.     

A statistical model for random rotations

This paper studies the properties of the Cayley distributions, a new family of models for random p×p rotations. This class of distributions is related to the Cayley transform that maps a p(p-1)/2×1 vector s into SO(p), the space of p×p rotation matrices. First an expression for the uniform measure on SO(p) is derived using the Cayley transform, then the Cayley density for random rotations is investigated. A closed-form expression is derived for its normalizing constant, a simple simulation algorithm is proposed, and moments are derived. The efficiencies of moment estimators of the parameters of the new model are also calculated. A Monte Carlo investigation of tests and of confidence regions for the parameters of the new density is briefly summarized. A numerical example is presented.