Maximum entropy characterizations of the multivariate Liouville distributions

A random vector X=(X₁,X₂,…,X_n) with positive components has a Liouville distribution with parameter θ=(θ₁,θ₂,…,θ_n) if its joint probability density function is proportional to , θ_i>0 [R.D. Gupta, D.S.P. Richards, Multivariate Liouville distributions, J. Multivariate Anal. 23 (1987) 233-256]. Examples include correlated gamma variables, Dirichlet and inverted Dirichlet distributions. We derive appropriate constraints which establish the maximum entropy characterization of the Liouville distributions among all multivariate distributions. Matrix analogs of the Liouville distributions are considered. Some interesting results related to I-projection from a Liouville distribution are presented.     

Characteristic functions of scale mixtures of multivariate skew-normal distributions

We obtain the characteristic function of scale mixtures of skew-normal distributions both in the univariate and multivariate cases. The derivation uses the simple stochastic relationship between skew-normal distributions and scale mixtures of skew-normal distributions. In particular, we describe the characteristic function of skew-normal, skew-t, and other related distributions.     

A class of weighted multivariate normal distributions and its properties

This article proposes a class of weighted multivariate normal distributions whose probability density function has the form of a product of a multivariate normal density and a weighting function. The class is obtained from marginal distributions of various doubly truncated multivariate normal distributions. The class strictly includes the multivariate normal and multivariate skew-normal. It is useful for selection modeling and inequality constrained normal mean vector analysis. We report on a study of some distributional properties and the Bayesian perspective of the class. A probabilistic representation of the distributions is also given. The representation is shown to be straightforward to specify the distribution and to implement computation, with output readily adapted for the required analysis. Necessary theories and illustrative examples are provided.     

Structural decompositions of multivariate distributions with applications in moment and cumulant

We provide lattice decompositions for multivariate distributions. The lattice decompositions reveal the structural relationship between the Lancaster/Bahadur model and the model of Streitberg (Ann. Statist. 18 (1990) 1878). For multivariate categorical data, the decompositions allows modeling strategy for marginal inference. The theory discussed in this paper illustrates the concept of reproducibility, which was discussed in Liang et al. (J. Roy. Statist. Soc. Ser. B 54 (1992) 3). For the purpose of delineating the relationship between the various types of decompositions of distributions, we develop a theory of polytypefication, the generality of which is exploited to prove results beyond interaction.     

Third-order power comparisons for a class of tests for multivariate linear hypothesis under general distributions

The purpose of this paper is, in multivariate linear regression model (Part I) and GMANOVA model (Part II), to investigate the effect of nonnormality upon the nonnull distributions of some multivariate test statistics under normality. It is shown that whatever the underlying distributions, the difference of local powers up to order N⁻¹ after either Bartlett’s type adjustment or Cornish-Fisher’s type size adjustment under nonnormality coincides with that in Anderson [An Introduction to Multivariate Statistical Analysis, 2nd ed. and 3rd ed., Wiley, New York, 1984, 2003] under normality. The derivation of asymptotic expansions is based on the differential operator associated with the multivariate linear regression model under general distributions. The performance of higher-order results in finite samples, including monotone Bartlett’s type adjustment and monotone Cornish-Fisher’s type size adjustment, is examined using simulation studies.     

Canonical representation of conditionally specified multivariate discrete distributions

Most work on conditionally specified distributions has focused on approaches that operate on the probability space, and the constraints on the probability space often make the study of their properties challenging. We propose decomposing both the joint and conditional discrete distributions into characterizing sets of canonical interactions, and we prove that certain interactions of a joint distribution are shared with its conditional distributions. This invariance opens the door for checking the compatibility between conditional distributions involving the same set of variables. We formulate necessary and sufficient conditions for the existence and uniqueness of discrete conditional models, and we show how a joint distribution can be easily computed from the pool of interactions collected from the conditional distributions. Hence, the methods can be used to calculate the exact distribution of a Gibbs sampler. Furthermore, issues such as how near compatibility can be reconciled are also discussed. Using mixed parametrization, we show that the proposed approach is based on the canonical parameters, while the conventional approaches are based on the mean parameters. Our advantage is partly due to the invariance that holds only for the canonical parameters.     

Pseudo-inverse multivariate/matrix-variate distributions

The Moore-Penrose inverse of a singular or nonsquare matrix is not only existent but also unique. In this paper, we derive the Jacobian of the transformation from such a matrix to the transpose of its Moore-Penrose inverse. Using this Jacobian, we investigate the distribution of the Moore-Penrose inverse of a random matrix and propose the notion of pseudo-inverse multivariate/matrix-variate distributions. For arbitrary multivariate or matrix-variate distributions, we can develop the corresponding pseudo-inverse distributions. In particular, we present pseudo-inverse multivariate normal distributions, pseudo-inverse Dirichlet distributions, pseudo-inverse matrix-variate normal distributions and pseudo-inverse Wishart distributions.     

Multivariate semi-logistic distributions

Three new multivariate semi-logistic distributions (denoted by MSL⁽¹⁾, MSL⁽²⁾, and GMSL respectively) are studied in this paper. They are more general than Gumbel’s (1961) [1] and Arnold’s (1992) [2] multivariate logistic distributions. They may serve as competitors to these commonly used multivariate logistic distributions. Various characterization theorems via geometric maximization and geometric minimization procedures of the three MSL⁽¹⁾, MSL⁽²⁾ and GMSL are proved. The particular multivariate logistic distribution used in the multiple logistic regression model is introduced. Its characterization theorem is also studied. Finally, some further research work on these MSL is also presented. Some probability density plots and contours of the bivariate MSL⁽¹⁾, MSL⁽²⁾ as well as Gumbel’s and Arnold’s bivariate logistic distributions are presented in the Appendix.     

Some recent developments on complex multivariate distributions

In this paper, the author gives a review of the literature on complex multivariate distributions. Some new results on these distributions are also given. Finally, the author discusses the applications of the complex multivariate distributions in the area of the inference on multiple time series.     

Some notes on multivariate generalized Pareto distributions

The investigation of multivariate generalized Pareto distributions (GPDs) has begun only recently and there are slightly varying definitions of GPDs available. In this article we investigate the one from Section 5.1 of Falk et al. [Laws of Small Numbers: Extremes and Rare Events, second ed., Birkhäuser, Basel, 2004], which does not differ in the area of interest from those of other authors. We first give an interpretation of the case of independence in terms of the peaks-over-threshold approach. This case is also used in dimension d=3 by Falk et al. [Laws of Small Numbers: Extremes and Rare Events, second ed., Birkhäuser, Basel, 2004] as a counterexample to show that GP functions are not necessarily distribution functions on their entire support. We generalize this counterexample to an arbitrary dimension d≥3 and demonstrate also that other GP functions show this behavior. Finally we show that different GPDs can lead to the same conditional probability measure in the area of interest.     

On fundamental skew distributions

A new class of multivariate skew-normal distributions, fundamental skew-normal distributions and their canonical version, is developed. It contains the product of independent univariate skew-normal distributions as a special case. Stochastic representations and other main properties of the associated distribution theory of linear and quadratic forms are considered. A unified procedure for extending this class to other families of skew distributions such as the fundamental skew-symmetric, fundamental skew-elliptical, and fundamental skew-spherical class of distributions is also discussed.     

A large deviation limit theorem for multivariate distributions

A local limit theorem for large deviations of $\text{o(n)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}$, where n is the sample size, is developed for multivariate statistics which are more general than standardised means, but which depend on n in much the same way. In particular, the cumulants of the statistic are of the same order in $\text{n}{}^{\mathrm{<mtext>?1</mtext><mtext>2</mtext>}}$ as those of a standardised mean. The theory is derived under conditions which correspond to those in earlier work by Richter on limit theorems for standardised means and by Chambers on the validity of Edgeworth expansions for multivariate statistics.     

Hierarchical orbital decompositions and extended decomposable distributions

Elliptically contoured distributions can be considered to be the distributions for which the contours of the density functions are proportional ellipsoids. Kamiya, Takemura and Kuriki [Star-shaped distributions and their generalizations, J. Statist. Plann. Inference, 2006, available at 〈http://arxiv.org/abs/math.ST/0605600〉, to appear] generalized the elliptically contoured distributions to star-shaped distributions, for which the contours are allowed to be arbitrary proportional star-shaped sets. This was achieved by considering the so-called orbital decomposition of the sample space in the general framework of group invariance. In the present paper, we extend their results by conducting the orbital decompositions in steps and obtaining a further, hierarchical decomposition of the sample space. This allows us to construct probability models and distributions with further independence structures. The general results are applied to the star-shaped distributions with a certain symmetric structure, the distributions related to the two-sample Wishart problem and the distributions of preference rankings.     

A comparison of higher-order local powers of a class of one-way MANOVA tests under general distributions

The purpose of this paper is to investigate the effect of nonnormality upon the nonnull distributions of some MANOVA test statistics under normality. It is shown that whatever the underlying distributions, the difference of the local powers up to order N^-1 (N is the total number of observations) after either Bartlett's type adjustment or Cornish-Fisher's type adjustment under nonnormality coincides with that in Anderson [An Introduction to Multivariate Statistical Analysis, second ed., 1984 and third ed., 2003, Wiley, New York] under normality. The performance of higher-order results in finite samples is examined using simulation studies.     

The Fréchet distance between multivariate normal distributions

The Fréchet distance between two multivariate normal distributions having means μ_X, μ_Y and covariance matrices Σ_X, Σ_Y is shown to be given by $\text{d}{}^2\text{= |μ}{}_{\mathrm{X}}\text{? μ}{}_{\mathrm{Y}}\text{|}{}^2\text{+}\text{tr}\text{(Σ}{}_{\mathrm{X}}\text{+ Σ}{}_{\mathrm{Y}}\text{? 2(Σ}{}_{\mathrm{X}}\text{Σ}{}_{\mathrm{Y}}\text{)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}\text{)}$. The quantity d₀ given by $\text{d}{}_0{}^2\text{=}\text{tr}\text{(Σ}{}_{\mathrm{X}}\text{+ Σ}{}_{\mathrm{Y}}\text{? 2(Σ}{}_{\mathrm{X}}\text{Σ}{}_{\mathrm{Y}}\text{)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}\text{)}$ is a natural metric on the space of real covariance matrices of given order.     

Sequences of elliptical distributions and mixtures of normal distributions

Two conditions are shown under which elliptical distributions are scale mixtures of normal distributions with respect to probability distributions. The issue of finding the mixing distribution function is also considered. As a unified theoretical framework, it is also shown that any scale mixture of normal distributions is always a term of a sequence of elliptical distributions, increasing in dimension, and that all the terms of this sequence are also scale mixtures of normal distributions sharing the same mixing distribution function. Some examples are shown as applications of these concepts, showing the way of finding the mixing distribution function.     

Preserving multivariate dispersion: An application to the Wishart distribution

Univariate dispersive ordering has been extensively characterized by many authors over the last two decades. However, the multivariate version lacks extensive analysis. In this paper, sufficient and necessary conditions are given to preserve the strong multivariate dispersion order through properties of the corresponding transformation. Finally, these results are applied to the Wishart distribution which can be viewed as “the spread of the dispersion”.     

Likelihood ratio tests of correlated multivariate samples

We develop methods to compare multiple multivariate normally distributed samples which may be correlated. The methods are new in the context that no assumption is made about the correlations among the samples. Three types of null hypotheses are considered: equality of mean vectors, homogeneity of covariance matrices, and equality of both mean vectors and covariance matrices. We demonstrate that the likelihood ratio test statistics have finite-sample distributions that are functions of two independent Wishart variables and dependent on the covariance matrix of the combined multiple populations. Asymptotic calculations show that the likelihood ratio test statistics converge in distribution to central Chi-squared distributions under the null hypotheses regardless of how the populations are correlated. Following these theoretical findings, we propose a resampling procedure for the implementation of the likelihood ratio tests in which no restrictive assumption is imposed on the structures of the covariance matrices. The empirical size and power of the test procedure are investigated for various sample sizes via simulations. Two examples are provided for illustration. The results show good performance of the methods in terms of test validity and power.     

Exact distributions of MLEs of regression coefficients in GMANOVA-MANOVA model

This paper studies the exact distributions of the MLEs of the regression coefficient matrices in a GMANOVA-MANOVA model with normal error. The unique conditions for linear functions of the MLEs of regression coefficient matrices are presented, and the exact density functions or characteristic functions for these linear functions are derived.     

Peaks-over-threshold stability of multivariate generalized Pareto distributions

It is well-known that the univariate generalized Pareto distributions (GPD) are characterized by their peaks-over-threshold (POT) stability. We extend this result to multivariate GPDs.It is also shown that this POT stability is asymptotically shared by distributions which are in a certain neighborhood of a multivariate GPD. A multivariate extreme value distribution is a typical example.The usefulness of the results is demonstrated by various applications. We immediately obtain, for example, that the excess distribution of a linear portfolio with positive weights a_i, i≤d, is independent of the weights, if (U₁,…,U_d) follows a multivariate GPD with identical univariate polynomial or Pareto margins, which was established by Macke [On the distribution of linear combinations of multivariate EVD and GPD distributed random vectors with an application to the expected shortfall of portfolios, Diploma Thesis, University of Würzburg, 2004, (in German)] and Falk and Michel [Testing for tail independence in extreme value models. Ann. Inst. Statist. Math. 58 (2006) 261-290]. This implies, for instance, that the expected shortfall as a measure of risk fails in this case.