Multivariate analysis of variance with fewer observations than the dimension

In this article, we consider the problem of testing a linear hypothesis in a multivariate linear regression model which includes the case of testing the equality of mean vectors of several multivariate normal populations with common covariance matrix Σ, the so-called multivariate analysis of variance or MANOVA problem. However, we have fewer observations than the dimension of the random vectors. Two tests are proposed and their asymptotic distributions under the hypothesis as well as under the alternatives are given under some mild conditions. A theoretical comparison of these powers is made.     

A novel trace test for the mean parameters in a multivariate growth curve model

A trace test for the mean parameters of the growth curve model is proposed. It is constructed using the restricted maximum likelihood followed by an estimated likelihood ratio approach. The statistic reduces to the Lawley-Hotelling trace test for the Multivariate Analysis of Variance (MANOVA) models. Our test statistic is, therefore, a natural extension of the classical trace test to GMANOVA models. We show that the distribution of the test under the null hypothesis does not depend on the unknown covariance matrix Σ. We also show that the distributions under the null and alternative hypotheses can be represented as sums of weighted central and non-central chi-square random variables, respectively. Under the null hypothesis, the Satterthwaite approximation is used to get an approximate critical point. A novel Satterthwaite type approximation is proposed to obtain an approximate power. A simulation study is performed to evaluate the performance of our proposed test and numerical examples are provided as illustrations.     

New families of estimators and test statistics in log-linear models

In this paper we consider categorical data that are distributed according to a multinomial, product-multinomial or Poisson distribution whose expected values follow a log-linear model and we study the inference problem of hypothesis testing in a log-linear model setting. The family of test statistics considered is based on the family of ?-divergence measures. The unknown parameters in the log-linear model under consideration are also estimated using ?-divergence measures: Minimum ?-divergence estimators. A simulation study is included to find test statistics that offer an attractive alternative to the Pearson chi-square and likelihood-ratio test statistics.     

A comparison of higher-order local powers of a class of one-way MANOVA tests under general distributions

The purpose of this paper is to investigate the effect of nonnormality upon the nonnull distributions of some MANOVA test statistics under normality. It is shown that whatever the underlying distributions, the difference of the local powers up to order N^-1 (N is the total number of observations) after either Bartlett's type adjustment or Cornish-Fisher's type adjustment under nonnormality coincides with that in Anderson [An Introduction to Multivariate Statistical Analysis, second ed., 1984 and third ed., 2003, Wiley, New York] under normality. The performance of higher-order results in finite samples is examined using simulation studies.     

Generalized p-values and generalized confidence regions for the multivariate Behrens-Fisher problem and MANOVA

For two multivariate normal populations with unequal covariance matrices, a procedure is developed for testing the equality of the mean vectors based on the concept of generalized p-values. The generalized p-values we have developed are functions of the sufficient statistics. The computation of the generalized p-values is discussed and illustrated with an example. Numerical results show that one of our generalized p-value test has a type I error probability not exceeding the nominal level. A formula involving only a finite number of chi-square random variables is provided for computing this generalized p-value. The formula is useful in a Bayesian solution as well. The problem of constructing a confidence region for the difference between the mean vectors is also addressed using the concept of generalized confidence regions. Finally, using the generalized p-value approach, a solution is developed for the heteroscedastic MANOVA problem.     

An asymptotic expansion of the distribution of Rao's U-statistic under a general condition

In this paper we consider the problem of testing the hypothesis about the sub-mean vector. For this propose, the asymptotic expansion of the null distribution of Rao's U-statistic under a general condition is obtained up to order of n^-1. The same problem in the k-sample case is also investigated. We find that the asymptotic distribution of generalized U-statistic in the k-sample case is identical to that of the generalized Hotelling's T² distribution up to n^-1. A simulation experiment is carried out and its results are presented. It shows that the asymptotic distributions have significant improvement when comparing with the limiting distributions both in the small sample case and the large sample case. It also demonstrates the equivalence of two testing statistics mentioned above.     

Rates of convergence of quadratic rank statistics

The rates of convergence of the distribution function of quadratic rank statistics to the X²-distribution under hypothesis and near alternatives are investigated. The considered quadratic rank statistics are used for testing the multivariate hypothesis of randomness. The method suggested by Jure?ková [7] is applied.     

On some nonparametric tests for profile analysis of several multivariate samples

For profile analysis of independent samples from several multivariate populations, a nonparametric analog of the hypothesis of parallelism of population profiles is formulated. A class of asymptotically distribution-free statistics is offered to test this hypothesis. These are based on generalized U statistics and are in some sense modifications of statistics offered previously by one of the authors for testing the homogeneity hypothesis. Consistency of these statistics is established for suitable alternatives and also asymptotic power is investigated.     

On the distribution of the ratio of the largest eigenvalue to the trace of a Wishart matrix

The ratio of the largest eigenvalue divided by the trace of a p×p random Wishart matrix with n degrees of freedom and an identity covariance matrix plays an important role in various hypothesis testing problems, both in statistics and in signal processing. In this paper we derive an approximate explicit expression for the distribution of this ratio, by considering the joint limit as both p,n→∞ with p/n→c. Our analysis reveals that even though asymptotically in this limit the ratio follows a Tracy-Widom (TW) distribution, one of the leading error terms depends on the second derivative of the TW distribution, and is non-negligible for practical values of p, in particular for determining tail probabilities. We thus propose to explicitly include this term in the approximate distribution for the ratio. We illustrate empirically using simulations that adding this term to the TW distribution yields a quite accurate expression to the empirical distribution of the ratio, even for small values of p,n.     

Exact distribution of the generalized Wilks’s statistic and applications

We establish the exact expression of the density of Wilks’s statistic Λ(n,p,q), and also those of the densities of the product and ratio of two independent such statistics, in terms of Meijer functions, and provide applications with numerical illustrations in various domains of Multivariate Analysis.     

On the dependence structure of order statistics

Given a random sample from a continuous variable, it is observed that the copula linking any pair of order statistics is independent of the parent distribution. To compare the degree of association between two such pairs of ordered random variables, a notion of relative monotone regression dependence (or stochastic increasingness) is considered. Using this concept, it is proved that for i<j, the dependence of the jth order statistic on the ith order statistic decreases as i and j draw apart. This extends earlier results of Tukey (Ann. Math. Statist. 29 (1958) 588) and Kim and David (J. Statist. Plann. Inference 24 (1990) 363). The effect of the sample size on this type of dependence is also investigated, and an explicit expression is given for the population value of Kendall's coefficient of concordance between two arbitrary order statistics of a random sample.     

A linear regression model for imprecise response

A linear regression model with imprecise response and p real explanatory variables is analyzed. The imprecision of the response variable is functionally described by means of certain kinds of fuzzy sets, the LR fuzzy sets. The LR fuzzy random variables are introduced to model usual random experiments when the characteristic observed on each result can be described with fuzzy numbers of a particular class, determined by 3 random values: the center, the left spread and the right spread. In fact, these constitute a natural generalization of the interval data. To deal with the estimation problem the space of the LR fuzzy numbers is proved to be isometric to a closed and convex cone of R³ with respect to a generalization of the most used metric for LR fuzzy numbers. The expression of the estimators in terms of moments is established, their limit distribution and asymptotic properties are analyzed and applied to the determination of confidence regions and hypothesis testing procedures. The results are illustrated by means of some case-studies.     

Multivariate linear rank statistics for profile analysis

For some general multivariate linear models, linear rank statistics are used in conjunction with Roy's Union-Intersection Principle to develop some tests for inference on the parameter (vector) when they are subject to certain linear constraints. More powerful tests are designed by incorporating the a priori information on these constraints. Profile analysis is an important application of this type of hypothesis testing problem; it consists of a set of hypothesis testing problem for the p responses q-sample model, where it is a priori assumed that the response-sample interactions are null.     

HAC estimation and strong linearity testing in weak ARMA models

In the framework of ARMA models, we consider testing the reliability of the standard asymptotic covariance matrix (ACM) of the least-squares estimator. The standard formula for this ACM is derived under the assumption that the errors are independent and identically distributed, and is in general invalid when the errors are only uncorrelated. The test statistic is based on the difference between a conventional estimator of the ACM of the least-squares estimator of the ARMA coefficients and its robust HAC-type version. The asymptotic distribution of the HAC estimator is established under the null hypothesis of independence, and under a large class of alternatives. The asymptotic distribution of the proposed statistic is shown to be a standard χ² under the null, and a noncentral χ² under the alternatives. The choice of the HAC estimator is discussed through asymptotic power comparisons. The finite sample properties of the test are analyzed via Monte Carlo simulation.     

On the performance of some statistics in discriminant analysis based on covariates

In this paper we study the behavior of three statistics suggested for testing the hypothesis, H₀ : μ₁ = μ₂, in the two sample case, in the presence of covariables. Power comparisons are made in the case when δ₂, the difference of the mean vectors in the covariates, is not equal to zero. This extends an earlier paper of the authors [Sanklya Ser. B35 51–78], where δ₂ was assumed to be equal to zero. The results reiterate those obtained in the above cited paper that for low observed values of D_q² one would use t₂ otherwise t₃ would be recommended. The statistic t₁ does not seem to be appropriate for testing this hypothesis.     

A test for elliptical symmetry

This paper presents a statistic for testing the hypothesis of elliptical symmetry. The statistic also provides a specialized test of multivariate normality. We obtain the asymptotic distribution of this statistic under the null hypothesis of multivariate normality, and give a bootstrapping procedure for approximating the null distribution of the statistic under an arbitrary elliptically symmetric distribution. We present simulation results to examine the accuracy of the asymptotic distribution and the performance of the bootstrapping procedure. Finally, for selected alternatives, we compare the power of our test statistic with that of recently proposed tests for elliptical symmetry given by Manzotti et al. [A statistic for testing the null hypothesis of elliptical symmetry, J. Multivariate Anal. 81 (2002) 274-285] and Schott [Testing for elliptical symmetry in covariance-matrix-based analyses, Statist. Probab. Lett. 60 (2002) 395-404], and with that of the well known tests for multivariate normality of Mardia [Measures of multivariate skewness and kurtosis with applications, Biometrika 57 (1970) 519-530] and Baringhaus and Henze [A consistent test for multivariate normality based on the empirical characteristic function, Metrika 35 (1988) 339-348].     

Completeness and unbiased estimation of mean vector in the multivariate group sequential case

We consider estimation after a group sequential test about a multivariate normal mean, such as a χ² test or a sequential version of the Bonferroni procedure. We derive the density function of the sufficient statistics and show that the sample mean remains to be the maximum likelihood estimator but is no longer unbiased. We propose an alternative Rao-Blackwell type unbiased estimator. We show that the family of distributions of the sufficient statistic is not complete, and there exist infinitely many unbiased estimators of the mean vector and none has uniformly minimum variance. However, when restricted to truncation-adaptable statistics, completeness holds and the Rao-Blackwell estimator has uniformly minimum variance.     

Wishart ratios with dependent structure: New members of the bimatrix beta type IV

In multivariate statistics under normality, the problems of interest are random covariance matrices (known as Wishart matrices) and “ratios” of Wishart matrices that arise in multivariate analysis of variance (MANOVA) (see 24). The bimatrix variate beta type IV distribution (also known in the literature as bimatrix variate generalised beta; matrix variate generalization of a bivariate beta type I) arises from “ratios” of Wishart matrices. In this paper, we add a further independent Wishart random variate to the “denominator” of one of the ratios; this results in deriving the exact expression for the density function of the bimatrix variate extended beta type IV distribution. The latter leads to the proposal of the bimatrix variate extended F distribution. Some interesting characteristics of these newly introduced bimatrix distributions are explored. Lastly, we focus on the bivariate extended beta type IV distribution (that is an extension of bivariate Jones’ beta) with emphasis on P(X₁<X₂) where X₁ is the random stress variate and X₂ is the random strength variate.     

Multivariate Behrens-Fisher problem with missing data

Inference about the difference between two normal mean vectors when the covariance matrices are unknown and arbitrary is considered. Assuming that the incomplete data are of monotone pattern, a pivotal quantity, similar to the Hotelling T² statistic, is proposed. A satisfactory moment approximation to the distribution of the pivotal quantity is derived. Hypothesis testing and confidence estimation based on the approximate distribution are outlined. The accuracy of the approximation is investigated using Monte Carlo simulation. Monte Carlo studies indicate that the approximate method is very satisfactory even for moderately small samples. The proposed methods are illustrated using an example.