Special variance structures in the growth curve model

Standard and extended growth curve model (multivariate linear model) with practically important variance structures are considered and a method for parameters estimation is proposed.     

The power of the likelihood ratio test for additional information in a multivariate linear model

Summary This paper deals with the likelihood ratio test for additional information in a multivariate linear model. It is shown that the power of the likelihood ratio test procedure has a monotonicity property. Asymptotic approximations for the power are also obtained.     

Estimation for parameters of interest in random effects growth curve models

In this paper, we consider the general growth curve model with multivariate random effects covariance structure and provide a new simple estimator for the parameters of interest. This estimator is not only convenient for testing the hypothesis on the corresponding parameters, but also has higher efficiency than the least-square estimator and the improved two-stage estimator obtained by Rao under certain conditions. Moreover, we obtain the necessary and sufficient condition for the new estimator to be identical to the best linear unbiased estimator. Examples of its application are given.     

A new test for multivariate normality

We propose a new class of rotation invariant and consistent goodness-of-fit tests for multivariate distributions based on Euclidean distance between sample elements. The proposed test applies to any multivariate distribution with finite second moments. In this article we apply the new method for testing multivariate normality when parameters are estimated. The resulting test is affine invariant and consistent against all fixed alternatives. A comparative Monte Carlo study suggests that our test is a powerful competitor to existing tests, and is very sensitive against heavy tailed alternatives.     

Linear sufficiency in a general growth curve model

The notion of linear sufficiency for the whole set of estimable functions in the general Gauss-Markov model is extended to the estimation of any special set of estimable functions in a general growth curve model. Some general results with respect to the concept of linear sufficiency are obtained, from which a necessary and sufficient condition is established for a linear transformation, {F₁,F₂}, of the observation matrix Y to have the property that there exists a linear function of which is the BLUE of the estimable functions .     

A weighted multivariate signed-rank test for cluster-correlated data

A weighted multivariate signed-rank test is introduced for an analysis of multivariate clustered data. Observations in different clusters may then get different weights. The test provides a robust and efficient alternative to normal theory based methods. Asymptotic theory is developed to find the approximate p-value as well as to calculate the limiting Pitman efficiency of the test. A conditionally distribution-free version of the test is also discussed. The finite-sample behavior of different versions of the test statistic is explored by simulations and the new test is compared to the unweighted and weighted versions of Hotelling’s T² test and the multivariate spatial sign test introduced in [D. Larocque, J. Nevalainen, H. Oja, A weighted multivariate sign test for cluster-correlated data, Biometrika 94 (2007) 267-283]. Finally, a real data example is used to illustrate the theory.     

Third-order power comparisons for a class of tests for multivariate linear hypothesis under general distributions

The purpose of this paper is, in multivariate linear regression model (Part I) and GMANOVA model (Part II), to investigate the effect of nonnormality upon the nonnull distributions of some multivariate test statistics under normality. It is shown that whatever the underlying distributions, the difference of local powers up to order N⁻¹ after either Bartlett’s type adjustment or Cornish-Fisher’s type size adjustment under nonnormality coincides with that in Anderson [An Introduction to Multivariate Statistical Analysis, 2nd ed. and 3rd ed., Wiley, New York, 1984, 2003] under normality. The derivation of asymptotic expansions is based on the differential operator associated with the multivariate linear regression model under general distributions. The performance of higher-order results in finite samples, including monotone Bartlett’s type adjustment and monotone Cornish-Fisher’s type size adjustment, is examined using simulation studies.     

A multivariate skew normal distribution

In this paper, we define a new class of multivariate skew-normal distributions. Its properties are studied. In particular we derive its density, moment generating function, the first two moments and marginal and conditional distributions. We illustrate the contours of a bivariate density as well as conditional expectations. We also give an extension to construct a general multivariate skew normal distribution.     

A test of location for exchangeable multivariate normal data with unknown correlation

We consider the problem of testing whether the common mean of a single n-vector of multivariate normal random variables with known variance and unknown common correlation ρ is zero. We derive the standardized likelihood ratio test for known ρ and explore different ways of proceeding with ρ unknown. We evaluate the performance of the standardized statistic where ρ is replaced with an estimate of ρ and determine the critical value c_n that controls the type I error rate for the least favorable ρ in [0,1]. The constant c_n increases with n and this procedure has pathological behavior if ρ depends on n and ρ_n converges to zero at a certain rate. As an alternate approach, we replace ρ with the upper limit of a (1−β_n) confidence interval chosen so that c_n=c for all n. We determine β_n so that the type I error rate is exactly controlled for all ρ in [0,1]. We also investigate a simpler approach where we bound the type I error rate. The former method performs well for all n while the less powerful bound method may be a useful in some settings as a simple approach. The proposed tests can be used in different applications, including within-cluster resampling and combining exchangeable p-values.     

Estimation of the mean vector of a multivariate normal distribution: subspace hypothesis

This paper considers the estimation of the mean vector θ of a p-variate normal distribution with unknown covariance matrix Σ when it is suspected that for a p×r known matrix B the hypothesis θ=Bη, η∈R^r may hold. We consider empirical Bayes estimators which includes (i) the unrestricted unbiased (UE) estimator, namely, the sample mean vector (ii) the restricted estimator (RE) which is obtained when the hypothesis θ=Bη holds (iii) the preliminary test estimator (PTE), (iv) the James-Stein estimator (JSE), and (v) the positive-rule Stein estimator (PRSE). The biases and the risks under the squared loss function are evaluated for all the five estimators and compared. The numerical computations show that PRSE is the best among all the five estimators even when the hypothesis θ=Bη is true.     

Canonical representation of conditionally specified multivariate discrete distributions

Most work on conditionally specified distributions has focused on approaches that operate on the probability space, and the constraints on the probability space often make the study of their properties challenging. We propose decomposing both the joint and conditional discrete distributions into characterizing sets of canonical interactions, and we prove that certain interactions of a joint distribution are shared with its conditional distributions. This invariance opens the door for checking the compatibility between conditional distributions involving the same set of variables. We formulate necessary and sufficient conditions for the existence and uniqueness of discrete conditional models, and we show how a joint distribution can be easily computed from the pool of interactions collected from the conditional distributions. Hence, the methods can be used to calculate the exact distribution of a Gibbs sampler. Furthermore, issues such as how near compatibility can be reconciled are also discussed. Using mixed parametrization, we show that the proposed approach is based on the canonical parameters, while the conventional approaches are based on the mean parameters. Our advantage is partly due to the invariance that holds only for the canonical parameters.     

Nonparametric methods for unbalanced multivariate data and many factor levels

We propose different nonparametric tests for multivariate data and derive their asymptotic distribution for unbalanced designs in which the number of factor levels tends to infinity (large a, small n_i case). Quasi gratis, some new parametric multivariate tests suitable for the large a asymptotic case are also obtained. Finite sample performances are investigated and compared in a simulation study. The nonparametric tests are based on separate rankings for the different variables. In the presence of outliers, the proposed nonparametric methods have better power than their parametric counterparts. Application of the new tests is demonstrated using data from plant pathology.     

On a new multivariate two-sample test

In this paper we propose a new test for the multivariate two-sample problem. The test statistic is the difference of the sum of all the Euclidean interpoint distances between the random variables from the two different samples and one-half of the two corresponding sums of distances of the variables within the same sample. The asymptotic null distribution of the test statistic is derived using the projection method and shown to be the limit of the bootstrap distribution. A simulation study includes the comparison of univariate and multivariate normal distributions for location and dispersion alternatives. For normal location alternatives the new test is shown to have power similar to that of the t- and T²-Test.     

The distribution of the residual from a general elliptical multivariate linear model

Given a general multivariate linear model of full or less than full rank, we find the distributions of internally and externally studentised residuals, assuming normal and elliptical distributions.     

Asymptotics for testing hypothesis in some multivariate variance components model under non-normality

We consider the problem of deriving the asymptotic distribution of the three commonly used multivariate test statistics, namely likelihood ratio, Lawley-Hotelling and Bartlett-Nanda-Pillai statistics, for testing hypotheses on the various effects (main, nested or interaction) in multivariate mixed models. We derive the distributions of these statistics, both in the null as well as non-null cases, as the number of levels of one of the main effects (random or fixed) goes to infinity. The robustness of these statistics against departure from normality will be assessed.Essentially, in the asymptotic spirit of this paper, both the hypothesis and error degrees of freedom tend to infinity at a fixed rate. It is intuitively appealing to consider asymptotics of this type because, for example, in random or mixed effects models, the levels of the main random factors are assumed to be a random sample from a large population of levels.For the asymptotic results of this paper to hold, we do not require any distributional assumption on the errors. That means the results can be used in real-life applications where normality assumption is not tenable.As it happens, the asymptotic distributions of the three statistics are normal. The statistics have been found to be asymptotically null robust against the departure from normality in the balanced designs. The expressions for the asymptotic means and variances are fairly simple. That makes the results an attractive alternative to the standard asymptotic results. These statements are favorably supported by the numerical results.     

Fiducial inference on the largest mean of a multivariate normal distribution

Inference on the largest mean of a multivariate normal distribution is a surprisingly difficult and unexplored topic. Difficulties arise when two or more of the means are simultaneously the largest mean. Our proposed solution is based on an extension of R.A. Fisher’s fiducial inference methods termed generalized fiducial inference. We use a model selection technique along with the generalized fiducial distribution to allow for equal largest means and alleviate the overestimation that commonly occurs. Our proposed confidence intervals for the largest mean have asymptotically correct frequentist coverage and simulation results suggest that they possess promising small sample empirical properties. In addition to the theoretical calculations and simulations we also applied this approach to the air quality index of the four largest cities in the northeastern United States (Baltimore, Boston, New York, and Philadelphia).     

Regression models for multivariate ordered responses via the Plackett distribution

We investigate the properties of a class of discrete multivariate distributions whose univariate marginals have ordered categories, all the bivariate marginals, like in the Plackett distribution, have log-odds ratios which do not depend on cut points and all higher-order interactions are constrained to 0. We show that this class of distributions may be interpreted as a discretized version of a multivariate continuous distribution having univariate logistic marginals. Convenient features of this class relative to the class of ordered probit models (the discretized version of the multivariate normal) are highlighted. Relevant properties of this distribution like quadratic log-linear expansion, invariance to collapsing of adjacent categories, properties related to positive dependence, marginalization and conditioning are discussed briefly. When continuous explanatory variables are available, regression models may be fitted to relate the univariate logits (as in a proportional odds model) and the log-odds ratios to covariates.     

The likelihood ratio test for homogeneity in bivariate normal mixtures

This paper investigates the asymptotic properties of the likelihood ratio statistic for testing homogeneity in a bivariate normal mixture model with known covariance. The asymptotic null distributions of the likelihood ratio statistic and a modified likelihood ratio statistic are obtained in explicit form. The distributions are identical. The results of a small simulation study to approximate the null distribution are presented.     

A multivariate semi-logistic autoregressive process and its characterization

An autoregressive multivariate stochastic model is constructed which yields a stationary Markov process with a marginal invariant distribution as a multivariate semi-logistic distribution. This model is denoted as an MSL-AR(1) process. Some properties of the MSL-AR(1) process are studied and its characterization is also derived.     

Exact robustness studies of the test of independence based on four multivariate criteria and their distribution problems under violations

Summary Exact robustness studies against non-normality have been carried out for test of independence based on the four multivariate criteria: Hotelling's trace,U ^(p) , Pillai's trace,V ^(p) , Wilks' criterion,W ^(p) , and Roy's largest root,L _(p) . The density functions ofU ^(p) ,W ^(p) andL _(p) have been obtained in the canonical correlation case and further the moments ofU ^(p) and m.g.f. ofV ^(p) have been derived. All of the study is based on Pillai's distribution of the characteristic roots under violations. Numerical results for the power function have been tabulated for the two-roots case. Slight non-normality does not affect the independence test seriously.V ⁽²⁾ is found to be most robust against nonnormality. Yu-Sheng Hsu is now with Georgia State University, Atlanta.