Near-exact distributions for the independence and sphericity likelihood ratio test statistics

In this paper we show how, based on a decomposition of the likelihood ratio test for sphericity into two independent tests and a suitably developed decomposition of the characteristic function of the logarithm of the likelihood ratio test statistic to test independence in a set of variates, we may obtain extremely well-fitting near-exact distributions for both test statistics. Since both test statistics have the distribution of the product of independent Beta random variables, it is possible to obtain near-exact distributions for both statistics in the form of Generalized Near-Integer Gamma distributions or mixtures of these distributions. For the independence test statistic, numerical studies and comparisons with asymptotic distributions proposed by other authors show the extremely high accuracy of the near-exact distributions developed as approximations to the exact distribution. Concerning the sphericity test statistic, comparisons with formerly developed near-exact distributions show the advantages of these new near-exact distributions.     

Efficiency of test for independence after Box-Cox transformation

We consider the efficiency and the power of the normal theory test for independence after a Box-Cox transformation. We obtain an expression for the correlation between the variates after a Box-Cox transformation in terms of the correlation on the normal scale. We discuss the efficiency of test of independence after a Box-Cox transformation and show that for the family considered it is always more efficient to conduct the test of independence based on Pearson correlation coefficient after transformation to normality. Power of test of independence before and after a Box-Cox transformation is studied for a finite sample size using Monte Carlo simulation. Our results show that we can increase the power of the normal-theory test for independence after estimating the transformation parameter from the data. The procedure has application for generating non-negative random variables with prescribed correlation.     

Nonparametric tests of independence between random vectors

A nonparametric test of the mutual independence between many numerical random vectors is proposed. This test is based on a characterization of mutual independence defined from probabilities of half-spaces in a combinatorial formula of Möbius. As such, it is a natural generalization of tests of independence between univariate random variables using the empirical distribution function. If the number of vectors is p and there are n observations, the test is defined from a collection of processes R_n,A, where A is a subset of {1,…,p} of cardinality |A|>1, which are asymptotically independent and Gaussian. Without the assumption that each vector is one-dimensional with a continuous cumulative distribution function, any test of independence cannot be distribution free. The critical values of the proposed test are thus computed with the bootstrap which is shown to be consistent. Another similar test, with the same asymptotic properties, for the serial independence of a multivariate stationary sequence is also proposed. The proposed test works when some or all of the marginal distributions are singular with respect to Lebesgue measure. Moreover, in singular cases described in Section 4, the test inherits useful invariance properties from the general affine invariance property.     

On consistent testing for serial correlation of unknown form in vector time series models

Multivariate autoregressive models with exogenous variables (VARX) are often used in econometric applications. Many properties of the basic statistics for this class of models rely on the assumption of independent errors. Using results of Hong (Econometrica 64 (1996) 837), we propose a new test statistic for checking the hypothesis of non-correlation or independence in the Gaussian case. The test statistic is obtained by comparing the spectral density of the errors under the null hypothesis of independence with a kernel-based spectral density estimator. The asymptotic distribution of the statistic is derived under the null hypothesis. This test generalizes the portmanteau test of Hosking (J. Amer. Statist. Assoc. 75 (1980) 602). The consistency of the test is established for a general class of static regression models with autocorrelated errors. Its asymptotic slope is derived and the asymptotic relative efficiency within the class of possible kernels is also investigated. Finally, the level and power of the resulting tests are also studied by simulation.     

A multivariate empirical characteristic function test of independence with normal marginals

This paper proposes a semi-parametric test of independence (or serial independence) between marginal vectors each of which is normally distributed but without assuming the joint normality of these marginal vectors. The test statistic is a Cramér–von Mises functional of a process defined from the empirical characteristic function. This process is defined similarly as the process of Ghoudi et al. [J. Multivariate Anal. 79 (2001) 191] built from the empirical distribution function and used to test for independence between univariate marginal variables. The test statistic can be represented as a V-statistic. It is consistent to detect any form of dependence. The weak convergence of the process is derived. The asymptotic distribution of the Cramér–von Mises functionals is approximated by the Cornish–Fisher expansion using a recursive formula for cumulants and inversion of the characteristic function with numerical evaluation of the eigenvalues. The test statistic is finally compared with Wilks statistic for testing the parametric hypothesis of independence in the one-way MANOVA model with random effects.     

Maximum eccentricity as a union-intersection test statistic in multivariate analysis

Union-intersection is a heuristic method of test construction developed by S. N. Roy. Among the well-known applications of this principle is the test for independence between two sets of variates which leads directly to the concept of canonical correlation. Another multivariate application of considerable importance is the test of internal independence. In this article we consider the structure of a correlation matrix and derive a union-intersection test statistic for internal independence. This statistic will be shown to be a function of the maximum eccentricity of the p-dimensional correlation ellipsoid x′R^?1x = 1. The statistic will be applied to problems in factor analysis and categorical scaling.     

A test for independence of two multivariate samples

The paper presents a new nonparametric test for independence of two vectors. The idea is based on zonotope approach by G. Koshevoy, H. Oja and others, see [4, 5]. Under the independence hypothesis the test statistic converges in distribution to the supremum of a certain Gaussian field, and its asymptotic distribution is found using the theory of extrema of random Gaussian fields developed by V. Piterbarg and Yu. Tyurin, see [6, 8]. In contrast to traditional correlation coefficients the formula is not symmetric.      

Tests for independence in non-parametric heteroscedastic regression models

Consistent procedures are constructed for testing independence between the regressor and the error in non-parametric regression models. The tests are based on the Fourier formulation of independence, and utilize the joint and the marginal empirical characteristic functions of the regressor and of estimated residuals. The asymptotic null distribution as well as the behavior of the test statistic under alternatives is investigated. A simulation study compares bootstrap versions of the proposed tests to corresponding procedures utilizing the empirical distribution function.     

Some high-dimensional tests for a one-way MANOVA

A statistic is proposed for testing the equality of the mean vectors in a one-way multivariate analysis of variance. The asymptotic null distribution of this statistic, as both the sample size and the number of variables go to infinity, is shown to be normal. Thus, this test can be used when the number of variables is not small relative to the sample size. In particular, it can be used when the number of variables exceeds the degrees of freedom for error, a situation in which standard MANOVA tests are invalid. A related statistic, also having an asymptotic normal distribution, is developed for tests concerning the dimensionality of the hyperplane formed by the population mean vectors. The finite sample size performances of the normal approximations are evaluated in a simulation study.     

A note on marginal and conditional independence

Some statistical models imply that two random vectors are marginally independent as well as being conditionally independent with respect to another random vector. When the joint distribution of the vectors is normal, canonical correlation analysis may lead to relevant simplifications of the dependence structure. A similar application can be found in elliptical models, where linear independence does not imply statistical independence. Implications for Bayes analysis of the general linear model are discussed.     

HAC estimation and strong linearity testing in weak ARMA models

In the framework of ARMA models, we consider testing the reliability of the standard asymptotic covariance matrix (ACM) of the least-squares estimator. The standard formula for this ACM is derived under the assumption that the errors are independent and identically distributed, and is in general invalid when the errors are only uncorrelated. The test statistic is based on the difference between a conventional estimator of the ACM of the least-squares estimator of the ARMA coefficients and its robust HAC-type version. The asymptotic distribution of the HAC estimator is established under the null hypothesis of independence, and under a large class of alternatives. The asymptotic distribution of the proposed statistic is shown to be a standard χ² under the null, and a noncentral χ² under the alternatives. The choice of the HAC estimator is discussed through asymptotic power comparisons. The finite sample properties of the test are analyzed via Monte Carlo simulation.     

On the dependence structure of order statistics

Given a random sample from a continuous variable, it is observed that the copula linking any pair of order statistics is independent of the parent distribution. To compare the degree of association between two such pairs of ordered random variables, a notion of relative monotone regression dependence (or stochastic increasingness) is considered. Using this concept, it is proved that for i<j, the dependence of the jth order statistic on the ith order statistic decreases as i and j draw apart. This extends earlier results of Tukey (Ann. Math. Statist. 29 (1958) 588) and Kim and David (J. Statist. Plann. Inference 24 (1990) 363). The effect of the sample size on this type of dependence is also investigated, and an explicit expression is given for the population value of Kendall's coefficient of concordance between two arbitrary order statistics of a random sample.     

Some inequalities for strong mixing random variables with applications to density estimation

In this paper, we establish an inequality of the characteristic functions for strongly mixing random vectors, by which, an upper bound is provided for the supremum of the absolute value of the difference of two multivariate probability density functions based on strongly mixing random vectors. As its application, we consider the consistency and asymptotic normality of a kernel estimate of a density function under strong mixing. Our results generalize some known results in the literature.     

Multivariate analysis of variance with fewer observations than the dimension

In this article, we consider the problem of testing a linear hypothesis in a multivariate linear regression model which includes the case of testing the equality of mean vectors of several multivariate normal populations with common covariance matrix Σ, the so-called multivariate analysis of variance or MANOVA problem. However, we have fewer observations than the dimension of the random vectors. Two tests are proposed and their asymptotic distributions under the hypothesis as well as under the alternatives are given under some mild conditions. A theoretical comparison of these powers is made.     

On testing equality of pairwise rank correlations in a multivariate random vector

Spearman’s rank-correlation coefficient (also called Spearman’s rho) represents one of the best-known measures to quantify the degree of dependence between two random variables. As a copula-based dependence measure, it is invariant with respect to the distribution’s univariate marginal distribution functions. In this paper, we consider statistical tests for the hypothesis that all pairwise Spearman’s rank correlation coefficients in a multivariate random vector are equal. The tests are nonparametric and their asymptotic distributions are derived based on the asymptotic behavior of the empirical copula process. Only weak assumptions on the distribution function, such as continuity of the marginal distributions and continuous partial differentiability of the copula, are required for obtaining the results. A nonparametric bootstrap method is suggested for either estimating unknown parameters of the test statistics or for determining the associated critical values. We present a simulation study in order to investigate the power of the proposed tests. The results are compared to a classical parametric test for equal pairwise Pearson’s correlation coefficients in a multivariate random vector. The general setting also allows the derivation of a test for stochastic independence based on Spearman’s rho.     

Testing independence in nonparametric regression

We propose a new test for independence of error and covariate in a nonparametric regression model. The test statistic is based on a kernel estimator for the L₂-distance between the conditional distribution and the unconditional distribution of the covariates. In contrast to tests so far available in literature, the test can be applied in the important case of multivariate covariates. It can also be adjusted for models with heteroscedastic variance. Asymptotic normality of the test statistic is shown. Simulation results and a real data example are presented.     

Dimension estimation in sufficient dimension reduction: A unifying approach

Sufficient Dimension Reduction (SDR) in regression comprises the estimation of the dimension of the smallest (central) dimension reduction subspace and its basis elements. For SDR methods based on a kernel matrix, such as SIR and SAVE, the dimension estimation is equivalent to the estimation of the rank of a random matrix which is the sample based estimate of the kernel. A test for the rank of a random matrix amounts to testing how many of its eigen or singular values are equal to zero. We propose two tests based on the smallest eigen or singular values of the estimated matrix: an asymptotic weighted chi-square test and a Wald-type asymptotic chi-square test. We also provide an asymptotic chi-square test for assessing whether elements of the left singular vectors of the random matrix are zero. These methods together constitute a unified approach for all SDR methods based on a kernel matrix that covers estimation of the central subspace and its dimension, as well as assessment of variable contribution to the lower-dimensional predictor projections with variable selection, a special case. A small power simulation study shows that the proposed and existing tests, specific to each SDR method, perform similarly with respect to power and achievement of the nominal level. Also, the importance of the choice of the number of slices as a tuning parameter is further exhibited.     

Inference for the invariance of canonical analysis under linear transformations

Using a recent result about the invariance problem in linear canonical analysis (LCA), we introduce a criterion by means of which one can see if this invariance holds when the related random vectors are transformed by linear maps. Then, the estimation of this criterion is considered as well as the problem of testing for invariance of LCA. Particularly, a new test for additional information in canonical analysis is proposed and simulations are used to gain understanding of the finite sample performance of this test and to compare it with the likelihood ratio test.     

A two-sample test for comparison of long memory parameters

We construct a two-sample test for comparison of long memory parameters based on ratios of two rescaled variance (V/S) statistics studied in Giraitis et al. [L. Giraitis, R. Leipus, A. Philippe, A test for stationarity versus trends and unit roots for a wide class of dependent errors, Econometric Theory 21 (2006) 989-1029]. The two samples have the same length and can be mutually independent or dependent. In the latter case, the test statistic is modified to make it asymptotically free of the long-run correlation coefficient between the samples. To diminish the sensitivity of the test on the choice of the bandwidth parameter, an adaptive formula for the bandwidth parameter is derived using the asymptotic expansion in Abadir et al. [K. Abadir, W. Distaso, L. Giraitis, Two estimators of the long-run variance: beyond short memory, Journal of Econometrics 150 (2009) 56-70]. A simulation study shows that the above choice of bandwidth leads to a good size of our comparison test for most values of fractional and ARMA parameters of the simulated series.     

Bootstrap,wild bootstrap,and asymptotic normality

Summary We show for an i.i.d. sample that bootstrap estimates consistently the distribution of a linear statistic if and only if the normal approximation with estimated variance works. An asymptotic approach is used where everything may depend onn. The result is extended to the case of independent, but not necessarily identically distributed random variables. Furthermore it is shown that wild bootstrap works under the same conditions as bootstrap.This work has been supported by the Deutsche Forschungsgemeinschaft, Sonderforschungsbereich 123 Stochastische Mathematische Modelle