K-sample subsampling in general spaces: The case of independent time series

The problem of subsampling in two-sample and K-sample settings is addressed where both the data and the statistics of interest take values in general spaces. We focus on the case where each sample is a stationary time series, and construct subsampling confidence intervals and hypothesis tests with asymptotic validity. Some examples are also given, and the problem of optimal block size choice is discussed.     

Diagnostic checking for multivariate regression models

Diagnostic checking for multivariate parametric models is investigated in this article. A nonparametric Monte Carlo Test (NMCT) procedure is proposed. This Monte Carlo approximation is easy to implement and can automatically make any test procedure scale-invariant even when the test statistic is not scale-invariant. With it we do not need plug-in estimation of the asymptotic covariance matrix that is used to normalize test statistic and then the power performance can be enhanced. The consistency of NMCT approximation is proved. For comparison, we also extend the score type test to one-dimensional cases. NMCT can also be applied to diverse problems such as a classical problem for which we test whether or not certain covariables in linear model has significant impact for response. Although the Wilks lambda, a likelihood ratio test, is a proven powerful test, NMCT outperforms it especially in non-normal cases. Simulations are carried out and an application to a real data set is illustrated.     

Limit theorems for permutations of empirical processes with applications to change point analysis

Theorems of approximation of Gaussian processes for the sequential empirical process of the permutations of independent random variables are established. The results are applied to simulate critical values for the functionals of sequential empirical processes used in change point analysis. The proofs are based on the properties of rank statistics and negatively associated random variables.     

Bootstrap approximation of tail dependence function

For estimating a rare event via the multivariate extreme value theory, the so-called tail dependence function has to be investigated (see [L. de Haan, J. de Ronde, Sea and wind: Multivariate extremes at work, Extremes 1 (1998) 7-45]). A simple, but effective estimator for the tail dependence function is the tail empirical distribution function, see [X. Huang, Statistics of Bivariate Extreme Values, Ph.D. Thesis, Tinbergen Institute Research Series, 1992] or [R. Schmidt, U. Stadtmüller, Nonparametric estimation of tail dependence, Scand. J. Stat. 33 (2006) 307-335]. In this paper, we first derive a bootstrap approximation for a tail dependence function with an approximation rate via the construction approach developed by [K. Chen, S.H. Lo, On a mapping approach to investigating the bootstrap accuracy, Probab. Theory Relat. Fields 107 (1997) 197-217], and then apply it to construct a confidence band for the tail dependence function. A simulation study is conducted to assess the accuracy of the bootstrap approach.     

ON SOME TESTS FOR ELLIPTICAL SYMMETRY

In this paper, some test statistics of Kolmogorov type and Cramer-von Mises type based on projection pursuit technique are proposed for testing the sphericity problem of a high-dimensional distribution. The limiting distributions of the test statistics are derived under the null hypothesis and any fixed alternative. The asymptotic properties of Bootstrap approximation are investigated. Furthermore, for computational reasons, an approximation for the statistics, based on number theoretic method, is suggested.     

Multivariate nonparametric tests in a randomized complete block design

In this paper multivariate extensions of the Friedman and Page tests for the comparison of several treatments are introduced. Related unadjusted and adjusted treatment effect estimates for the multivariate response variable are also found and their properties discussed. The test statistics and estimates are analogous to the traditional univariate methods. In test constructions, the univariate ranks are replaced by multivariate spatial ranks (J. Nonparam. Statist. 5 (1995) 201). Asymptotic theory is developed to provide approximations for the limiting distributions of the test statistics and estimates. Limiting efficiencies of the tests and treatment effect estimates are found in the multivariate normal and t distribution cases. The tests are rotation invariant only, but affine invariant versions can be easily constructed. The theory is illustrated by an example.     

Bootstrap,wild bootstrap,and asymptotic normality

Summary We show for an i.i.d. sample that bootstrap estimates consistently the distribution of a linear statistic if and only if the normal approximation with estimated variance works. An asymptotic approach is used where everything may depend onn. The result is extended to the case of independent, but not necessarily identically distributed random variables. Furthermore it is shown that wild bootstrap works under the same conditions as bootstrap.This work has been supported by the Deutsche Forschungsgemeinschaft, Sonderforschungsbereich 123 Stochastische Mathematische Modelle     

Multivariate dependence of spacings of generalized order statistics

Multivariate dependence of spacings of generalized order statistics is studied. It is shown that spacings of generalized order statistics from DFR (IFR) distributions have the CIS (CDS) property. By restricting the choice of the model parameters and strengthening the assumptions on the underlying distribution, stronger dependence relations are established. For instance, if the model parameters are decreasingly ordered and the underlying distribution has a log-convex decreasing (log-concave) hazard rate, then the spacings satisfy the MTP₂ (S- MRR₂) property. Some consequences of the results are given. In particular, conditions for non-negativity of the best linear unbiased estimator of the scale parameter in a location-scale family are obtained. By applying a result for dual generalized order statistics, we show that in the particular situation of usual order statistics the assumptions can be weakened.     

On some testing problems for sparse contingency tables

A class of test statistics are proposed for sparse tables with ordered categories. It is shown that for different testing situations these test statistics asymptotically more powerful tests than Pearson's chi-square.     

Conditionally specified models and dimension reduction in the exponential families

We consider informative dimension reduction for regression problems with random predictors. Based on the conditional specification of the model, we develop a methodology for replacing the predictors with a smaller number of functions of the predictors. We apply the method to the case where the inverse conditional model is in the linear exponential family. For such an inverse model and the usual Normal forward regression model it is shown that, for any number of predictors, the sufficient summary has dimension two or less. In addition, we develop a test of dimensionality. The relationship of our method with the existing dimension reduction theory based on the marginal distribution of the predictors is discussed.     

Sufficient dimension reduction for the conditional mean with a categorical predictor in multivariate regression

Recent sufficient dimension reduction methodologies in multivariate regression do not have direct application to a categorical predictor. For this, we define the multivariate central partial mean subspace and propose two methodologies to estimate it. The first method uses the ordinary least squares. Chi-squared distributed statistics for dimension tests are constructed, and an estimate of the target subspace is consistent and efficient. Moreover, the effects of continuous predictors can be tested without assuming any model. The second method extends Iterative Hessian Transformation to this context. For dimension estimation, permutation tests are used. Simulated and real data examples for illustrating various properties of the proposed methods are presented.     

Affine-invariant aligned rank tests for the multivariate general linear model with VARMA errors

We develop optimal rank-based procedures for testing affine-invariant linear hypotheses on the parameters of a multivariate general linear model with elliptical VARMA errors. We propose a class of optimal procedures that are based either on residual (pseudo-)Mahalanobis signs and ranks, or on absolute interdirections and lift-interdirection ranks, i.e., on hyperplane-based signs and ranks. The Mahalanobis versions of these procedures are strictly affine-invariant, while the hyperplane-based ones are asymptotically affine-invariant. Both versions generalize the univariate signed rank procedures proposed by Hallin and Puri (J. Multivar. Anal. 50 (1994) 175), and are locally asymptotically most stringent under correctly specified radial densities. Their AREs with respect to Gaussian procedures are shown to be convex linear combinations of the AREs obtained in Hallin and Paindaveine (Ann. Statist. 30 (2002) 1103; Bernoulli 8 (2002) 787) for the pure location and purely serial models, respectively. The resulting test statistics are provided under closed form for several important particular cases, including multivariate Durbin-Watson tests, VARMA order identification tests, etc. The key technical result is a multivariate asymptotic linearity result proved in Hallin and Paindaveine (Asymptotic linearity of serial and nonserial multivariate signed rank statistics, submitted).     

Local efficiency of a Cramér-von Mises test of independence

Deheuvels proposed a rank test of independence based on a Cramér-von Mises functional of the empirical copula process. Using a general result on the asymptotic distribution of this process under sequences of contiguous alternatives, the local power curve of Deheuvels’ test is computed in the bivariate case and compared to that of competing procedures based on linear rank statistics. The Gil-Pelaez inversion formula is used to make additional comparisons in terms of a natural extension of Pitman's measure of asymptotic relative efficiency.     

Sequential order statistics with an order statistics prior

In the model of sequential order statistics, prior distributions are considered for the model parameters, which, for example, describe increasing load put on remaining components. Gamma priors are examined as well as priors out of a class of extended truncated Erlang distributions (ETED), which is introduced along with some properties. The choice of independent priors in both set-ups leads to respective independent, conjugate posterior distributions for the model parameters of sequential order statistics. Since, in practical applications, the model parameters will often be increasingly ordered, a multivariate prior is applied being the joint distribution of common ETED-order statistics. Whatever baseline distribution of the sequential order statistics is chosen, the joint posterior distribution turns out to be a Weinman multivariate exponential distribution. Posterior moments are given explicitly, and HPD credible sets for the model parameters are stated.     

Likelihood ratio tests for goodness-of-fit of a nonlinear regression model

We propose likelihood and restricted likelihood ratio tests for goodness-of-fit of nonlinear regression. The first-order Taylor approximation around the MLE of the regression parameters is used to approximate the null hypothesis and the alternative is modeled nonparametrically using penalized splines. The exact finite sample distribution of the test statistics is obtained for the linear model approximation and can be easily simulated. We recommend using the restricted likelihood instead of the likelihood ratio test because restricted maximum-likelihood estimates are not as severely biased as the maximum-likelihood estimates in the penalized splines framework.     

On a new multivariate two-sample test

In this paper we propose a new test for the multivariate two-sample problem. The test statistic is the difference of the sum of all the Euclidean interpoint distances between the random variables from the two different samples and one-half of the two corresponding sums of distances of the variables within the same sample. The asymptotic null distribution of the test statistic is derived using the projection method and shown to be the limit of the bootstrap distribution. A simulation study includes the comparison of univariate and multivariate normal distributions for location and dispersion alternatives. For normal location alternatives the new test is shown to have power similar to that of the t- and T²-Test.     

Nonparametric inference for extrinsic means on size-and-(reflection)-shape manifolds with applications in medical imaging

For all p>2,k>p, a size-and-reflection-shape space of k-ads in general position in R^p, invariant under translation, rotation and reflection, is shown to be a smooth manifold and is equivariantly embedded in a space of symmetric matrices, allowing a nonparametric statistical analysis based on extrinsic means. Equivariant embeddings are also given for the reflection-shape-manifold , a space of orbits of scaled k-ads in general position under the group of isometries of R^p, providing a methodology for statistical analysis of three-dimensional images and a resolution of the mathematical problems inherent in the use of the Kendall shape spaces in p-dimensions, p>2. The Veronese embedding of the planar Kendall shape manifold is extended to an equivariant embedding of the size-and-shape manifold , which is useful in the analysis of size-and-shape. Four medical imaging applications are provided to illustrate the theory.     

Nonparametric tests of independence between random vectors

A nonparametric test of the mutual independence between many numerical random vectors is proposed. This test is based on a characterization of mutual independence defined from probabilities of half-spaces in a combinatorial formula of Möbius. As such, it is a natural generalization of tests of independence between univariate random variables using the empirical distribution function. If the number of vectors is p and there are n observations, the test is defined from a collection of processes R_n,A, where A is a subset of {1,…,p} of cardinality |A|>1, which are asymptotically independent and Gaussian. Without the assumption that each vector is one-dimensional with a continuous cumulative distribution function, any test of independence cannot be distribution free. The critical values of the proposed test are thus computed with the bootstrap which is shown to be consistent. Another similar test, with the same asymptotic properties, for the serial independence of a multivariate stationary sequence is also proposed. The proposed test works when some or all of the marginal distributions are singular with respect to Lebesgue measure. Moreover, in singular cases described in Section 4, the test inherits useful invariance properties from the general affine invariance property.     

Order restricted inference for sequential k-out-of-n systems

Sequential order statistics have been introduced to model sequential k-out-of-n systems which, as an extension of k-out-of-n systems, allow the failure of some components of the system to influence the remaining ones. Based on an independent sample of vectors of sequential order statistics, the maximum likelihood estimators of the model parameters of a sequential k-out-of-n system are derived under order restrictions. Special attention is paid to the simultaneous maximum likelihood estimation of the model parameters and the distribution parameters for a flexible location-scale family. Furthermore, order restricted hypothesis tests are considered for making the decision whether the usual k-out-of-n model or the general sequential k-out-of-n model is appropriate for a given data.     

Auto-associative models and generalized principal component analysis

In this paper, we propose auto-associative (AA) models to generalize Principal component analysis (PCA). AA models have been introduced in data analysis from a geometrical point of view. They are based on the approximation of the observations scatter-plot by a differentiable manifold. In this paper, they are interpreted as Projection pursuit models adapted to the auto-associative case. Their theoretical properties are established and are shown to extend the PCA ones. An iterative algorithm of construction is proposed and its principle is illustrated both on simulated and real data from image analysis.