Tests for independence in non-parametric heteroscedastic regression models

Consistent procedures are constructed for testing independence between the regressor and the error in non-parametric regression models. The tests are based on the Fourier formulation of independence, and utilize the joint and the marginal empirical characteristic functions of the regressor and of estimated residuals. The asymptotic null distribution as well as the behavior of the test statistic under alternatives is investigated. A simulation study compares bootstrap versions of the proposed tests to corresponding procedures utilizing the empirical distribution function.     

Semi-aligned rank tests

Summary The distribution-free test based on semi-aligned rankings for no treatment effects in a two-way layout, with unequal number of replications in each cell is considered. The asymptotic χ-square distribution of the test statistic under the null hypothesis is derived. The Pitman asymptotic relative efficiency of the test (i) based on semi-aligned rankings with respect to the test (ii) based on within-block rankings, is shown to be larger than one as the number of blocks tends to infinity. Also the asymptotic properties of linear rank statistics (i) and (ii) are investigated and the asymptotic relative efficiency of the test (i) with respect to the test (ii) is again shown to be larger than one.     

Multivariate nonparametric tests in a randomized complete block design

In this paper multivariate extensions of the Friedman and Page tests for the comparison of several treatments are introduced. Related unadjusted and adjusted treatment effect estimates for the multivariate response variable are also found and their properties discussed. The test statistics and estimates are analogous to the traditional univariate methods. In test constructions, the univariate ranks are replaced by multivariate spatial ranks (J. Nonparam. Statist. 5 (1995) 201). Asymptotic theory is developed to provide approximations for the limiting distributions of the test statistics and estimates. Limiting efficiencies of the tests and treatment effect estimates are found in the multivariate normal and t distribution cases. The tests are rotation invariant only, but affine invariant versions can be easily constructed. The theory is illustrated by an example.     

Homogeneity tests based on several progressively Type-II censored samples

In this paper, we discuss the problem of testing the homogeneity of several populations when the available data are progressively Type-II censored. Defining for each sample a univariate counting process, we can modify all the methods that were developed during the last two decades (see e.g. [P.K. Andersen, Ø. Borgan, R. Gill, N. Keiding, Statistical Models Based on Counting Processes, Springer, New York, 1993]) for use to this problem. An important aspect of these tests is that they are based on either linear or non-linear functionals of a discrepancy process (DP) based on the comparison of the cumulative hazard rate (chr) estimated from each sample with the chr estimated from the whole sample (viz., the aggregation of all the samples), leading to either linear tests or non-linear tests. Both these kinds of tests suffer from some serious drawbacks. For example, it is difficult to extend non-linear tests to the K-sample situation when K?3. For this reason, we propose here a new class of non-linear tests, based on a chi-square type functional of the DP, that can be applied to the K-sample problem for any K?2.     

Likelihood ratio tests of correlated multivariate samples

We develop methods to compare multiple multivariate normally distributed samples which may be correlated. The methods are new in the context that no assumption is made about the correlations among the samples. Three types of null hypotheses are considered: equality of mean vectors, homogeneity of covariance matrices, and equality of both mean vectors and covariance matrices. We demonstrate that the likelihood ratio test statistics have finite-sample distributions that are functions of two independent Wishart variables and dependent on the covariance matrix of the combined multiple populations. Asymptotic calculations show that the likelihood ratio test statistics converge in distribution to central Chi-squared distributions under the null hypotheses regardless of how the populations are correlated. Following these theoretical findings, we propose a resampling procedure for the implementation of the likelihood ratio tests in which no restrictive assumption is imposed on the structures of the covariance matrices. The empirical size and power of the test procedure are investigated for various sample sizes via simulations. Two examples are provided for illustration. The results show good performance of the methods in terms of test validity and power.     

An asymptotic decomposition for multivariate distribution-free tests of independence

In the multivariate case, the empirical dependence function, defined as the empirical distribution function with reduced uniform margins on the unit interval, can be shown for an i.i.d. sequence to converge weakly in an asymptotic way to a limiting Gaussian process. The main result of this paper is that this limiting process can be canonically separated into a finite set of independent Gaussian processes, enabling one to test the existence of dependence relationships within each subset of coordinates independently (in an asymptotic way) of what occurs in the other subsets. As an application we derive the Karhunen-Loeve expansions of the corresponding processes and give the limiting distribution of the multivariate Cramer-Von Mises test of independence, generalizing results of Blum, Kiefer, Rosenblatt, and Dugué. Other extensions are mentioned, including a generalization of Kendall's τ.     

Likelihood ratio tests for goodness-of-fit of a nonlinear regression model

We propose likelihood and restricted likelihood ratio tests for goodness-of-fit of nonlinear regression. The first-order Taylor approximation around the MLE of the regression parameters is used to approximate the null hypothesis and the alternative is modeled nonparametrically using penalized splines. The exact finite sample distribution of the test statistics is obtained for the linear model approximation and can be easily simulated. We recommend using the restricted likelihood instead of the likelihood ratio test because restricted maximum-likelihood estimates are not as severely biased as the maximum-likelihood estimates in the penalized splines framework.     

Signed-rank tests for location in the symmetric independent component model

The so-called independent component (IC) model states that the observed p-vector X is generated via X=ΛZ+μ, where μ is a p-vector, Λ is a full-rank matrix, and the centered random vector Z has independent marginals. We consider the problem of testing the null hypothesis H₀:μ=0 on the basis of i.i.d. observations X₁,…,X_n generated by the symmetric version of the IC model above (for which all ICs have a symmetric distribution about the origin). In the spirit of [M. Hallin, D. Paindaveine, Optimal tests for multivariate location based on interdirections and pseudo-Mahalanobis ranks, Annals of Statistics, 30 (2002), 1103-1133], we develop nonparametric (signed-rank) tests, which are valid without any moment assumption and are, for adequately chosen scores, locally and asymptotically optimal (in the Le Cam sense) at given densities. Our tests are measurable with respect to the marginal signed ranks computed in the collection of null residuals , where is a suitable estimate of Λ. Provided that is affine-equivariant, the proposed tests, unlike the standard marginal signed-rank tests developed in [M.L. Puri, P.K. Sen, Nonparametric Methods in Multivariate Analysis, Wiley & Sons, New York, 1971] or any of their obvious generalizations, are affine-invariant. Local powers and asymptotic relative efficiencies (AREs) with respect to Hotelling’s T² test are derived. Quite remarkably, when Gaussian scores are used, these AREs are always greater than or equal to one, with equality in the multinormal model only. Finite-sample efficiencies and robustness properties are investigated through a Monte Carlo study.     

Variance component testing in semiparametric mixed models

It is of considerable interest to test for heteroscedasticity in statistical studies. In this paper, we investigate such a problem under the framework of a semiparametric mixed model. A score test is proposed for the hypothesis that all the variance components are zero. We establish the asymptotic property of the test, and examine its performance in a simulation study. The test is illustrated with the analysis of a longitudinal study of measurements of serum creatinine.     

Depth estimators and tests based on the likelihood principle with application to regression

We investigate depth notions for general models which are derived via the likelihood principle. We show that the so-called likelihood depth for regression in generalized linear models coincides with the regression depth of Rousseeuw and Hubert (J. Amer. Statist. Assoc. 94 (1999) 388) if the dependent observations are appropriately transformed. For deriving tests, the likelihood depth is extended to simplicial likelihood depth. The simplicial likelihood depth is always a U-statistic which is in some cases not degenerated. Since the U-statistic is degenerated in the most cases, we demonstrate that nevertheless the asymptotic distribution of the simplicial likelihood depth and thus asymptotic α-level tests for general types of hypotheses can be derived. The tests are distribution-free. We work out the method for linear and quadratic regression.     

Nonparametric tests for conditional independence in two-way contingency tables

Testing for the independence between two categorical variables R and S forming a contingency table is a well-known problem: the classical chi-square and likelihood ratio tests are used. Suppose now that for each individual a set of p characteristics is also observed. Those explanatory variables, likely to be associated with R and S, can play a major role in their possible association, and it can therefore be interesting to test the independence between R and S conditionally on them. In this paper, we propose two nonparametric tests which generalise the chi-square and the likelihood ratio ideas to this case. The procedure is based on a kernel estimator of the conditional probabilities. The asymptotic law of the proposed test statistics under the conditional independence hypothesis is derived; the finite sample behaviour of the procedure is analysed through some Monte Carlo experiments and the approach is illustrated with a real data example.     

Moving estimates test with time varying bandwidth

In this paper, we consider the problem of testing for parameter changes in time series models based on a moving estimates (ME) test. It is widely accepted that detecting some changes, for instance, those caused by temporary parameter shifts by the existing cusum test is difficult. A MV test with a fixed bandwidth has been developed to circumvent the defect, but the test still does not perform well under certain conditions. Motivated by this, we propose a MV test with a time varying bandwidth to outperform the original test. In order to illustrate our findings, we have provided simulation results.     

Empirical Hankel transforms and its applications to goodness-of-fit tests

We introduce a special Hankel transform for probability distributions on the nonnegative half-line and discuss some of its properties. Due to the uniqueness of the transform we suggest an integral type test statistic based on the empirical Hankel transform to treat simple and composite hypotheses goodness-of-fit problems. The special case of exponential distributions is studied in detail.     

Nonparametric tests for homogeneity of scale against ordered alternatives

Summary In this paper the nonparametric several sample scale problem is considered and some tests are proposed for the hypothesis of homogeneity versus ordered alternatives. These tests are based on statistics that are weighted linear combinations of Sugiura (1965,Osaka J. Math.,2, 385–426) type statistics proposed for testing homogeneity of scale against the omnibus alternative. For each class of test statistics suggested, the member with maximum Pitman efficiency is identified. The optimal statistics are compared with their parametric and nonparametric competitors.     

Structural test in regression on functional variables

Many papers deal with structural testing procedures in multivariate regression. More recently, various estimators have been proposed for regression models involving functional explanatory variables. Thanks to these new estimators, we propose a theoretical framework for structural testing procedures adapted to functional regression. The procedures introduced in this paper are innovative and make the link between former works on functional regression and others on structural testing procedures in multivariate regression. We prove asymptotic properties of the level and the power of our procedures under general assumptions that cover a large scope of possible applications: tests for no effect, linearity, dimension reduction, …     

A link-free method for testing the significance of predictors

One important step in regression analysis is to identify significant predictors from a pool of candidates so that a parsimonious model can be obtained using these significant predictors only. However, most of the existing methods assume linear relationships between response and predictors, which may be inappropriate in some applications. In this article, we discuss a link-free method that avoids specifying how the response depends on the predictors. Therefore, this method has no problem of model misspecification, and it is suitable for selecting significant predictors at the preliminary stage of data analysis. A test statistic is suggested and its asymptotic distribution is derived. Examples are used to demonstrate the proposed method.     

Estimating the error distribution in nonparametric multiple regression with applications to model testing

In this paper we consider the estimation of the error distribution in a heteroscedastic nonparametric regression model with multivariate covariates. As estimator we consider the empirical distribution function of residuals, which are obtained from multivariate local polynomial fits of the regression and variance functions, respectively. Weak convergence of the empirical residual process to a Gaussian process is proved. We also consider various applications for testing model assumptions in nonparametric multiple regression. The model tests obtained are able to detect local alternatives that converge to zero at an n^−1/2-rate, independent of the covariate dimension. We consider in detail a test for additivity of the regression function.     

Affine-invariant aligned rank tests for the multivariate general linear model with VARMA errors

We develop optimal rank-based procedures for testing affine-invariant linear hypotheses on the parameters of a multivariate general linear model with elliptical VARMA errors. We propose a class of optimal procedures that are based either on residual (pseudo-)Mahalanobis signs and ranks, or on absolute interdirections and lift-interdirection ranks, i.e., on hyperplane-based signs and ranks. The Mahalanobis versions of these procedures are strictly affine-invariant, while the hyperplane-based ones are asymptotically affine-invariant. Both versions generalize the univariate signed rank procedures proposed by Hallin and Puri (J. Multivar. Anal. 50 (1994) 175), and are locally asymptotically most stringent under correctly specified radial densities. Their AREs with respect to Gaussian procedures are shown to be convex linear combinations of the AREs obtained in Hallin and Paindaveine (Ann. Statist. 30 (2002) 1103; Bernoulli 8 (2002) 787) for the pure location and purely serial models, respectively. The resulting test statistics are provided under closed form for several important particular cases, including multivariate Durbin-Watson tests, VARMA order identification tests, etc. The key technical result is a multivariate asymptotic linearity result proved in Hallin and Paindaveine (Asymptotic linearity of serial and nonserial multivariate signed rank statistics, submitted).     

Semi-parametric estimation of partially linear single-index models

One of the most difficult problems in applications of semi-parametric partially linear single-index models (PLSIM) is the choice of pilot estimators and complexity parameters which may result in radically different estimators. Pilot estimators are often assumed to be root-n consistent, although they are not given in a constructible way. Complexity parameters, such as a smoothing bandwidth are constrained to a certain speed, which is rarely determinable in practical situations.In this paper, efficient, constructible and practicable estimators of PLSIMs are designed with applications to time series. The proposed technique answers two questions from Carroll et al. [Generalized partially linear single-index models, J. Amer. Statist. Assoc. 92 (1997) 477-489]: no root-n pilot estimator for the single-index part of the model is needed and complexity parameters can be selected at the optimal smoothing rate. The asymptotic distribution is derived and the corresponding algorithm is easily implemented. Examples from real data sets (credit-scoring and environmental statistics) illustrate the technique and the proposed methodology of minimum average variance estimation (MAVE).     

On rates of convergence in functional linear regression

This paper investigates the rate of convergence of estimating the regression weight function in a functional linear regression model. It is assumed that the predictor as well as the weight function are smooth and periodic in the sense that the derivatives are equal at the boundary points. Assuming that the functional data are observed at discrete points with measurement error, the complex Fourier basis is adopted in estimating the true data and the regression weight function based on the penalized least-squares criterion. The rate of convergence is then derived for both estimators. A simulation study is also provided to illustrate the numerical performance of our approach, and to make a comparison with the principal component regression approach.