Affine-invariant aligned rank tests for the multivariate general linear model with VARMA errors

We develop optimal rank-based procedures for testing affine-invariant linear hypotheses on the parameters of a multivariate general linear model with elliptical VARMA errors. We propose a class of optimal procedures that are based either on residual (pseudo-)Mahalanobis signs and ranks, or on absolute interdirections and lift-interdirection ranks, i.e., on hyperplane-based signs and ranks. The Mahalanobis versions of these procedures are strictly affine-invariant, while the hyperplane-based ones are asymptotically affine-invariant. Both versions generalize the univariate signed rank procedures proposed by Hallin and Puri (J. Multivar. Anal. 50 (1994) 175), and are locally asymptotically most stringent under correctly specified radial densities. Their AREs with respect to Gaussian procedures are shown to be convex linear combinations of the AREs obtained in Hallin and Paindaveine (Ann. Statist. 30 (2002) 1103; Bernoulli 8 (2002) 787) for the pure location and purely serial models, respectively. The resulting test statistics are provided under closed form for several important particular cases, including multivariate Durbin-Watson tests, VARMA order identification tests, etc. The key technical result is a multivariate asymptotic linearity result proved in Hallin and Paindaveine (Asymptotic linearity of serial and nonserial multivariate signed rank statistics, submitted).     

Empirical likelihood for linear models under m -dependent errors

In this paper, the empirical likelihood confidence regions for the regression coefficient in a linear model are constructed under m-dependent errors. It is shown that the blockwise empirical likelihood is a good way to deal with dependent samples. Partly supported by the National Natural Science Foundation of China and the SF of Guangxi Normal University.     

Berry-Esseen bounds for wavelet estimator in a regression model with linear process errors

In this paper, we derive the Berry-Esseen bounds of the wavelet estimator for a nonparametric regression model with linear process errors generated by φ-mixing sequences. As application, by the suitable choice of some constants, the convergence rate O(n^−1/6) of uniformly asymptotic normality of the wavelet estimator is obtained. Our results generalize some known results in the literature.     

Semi-parametric estimation of partially linear single-index models

One of the most difficult problems in applications of semi-parametric partially linear single-index models (PLSIM) is the choice of pilot estimators and complexity parameters which may result in radically different estimators. Pilot estimators are often assumed to be root-n consistent, although they are not given in a constructible way. Complexity parameters, such as a smoothing bandwidth are constrained to a certain speed, which is rarely determinable in practical situations.In this paper, efficient, constructible and practicable estimators of PLSIMs are designed with applications to time series. The proposed technique answers two questions from Carroll et al. [Generalized partially linear single-index models, J. Amer. Statist. Assoc. 92 (1997) 477-489]: no root-n pilot estimator for the single-index part of the model is needed and complexity parameters can be selected at the optimal smoothing rate. The asymptotic distribution is derived and the corresponding algorithm is easily implemented. Examples from real data sets (credit-scoring and environmental statistics) illustrate the technique and the proposed methodology of minimum average variance estimation (MAVE).     

Estimating the error distribution in nonparametric multiple regression with applications to model testing

In this paper we consider the estimation of the error distribution in a heteroscedastic nonparametric regression model with multivariate covariates. As estimator we consider the empirical distribution function of residuals, which are obtained from multivariate local polynomial fits of the regression and variance functions, respectively. Weak convergence of the empirical residual process to a Gaussian process is proved. We also consider various applications for testing model assumptions in nonparametric multiple regression. The model tests obtained are able to detect local alternatives that converge to zero at an n^−1/2-rate, independent of the covariate dimension. We consider in detail a test for additivity of the regression function.     

On rates of convergence in functional linear regression

This paper investigates the rate of convergence of estimating the regression weight function in a functional linear regression model. It is assumed that the predictor as well as the weight function are smooth and periodic in the sense that the derivatives are equal at the boundary points. Assuming that the functional data are observed at discrete points with measurement error, the complex Fourier basis is adopted in estimating the true data and the regression weight function based on the penalized least-squares criterion. The rate of convergence is then derived for both estimators. A simulation study is also provided to illustrate the numerical performance of our approach, and to make a comparison with the principal component regression approach.     

Long strange segments,ruin probabilities and the effect of memory on moving average processes

We obtain the rate of growth of long strange segments and the rate of decay of infinite horizon ruin probabilities for a class of infinite moving average processes with exponentially light tails. The rates are computed explicitly. We show that the rates are very similar to those of an i.i.d. process as long as the moving average coefficients decay fast enough. If they do not, then the rates are significantly different. This demonstrates the change in the length of memory in a moving average process associated with certain changes in the rate of decay of the coefficients.     

Kernel density estimation for spatial processes: the L1 theory

The purpose of this paper is to investigate kernel density estimators for spatial processes with linear or nonlinear structures. Sufficient conditions for such estimators to converge in L₁ are obtained under extremely general, verifiable conditions. The results hold for mixing as well as for nonmixing processes. Potential applications include testing for spatial interaction, the spatial analysis of causality structures, the definition of leading/lagging sites, the construction of clusters of comoving sites, etc.     

Estimation of a multivariate stochastic volatility density by kernel deconvolution

We consider a continuous time stochastic volatility model. The model contains a stationary volatility process. We aim to estimate the multivariate density of the finite-dimensional distributions of this process. We assume that we observe the process at discrete equidistant instants of time. The distance between two consecutive sampling times is assumed to tend to zero.A multivariate Fourier-type deconvolution kernel density estimator based on the logarithm of the squared processes is proposed to estimate the multivariate volatility density. An expansion of the bias and a bound on the variance are derived.     

Density testing in a contaminated sample

We study non-parametric tests for checking parametric hypotheses about a multivariate density f of independent identically distributed random vectors Z₁,Z₂,… which are observed under additional noise with density ψ. The tests we propose are an extension of the test due to Bickel and Rosenblatt [On some global measures of the deviations of density function estimates, Ann. Statist. 1 (1973) 1071-1095] and are based on a comparison of a nonparametric deconvolution estimator and the smoothed version of a parametric fit of the density f of the variables of interest Z_i. In an example the loss of efficiency is highlighted when the test is based on the convolved (but observable) density g=f*ψ instead on the initial density of interest f.     

Moving estimates test with time varying bandwidth

In this paper, we consider the problem of testing for parameter changes in time series models based on a moving estimates (ME) test. It is widely accepted that detecting some changes, for instance, those caused by temporary parameter shifts by the existing cusum test is difficult. A MV test with a fixed bandwidth has been developed to circumvent the defect, but the test still does not perform well under certain conditions. Motivated by this, we propose a MV test with a time varying bandwidth to outperform the original test. In order to illustrate our findings, we have provided simulation results.     

Statistical inference in a panel data semiparametric regression model with serially correlated errors

We consider a panel data semiparametric partially linear regression model with an unknown vector β of regression coefficients, an unknown nonparametric function g(·) for nonlinear component, and unobservable serially correlated errors. The correlated errors are modeled by a vector autoregressive process which involves a constant intraclass correlation. Applying the pilot estimators of β and g(·), we construct estimators of the autoregressive coefficients, the intraclass correlation and the error variance, and investigate their asymptotic properties. Fitting the error structure results in a new semiparametric two-step estimator of β, which is shown to be asymptotically more efficient than the usual semiparametric least squares estimator in terms of asymptotic covariance matrix. Asymptotic normality of this new estimator is established, and a consistent estimator of its asymptotic covariance matrix is presented. Furthermore, a corresponding estimator of g(·) is also provided. These results can be used to make asymptotically efficient statistical inference. Some simulation studies are conducted to illustrate the finite sample performances of these proposed estimators.     

Estimation in generalized linear models for functional data via penalized likelihood

We analyze in a regression setting the link between a scalar response and a functional predictor by means of a Functional Generalized Linear Model. We first give a theoretical framework and then discuss identifiability of the model. The functional coefficient of the model is estimated via penalized likelihood with spline approximation. The L² rate of convergence of this estimator is given under smoothness assumption on the functional coefficient. Heuristic arguments show how these rates may be improved for some particular frameworks.     

Functional semiparametric partially linear model with autoregressive errors

In this paper, we introduce a functional semiparametric model, where a real-valued random variable is explained by the sum of a unknown linear combination of the components of a multivariate random variable and an unknown transformation of a functional random variable. The errors can be autocorrelated. We focus here on the parametric estimation of the coefficients in the linear combination. First, we use a nonparametric kernel method to remove the effect of the functional explanatory variable. Then, we use generalized least squares approach to obtain an estimator of these coefficients. Under some technical assumptions, we prove consistency and asymptotic normality of our estimator. Finally, we present Monte Carlo simulations that illustrate these characteristics.     

Weak convergence of non-stationary multivariate marked processes with applications to martingale testing

This paper establishes the weak convergence of a class of marked empirical processes of possibly non-stationary and/or non-ergodic multivariate time series sequences under martingale conditions. The assumptions involved are similar to those in Brown's martingale central limit theorem. In particular, no mixing conditions are imposed. As an application, we propose a test statistic for the martingale hypothesis and we derive its asymptotic null distribution. Finally, a Monte Carlo study shows that the asymptotic results provide good approximations for small and moderate sample sizes. An application to the S&P 500 is also considered.     

Estimation of the regression operator from functional fixed-design with correlated errors

We consider the estimation of the regression operator r in the functional model: Y=r(x)+ε, where the explanatory variable x is of functional fixed-design type, the response Y is a real random variable and the error process ε is a second order stationary process. We construct the kernel type estimate of r from functional data curves and correlated errors. Then we study their performances in terms of the mean square convergence and the convergence in probability. In particular, we consider the cases of short and long range error processes. When the errors are negatively correlated or come from a short memory process, the asymptotic normality of this estimate is derived. Finally, some simulation studies are conducted for a fractional autoregressive integrated moving average and for an Ornstein-Uhlenbeck error processes.     

The effect of memory on functional large deviations of infinite moving average processes

The large deviations of an infinite moving average process with exponentially light tails are very similar to those of an i.i.d. sequence as long as the coefficients decay fast enough. If they do not, the large deviations change dramatically. We study this phenomenon in the context of functional large, moderate and huge deviation principles.     

Generalized partially linear models with missing covariates

In this article we study a semiparametric generalized partially linear model when the covariates are missing at random. We propose combining local linear regression with the local quasilikelihood technique and weighted estimating equation to estimate the parameters and nonparameters when the missing probability is known or unknown. We establish normality of the estimators of the parameter and asymptotic expansion for the estimators of the nonparametric part. We apply the proposed models and methods to a study of the relation between virologic and immunologic responses in AIDS clinical trials, in which virologic response is classified into binary variables. We also give simulation results to illustrate our approach.     

Tests for independence in non-parametric heteroscedastic regression models

Consistent procedures are constructed for testing independence between the regressor and the error in non-parametric regression models. The tests are based on the Fourier formulation of independence, and utilize the joint and the marginal empirical characteristic functions of the regressor and of estimated residuals. The asymptotic null distribution as well as the behavior of the test statistic under alternatives is investigated. A simulation study compares bootstrap versions of the proposed tests to corresponding procedures utilizing the empirical distribution function.     

Bootstrap testing for discontinuities under long-range dependence

We consider testing for discontinuities in a trend function when the residual process exhibits long memory. Using a wavelet decomposition of the estimated trend function into a low-resolution and a high-resolution component, a test statistic is proposed based on blockwise resampling of estimated residual variances. Asymptotic validity of the test is derived. A simulation study illustrates finite sample properties.