On confidence bands for multivariate nonparametric regression

In a multivariate nonparametric regression problem with fixed, deterministic design asymptotic, uniform confidence bands for the regression function are constructed. The construction of the bands is based on the asymptotic distribution of the maximal deviation between a suitable nonparametric estimator and the true regression function which is derived by multivariate strong approximation methods and a limit theorem for the supremum of a stationary Gaussian field over an increasing system of sets. The results are derived for a general class of estimators which includes local polynomial estimators as a special case. The finite sample properties of the proposed asymptotic bands are investigated by means of a small simulation study.     

Adaptive nonparametric estimation of a multivariate regression function

We consider the kernel estimation of a multivariate regression function at a point. Theoretical choices of the bandwidth are possible for attaining minimum mean squared error or for local scaling, in the sense of asymptotic distribution. However, these choices are not available in practice. We follow the approach of Krieger and Pickands (Ann. Statist.9 (1981) 1066–1078) and Abramson (J. Multivariate Anal.12 (1982), 562–567) in constructing adaptive estimates after demonstrating the weak convergence of some error process. As consequences, efficient data-driven consistent estimation is feasible, and data-driven local scaling is also feasible. In the latter instance, nearest-neighbor-type estimates and variance-stabilizing estimates are obtained as special cases.     

Minimax nonparametric testing in a problem related to the radon transform

We consider the detection problem of a two-dimensional function from noisy observations of its integrals over lines. We study both rate and sharp asymptotics for the error probabilities in the minimax setup. By construction, the derived tests are non-adaptive. We also construct a minimax rate-optimal adaptive test of rather simple structure.     

Optimal testing for additivity in multiple nonparametric regression

We consider the problem of testing for additivity in the standard multiple nonparametric regression model. We derive optimal (in the minimax sense) non- adaptive and adaptive hypothesis testing procedures for additivity against the composite nonparametric alternative that the response function involves interactions of second or higher orders separated away from zero in L ²([0, 1] ^d )-norm and also possesses some smoothness properties. In order to shed some light on the theoretical results obtained, we carry out a wide simulation study to examine the finite sample performance of the proposed hypothesis testing procedures and compare them with a series of other tests for additivity available in the literature.     

Variance function estimation in multivariate nonparametric regression with fixed design

Variance function estimation in multivariate nonparametric regression is considered and the minimax rate of convergence is established in the iid Gaussian case. Our work uses the approach that generalizes the one used in [A. Munk, Bissantz, T. Wagner, G. Freitag, On difference based variance estimation in nonparametric regression when the covariate is high dimensional, J. R. Stat. Soc. B 67 (Part 1) (2005) 19-41] for the constant variance case. As is the case when the number of dimensions d=1, and very much contrary to standard thinking, it is often not desirable to base the estimator of the variance function on the residuals from an optimal estimator of the mean. Instead it is desirable to use estimators of the mean with minimal bias. Another important conclusion is that the first order difference based estimator that achieves minimax rate of convergence in the one-dimensional case does not do the same in the high dimensional case. Instead, the optimal order of differences depends on the number of dimensions.     

A nonparametric regression cross spectrum for multivariate time series

We consider dependence structures in multivariate time series that are characterized by deterministic trends. Results from spectral analysis for stationary processes are extended to deterministic trend functions. A regression cross covariance and spectrum are defined. Estimation of these quantities is based on wavelet thresholding. The method is illustrated by a simulated example and a three-dimensional time series consisting of ECG, blood pressure and cardiac stroke volume measurements.     

Optimal global rates of convergence ofM-estimates for multivariate nonparametric regression

Consider the nonparametric regression modelY=go(T)+u, whereY is real-valued,u is a random error,T is a randomd-vector of explanatory variables ranging over a nondegenerated-dimensional compact setC, andgo(·) is the unknown smooth regression function, which ism (0) times continuously differentiable and itsmth partial derivatives satisfy the Hölder condition with exponent(0,1], wherei ₁, ...,i _d are nonnegative integers satisfying _k ^=1/d i _k =m. The piecewise polynomial estimator ofgo based onM-estimates is considered. It is proved that the rate of convergence of the underlying estimator is under certain regular conditions, which is the optimal global rate of convergence of least square estimates for nonparametric regression studied in [10–11].This work is partly supported by the National Natural Science Foundation of China.     

Minimax lower bound for kink location estimators in a nonparametric regression model with long-range dependence

In this paper, a lower bound is determined in the minimax sense for change point estimators of the first derivative of a regression function in the fractional white noise model. Similar minimax results presented previously in the area focus on change points in the derivatives of a regression function in the white noise model or consider estimation of the regression function in the presence of correlated errors.     

Asymptotics of estimators for nonparametric multivariate regression models with long memory

In this paper, a nonparametric multivariate regression model with long memory covariates and long memory errors is considered. We approximate the nonparametric multivariate regression function by the weighted additive one-dimensional functions. The local linear smoothing and least squares method are proposed for the one-dimensional regression estimation and the weight parameters estimation, respectively. The asymptotic behaviors of the proposed estimators are investigated.     

A nonparametric regression method for multiple longitudinal phenotypes using multivariate adaptive splines

In genetic studies of complex diseases, particularly mental illnesses, and behavior disorders, two distinct characteristics have emerged in some data sets. First, genetic data sets are collected with a large number of phenotypes that are potentially related to the complex disease under study. Second, each phenotype is collected from the same subject repeatedly over time. In this study, we present a nonparametric regression approach to study multivariate and time-repeated phenotypes together by using the technique of the multivariate adaptive regression splines for analysis of longitudinal data (MASAL), which makes it possible to identify genes, gene-gene and gene-environment, including time, interactions associated with the phenotypes of interest. Furthermore, we propose a permutation test to assess the associations between the phenotypes and selected markers. Through simulation, we demonstrate that our proposed approach has advantages over the existing methods that examine each longitudinal phenotype separately or analyze the summarized values of phenotypes by compressing them into one-time-point phenotypes. Application of the proposed method to the Framingham Heart Study illustrates that the use of multivariate longitudinal phenotypes enhanced the significance of the association test.     

Power maps in goodness-of-fit testing

For classical goodness-of-fit tests as well as for their modified versions in case of Type-II right censored data, results of a simulation study are presented, where the powers of the tests under consideration against beta alternatives are illustrated in informative, user-oriented plots that offer the possibility to directly choose the best test statistic in a concrete situation, when some prior belief about the alternative is available. The behavior of powers of respective statistical tests as functions of beta parameters is examined and discussed.     

Some multivariate linear regression testing problems with additional observations

In an earlier paper, the present author ([6], Calcutta Statist. Assoc. Bull.28, 47–56) proposed a similar test for a mean testing problem with additional observations on a set of correlated auxiliary variables. This idea has been extended here to cover some multivariate linear regression testing problems with the same type of additional observations on a set of correlated auxiliary variables.     

Estimating the error distribution in nonparametric multiple regression with applications to model testing

In this paper we consider the estimation of the error distribution in a heteroscedastic nonparametric regression model with multivariate covariates. As estimator we consider the empirical distribution function of residuals, which are obtained from multivariate local polynomial fits of the regression and variance functions, respectively. Weak convergence of the empirical residual process to a Gaussian process is proved. We also consider various applications for testing model assumptions in nonparametric multiple regression. The model tests obtained are able to detect local alternatives that converge to zero at an n^−1/2-rate, independent of the covariate dimension. We consider in detail a test for additivity of the regression function.     

Cardinal splines in nonparametric regression

We discuss a nonparametric regression model on an equidistant grid of the real line. A class of kernel type estimates based on the so-called fundamental cardinal splines will be introduced. Asymptotic optimality of these estimates will be established for certain functional classes. This model explains the often mentioned heuristic fact that cubic splines are adequate for most practical applications.      

Testing independence in nonparametric regression

We propose a new test for independence of error and covariate in a nonparametric regression model. The test statistic is based on a kernel estimator for the L₂-distance between the conditional distribution and the unconditional distribution of the covariates. In contrast to tests so far available in literature, the test can be applied in the important case of multivariate covariates. It can also be adjusted for models with heteroscedastic variance. Asymptotic normality of the test statistic is shown. Simulation results and a real data example are presented.     

Robust nonparametric regression estimation

In this paper we define a robust conditional location functional without requiring any moment condition. We apply the nonparametric proposals considered by C. Stone (Ann. Statist. 5 (1977), 595–645) to this functional equation in order to obtain strongly consistent, robust nonparametric estimates of the regression function. We give some examples by using nearest neighbor weights or weights based on kernel methods under no assumptions whatsoever on the probability measure of the vector (X,Y). We also derive strong convergence rates and the asymptotic distribution of the proposed estimates.     

Testing strict monotonicity in nonparametric regression

A new test for strict monotonicity of the regression function is proposed which is based on a composition of an estimate of the inverse of the regression function with a common regression estimate. This composition is equal to the identity if and only if the “true” regression function is strictly monotone, and a test based on an L ²-distance is investigated. The asymptotic normality of the corresponding test statistic is established under the null hypothesis of strict monotonicity.      

Minimax multivariate empirical Bayes estimators under multicollinearity

In this paper we consider the problem of estimating the matrix of regression coefficients in a multivariate linear regression model in which the design matrix is near singular. Under the assumption of normality, we propose empirical Bayes ridge regression estimators with three types of shrinkage functions, that is, scalar, componentwise and matricial shrinkage. These proposed estimators are proved to be uniformly better than the least squares estimator, that is, minimax in terms of risk under the Strawderman's loss function. Through simulation and empirical studies, they are also shown to be useful in the multicollinearity cases.     

Error inference for nonparametric regression

This study examines means for inferring the distribution of the error in nonparametric regression. The central objective is to develop confidence intervals for nonparametric regression. Our computational study would seem to affirm that our methods are potentially useful in cases of small sample size or heterogeneously distributed error. Theoretical developments offer sufficient conditions for asymptotic normality.This work was undertaken while Dr. Rutherford was with the University of Arizona. It was supported in part by NSF grant DPP 82-19439.