Plug-in method for nonparametric regression

The problem of bandwidth selection for non-parametric kernel regression is considered. We will follow the Nadaraya–Watson and local linear estimator especially. The circular design is assumed in this work to avoid the difficulties caused by boundary effects. Most of bandwidth selectors are based on the residual sum of squares (RSS). It is often observed in simulation studies that these selectors are biased toward undersmoothing. This leads to consideration of a procedure which stabilizes the RSS by modifying the periodogram of the observations. As a result of this procedure, we obtain an estimation of unknown parameters of average mean square error function (AMSE). This process is known as a plug-in method. Simulation studies suggest that the plug-in method could have preferable properties to the classical one. Supported by the MSMT: LC 06024.     

A bias corrected nonparametric regression estimator

In this article, we propose a new method of bias reduction in nonparametric regression estimation. The proposed new estimator has asymptotic bias order h⁴, where h is a smoothing parameter, in contrast to the usual bias order h² for the local linear regression. In addition, the proposed estimator has the same order of the asymptotic variance as the local linear regression. Our proposed method is closely related to the bias reduction method for kernel density estimation proposed by Chung and Lindsay (2011). However, our method is not a direct extension of their density estimate, but a totally new one based on the bias cancelation result of their proof.     

A nonparametric regression method for multiple longitudinal phenotypes using multivariate adaptive splines

In genetic studies of complex diseases, particularly mental illnesses, and behavior disorders, two distinct characteristics have emerged in some data sets. First, genetic data sets are collected with a large number of phenotypes that are potentially related to the complex disease under study. Second, each phenotype is collected from the same subject repeatedly over time. In this study, we present a nonparametric regression approach to study multivariate and time-repeated phenotypes together by using the technique of the multivariate adaptive regression splines for analysis of longitudinal data (MASAL), which makes it possible to identify genes, gene-gene and gene-environment, including time, interactions associated with the phenotypes of interest. Furthermore, we propose a permutation test to assess the associations between the phenotypes and selected markers. Through simulation, we demonstrate that our proposed approach has advantages over the existing methods that examine each longitudinal phenotype separately or analyze the summarized values of phenotypes by compressing them into one-time-point phenotypes. Application of the proposed method to the Framingham Heart Study illustrates that the use of multivariate longitudinal phenotypes enhanced the significance of the association test.     

Robust nonparametric regression estimation

In this paper we define a robust conditional location functional without requiring any moment condition. We apply the nonparametric proposals considered by C. Stone (Ann. Statist. 5 (1977), 595–645) to this functional equation in order to obtain strongly consistent, robust nonparametric estimates of the regression function. We give some examples by using nearest neighbor weights or weights based on kernel methods under no assumptions whatsoever on the probability measure of the vector (X,Y). We also derive strong convergence rates and the asymptotic distribution of the proposed estimates.     

A nonparametric lack-of-fit test for heteroscedastic regression models

A simple test is proposed for examining the correctness of a given completely specified response function against unspecified general alternatives in the context of univariate regression. The usual diagnostic tools based on residual plots are useful but heuristic. We introduce a formal statistical test supplementing the graphical analysis. Technically, the test statistic is the maximum length of the sequences of ordered (with respect to the covariate) observations that are consecutively overestimated or underestimated by the candidate regression function. Note that the testing procedure can cope with heteroscedastic errors and no replicates. Recursive formulae allowing one to calculate the exact distribution of the test statistic under the null hypothesis and under a class of alternative hypotheses are given.     

A comparison of kriging with nonparametric regression methods

“Kriging” is the name of a parametric regression method used by hydrologists and mining engineers, among others. Features of the kriging approach are that it also provides an error estimate and that it can conveniently be employed also to estimate the integral of the regression function. In the present work, the kriging method is described and some of its statistical characteristics are explored. Also, some extensions of the nonparametric regression approach are made so that it too displays the kriging features. In particular, a “data driven” estimator of the expected square error is derived. Theoretical and computational comparisons of the kriging and nonparametric regressors are offered.     

Cardinal splines in nonparametric regression

We discuss a nonparametric regression model on an equidistant grid of the real line. A class of kernel type estimates based on the so-called fundamental cardinal splines will be introduced. Asymptotic optimality of these estimates will be established for certain functional classes. This model explains the often mentioned heuristic fact that cubic splines are adequate for most practical applications.      

Error inference for nonparametric regression

This study examines means for inferring the distribution of the error in nonparametric regression. The central objective is to develop confidence intervals for nonparametric regression. Our computational study would seem to affirm that our methods are potentially useful in cases of small sample size or heterogeneously distributed error. Theoretical developments offer sufficient conditions for asymptotic normality.This work was undertaken while Dr. Rutherford was with the University of Arizona. It was supported in part by NSF grant DPP 82-19439.     

Testing independence in nonparametric regression

We propose a new test for independence of error and covariate in a nonparametric regression model. The test statistic is based on a kernel estimator for the L₂-distance between the conditional distribution and the unconditional distribution of the covariates. In contrast to tests so far available in literature, the test can be applied in the important case of multivariate covariates. It can also be adjusted for models with heteroscedastic variance. Asymptotic normality of the test statistic is shown. Simulation results and a real data example are presented.     

A nonparametric regression cross spectrum for multivariate time series

We consider dependence structures in multivariate time series that are characterized by deterministic trends. Results from spectral analysis for stationary processes are extended to deterministic trend functions. A regression cross covariance and spectrum are defined. Estimation of these quantities is based on wavelet thresholding. The method is illustrated by a simulated example and a three-dimensional time series consisting of ECG, blood pressure and cardiac stroke volume measurements.     

A prior near-ignorance Gaussian process model for nonparametric regression

This paper proposes a prior near-ignorance model for regression based on a set of Gaussian Processes (GP). GPs are natural prior distributions for Bayesian regression. They offer a great modeling flexibility and have found widespread application in many regression problems. However, a GP requires the prior elicitation of its mean function, which represents our prior belief about the shape of the regression function, and of the covariance between any two function values.In the absence of prior information, it may be difficult to fully specify these infinite dimensional parameters. In this work, by modeling the prior mean of the GP as a linear combination of a set of basis functions and assuming as prior for the combination coefficients a set of conjugate distributions obtained as limits of truncate exponential priors, we have been able to model prior ignorance about the mean of the GP. The resulting model satisfies translation invariance, learning and, under some constraints, convergence, which are desirable properties for a prior near-ignorance model. Moreover, it is shown in this paper how this model can be extended to allow for a weaker specification of the GP covariance between function values, by letting each basis function to vary in a set of functions.Application to hypothesis testing has shown how the use of this model induces the capability of automatically detecting when a reliable decision cannot be made based on the available data.     

Pseudo-empirical likelihood estimation using nonparametric regression

Pseudo-empirical likelihood estimation of the population mean is considered. A nonparametric regression theory is proposed, to provide the fitted values on which to calibrate, and the common model misspecification problem is therefore addressed. Results derived from empirical studies show that the proposed estimator for the population mean can perform better than alternative estimators.     

Bootstrapping the nonparametric ARCH regression model

In this paper we introduce the nonparametric AR(1)–ARCH(1) model and show weak consistency of the Nadaraya–Watson estimators for the model. We propose a residual and a wild bootstrap method and prove weak consistency of the bootstrap estimators.     

Testing strict monotonicity in nonparametric regression

A new test for strict monotonicity of the regression function is proposed which is based on a composition of an estimate of the inverse of the regression function with a common regression estimate. This composition is equal to the identity if and only if the “true” regression function is strictly monotone, and a test based on an L ²-distance is investigated. The asymptotic normality of the corresponding test statistic is established under the null hypothesis of strict monotonicity.      

Monotone nonparametric regression with random design

In this paper we study the nonparametric least squares estimator of a regression function in a random design setting under the constraint that this function is monotone, say, nonincreasing. The errors are not assumed conditionally i.i.d. given the observation points. In particular, this includes the case of conditional heteroscedasticity and the case of the current status model. The -error is shown to be of order n ^−p/3 and asymptotically Gaussian with explicit asymptotic mean and variance.      

Optimal designs for nonparametric kernel regression

We consider the fixed design regression model Y_i = g(t_i) + ξ_i, i = 1, …, n, where ξ_i are (not necessarily i.i.d.) no variables, t_i constitute the design points where nonrepeatable measurements are to be taken and Y_i are the observations from which g and its derivatives are to be estimated. The dependency of the Integrated Mean Squared Error of two different types of kernel estimates on the design {t₁, …, t_n} is established. This allows the derivation of asymptotically optimal designs.     

Robust estimation for nonparametric generalized regression

This paper focuses on nonparametric regression estimation for the parameters of a discrete or continuous distribution, such as the Poisson or Gamma distributions, when anomalous data are present. The proposal is a natural extension of robust methods developed in the setting of parametric generalized linear models. Robust estimators bounding either large values of the deviance or of the Pearson residuals are introduced and their asymptotic behaviour is derived. Through a Monte Carlo study, for the Poisson and Gamma distributions, the finite properties of the proposed procedures are investigated and their performance is compared with that of the classical ones. A resistant cross-validation method to choose the smoothing parameter is also considered.     

A predictive estimator of finite population mean using nonparametric regression

The paper considers the problem of estimating the population mean using auxiliary information. We propose a new model-based estimator of the population mean, based on local polynomial regression. This estimator exhibits several attractive properties under the model-based approach. The estimator is compared to a number of methods which have been proposed in the literature via a simulation study based on several populations.     

Adaptive nonparametric regression on spin fiber bundles

The construction of adaptive nonparametric procedures by means of wavelet thresholding techniques is now a classical topic in modern mathematical statistics. In this paper, we extend this framework to the analysis of nonparametric regression on sections of spin fiber bundles defined on the sphere. This can be viewed as a regression problem where the function to be estimated takes as its values algebraic curves (for instance, ellipses) rather than scalars, as usual. The problem is motivated by many important astrophysical applications, concerning, for instance, the analysis of the weak gravitational lensing effect, i.e. the distortion effect of gravity on the images of distant galaxies. We propose a thresholding procedure based upon the (mixed) spin needlets construction recently advocated by Geller and Marinucci (2008, 2010) and Geller et al. (2008, 2009), and we investigate their rates of convergence and their adaptive properties over spin Besov balls.     

Two tests for heteroscedasticity in nonparametric regression

In this paper, two new tests for heteroscedasticity in nonparametric regression are presented and compared. The first of these tests consists in first estimating nonparametrically the unknown conditional variance function and then using a classical least-squares test for a general linear model to test whether this function is a constant. The second test is based on using an overall distance between a nonparametric estimator of the conditional variance function and a parametric estimator of the variance of the model under the assumption of homoscedasticity. A bootstrap algorithm is used to approximate the distribution of this test statistic. Extended versions of both procedures in two directions, first, in the context of dependent data, and second, in the case of testing if the variance function is a polynomial of a certain degree, are also described. A broad simulation study is carried out to illustrate the finite sample performance of both tests when the observations are independent and when they are dependent.