Nonparametric regression with current status data

We apply nonparametric regression to current status data, which often arises in survival analysis and reliability analysis. While no parametric assumption on the distributions has been imposed, most authors have employed parametric models like linear models to measure the covariate effects on failure times in regression analysis with current status data. We construct a nonparametric estimator of the regression function by modifying the maximum rank correlation (MRC) estimator. Our estimator can deal with the cases where the other estimators do not work. We present the asymptotic bias and the asymptotic distribution of the estimator by adapting a result on equicontinuity of degenerate U-processes to the setup of this paper.     

Oracle inequality for conditional density estimation and an actuarial example

Conditional density estimation in a parametric regression setting, where the problem is to estimate a parametric density of the response given the predictor, is a classical and prominent topic in regression analysis. This article explores this problem in a nonparametric setting where no assumption about shape of an underlying conditional density is made. For the first time in the literature, it is proved that there exists a nonparametric data-driven estimator that matches performance of an oracle which: (i) knows the underlying conditional density, (ii) adapts to an unknown design of predictors, (iii) performs a dimension reduction if the response does not depend on the predictor, (iv) is minimax over a vast set of anisotropic bivariate function classes. All these results are established via an oracle inequality which is on par with ones known in the univariate density estimation literature. Further, the asymptotically optimal estimator is tested on an interesting actuarial example which explores a relationship between credit scoring and premium for basic auto-insurance for 54 undergraduate college students.     

非参数回归函数估计的渐近正态性

本文研究了独立或相依样本时非参数回归函数的Ｎａｄａｒａｙａ-Ｗａｔｓｏｎ估计，在简洁合理的条件下，证明了估计量的渐近正态性．获得的结论可在时间序列分析中得到应用．     

缺失数据下N-W估计

在缺失响应变量的不完全数据下,研究独立或相依样本时非参数回归函数的Nadaraya- Watson估计,在一定条件下,证明了估计量的渐近正态性,获得的结论可在时间序列分析中得到应用,模拟研究说明了该方法在有限样本下具有良好的的性质。     

A bivariate histogram density estimator: Consistency and asymptotic normality

This paper presents a nonparametric histogram density estimator based on the spacings of order statistics. This estimator generalizes to the bivariate case the univariate histogram estimator proposed by Van Ryzin (1973). The first of the two theorems in this paper gives conditions under which the estimator is pointwise strongly consistent. The second theorem provides conditions for the asymptotic normality of the estimator for points at which the density function possesses continuous partial derivatives of second order.     

Wavelet estimation of the diffusion coefficient in time dependent diffusion models

The estimation problem for diffusion coefficients in diffusion processes has been studied in many papers,where the diffusion coefficient function is assumed to be a 1-dimensional bounded Lipschitzian function of the state or the time only.There is no previous work for the nonparametric estimation of time-dependent diffusion models where the diffusion coefficient depends on both the state and the time.This paper introduces and studies a wavelet estimation of the time-dependent diffusion coefficient under a more general assumption that the diffusion coefficient is a linear growth Lipschitz function.Using the properties of martingale,we translate the problems in diffusion into the nonparametric regression setting and give the L~r convergence rate.A strong consistency of the estimate is established.With this result one can estimate the time-dependent diffusion coefficient using the same structure of the wavelet estimators under any equivalent probability measure.For example, in finance,the wavelet estimator is strongly consistent under the market probability measure as well as the risk neutral probability measure.     

Robust to noise and outliers estimator of correlation dimension

The estimation of correlation dimension of continuous and discreet deterministic chaotic processes corrupted by an additive noise and outliers observations is investigated. In this paper we propose a new estimator of correlation dimension based on similarity between the evolution of Gaussian kernel correlation sum (Gkcs) and that of modified Boltzmann sigmoidal function (mBsf), this estimator is given by the maximum value of the first derivative of logarithmic transform of Gkcs against logarithmic transform of bandwidth, so the proposed estimator is independent of the choice of regression region like other regression estimators of correlation dimension. Simulation study indicates the robustness of proposed estimator to the presence of different types of noise such us independent Gaussian noise, non independent Gaussian noise and uniform noise for high noise level, moreover, this estimator is also robust to presence of 60% of outliers observations. Application of this new estimator with determination of their confidence interval using the moving block bootstrap method to adjusted closed price of S&P500 index daily time series revels the stochastic behavior of such financial time series.     

复杂系统中混沌排斥子的动力学特性分析及应用研究

研究了由一类复杂系统排斥子所生成的时间序列的分形特征、分维值,利用相空间重构理论对排斥子所生成的混沌时序数据进行了重构．研究了时序数据的零均值处理、傅立叶滤波对预测结果的影响,研究了预测样本值的选取对预测的相对误差、预测长度影响等相关问题．结果表明:该模型对于这类排斥子所生成的时序数据建模和预测都具有实用性,且混沌排斥子样本数据的零均值处理对预测结果有一定的量的改变,但对排斥子样本数据进行Fourier滤波处理会降低预测的精度,这对于复杂系统排斥子的研究有着较为重要的理论和实际意义．     

Censored multiple regression by the method of average derivatives

This paper proposes a technique [termed censored average derivative estimation (CADE)] for studying estimation of the unknown regression function in nonparametric censored regression models with randomly censored samples. The CADE procedure involves three stages: firstly-transform the censored data into synthetic data or pseudo-responses using the inverse probability censoring weighted (IPCW) technique, secondly estimate the average derivatives of the regression function, and finally approximate the unknown regression function by an estimator of univariate regression using techniques for one-dimensional nonparametric censored regression. The CADE provides an easily implemented methodology for modelling the association between the response and a set of predictor variables when data are randomly censored. It also provides a technique for “dimension reduction” in nonparametric censored regression models. The average derivative estimator is shown to be root-n consistent and asymptotically normal. The estimator of the unknown regression function is a local linear kernel regression estimator and is shown to converge at the optimal one-dimensional nonparametric rate. Monte Carlo experiments show that the proposed estimators work quite well.     

Modal Regression Based on Nonparametric Quantile Estimator

Modal regression based on nonparametric quantile estimator is given. Unlike the traditional mean and median regression, modal regression uses mode but not mean or median to represent the center of a conditional distribution, which helps the model to be more robust for outliers, asymmetric or heavy-taileddistribution. Most of solutions for modal regression are based on kernel estimation of density. This paper studies a new solution for modal regression by means of nonparametric quantile estimator. This method builds on the fact that the distribution function is the inverse of the quantile function, then the flexibility of nonparametric quantile estimator is utilized to improve the estimation of modal function. The simulations and application show that the new model outperforms the modal regression model via linear quantile function estimation.     

Nonparametric Berkson regression under normal measurement error and bounded design

Regression data often suffer from the so-called Berkson measurement error which contaminates the design variables. Conventional nonparametric approaches to this errors-in-variables problem usually require rather strong conditions on the support of the design density and that of the contaminated regression function, which seem unrealistic in many cases. In the current note, we introduce a novel nonparametric regression estimator, which is able to identify the regression function on the whole real line under normal Berkson error although the location of the design variables is restricted to some bounded interval. The asymptotic properties of this estimator are investigated and some numerical simulations are provided.     

Asymptotic properties of Lasso in high-dimensional partially linear models

We study the properties of the Lasso in the high-dimensional partially linear model where the number of variables in the linear part can be greater than the sample size. We use truncated series expansion based on polynomial splines to approximate the nonparametric component in this model. Under a sparsity assumption on the regression coefficients of the linear component and some regularity conditions, we derive the oracle inequalities for the prediction risk and the estimation error. We also provide sufficient conditions under which the Lasso estimator is selection consistent for the variables in the linear part of the model. In addition, we derive the rate of convergence of the estimator of the nonparametric function. We conduct simulation studies to evaluate the finite sample performance of variable selection and nonparametric function estimation.     

删失数据回归误差项的非参数密度估计的一致相合性(英文)

回归误差项是不可观测的. 由于回归误差项的密度函数在实际中有许多应用, 故使用非参数方法对其进行估计就成为回归分析中的一个基本问题. 针对完全观测数据回归模型, 曾有作者对此问题进行了研究. 然而在实际应用中, 经常会有数据被删失的情况发生, 在此情况下, 可以利用删失回归残差, 并使用核估计的方法对回归误差项的密度函数进行估计. 本文研究了该估计的大样本性质, 并证明了估计量的一致相合性.     

Asymptotic distributions of two “synthetic data” estimators for censored single-index models

The censored single-index model provides a flexible way for modelling the association between a response and a set of predictor variables when the response variable is randomly censored and the link function is unknown. It presents a technique for “dimension reduction” in semiparametric censored regression models and generalizes the existing accelerated failure time models for survival analysis. This paper proposes two methods for estimation of single-index models with randomly censored samples. We first transform the censored data into synthetic data or pseudo-responses unbiasedly, then obtain estimates of the index coefficients by the rOPG or rMAVE procedures of Xia (2006) [1]. Finally, we estimate the unknown nonparametric link function using techniques for univariate censored nonparametric regression. The estimators for the index coefficients are shown to be root-n consistent and asymptotically normal. In addition, the estimator for the unknown regression function is a local linear kernel regression estimator and can be estimated with the same efficiency as the parameters are known. Monte Carlo simulations are conducted to illustrate the proposed methodologies.     

Consistency of the regression estimator with functional data under long memory conditions

We study the nonparametric regression estimation when the explanatory variable takes values in some abstract functional space. We establish some asymptotic results and we give the (pointwise and uniform) convergence of the kernel type estimator constructed from functional data under long memory conditions.     

Robust estimation in a nonlinear cointegration model

This paper considers the nonparametric M-estimator in a nonlinear cointegration type model. The local time density argument, which was developed by Phillips and Park (1998) [6] and Wang and Phillips (2009) [9], is applied to establish the asymptotic theory for the nonparametric M-estimator. The weak consistency and the asymptotic distribution of the proposed estimator are established under mild conditions. Meanwhile, the asymptotic distribution of the local least squares estimator and the local least absolute distance estimator can be obtained as applications of our main results. Furthermore, an iterated procedure for obtaining the nonparametric M-estimator and a cross-validation bandwidth selection method are discussed, and some numerical examples are provided to show that the proposed methods perform well in the finite sample case.     

Robust Depth-Weighted Wavelet for Nonparametric Regression Models

In the nonparametric regression models, the original regression estimators including kernel estimator, Fourier series estimator and wavelet estimator are always constructed by the weighted sum of data, and the weights depend only on the distance between the design points and estimation points. As a result these estimators are not robust to the perturbations in data. In order to avoid this problem, a new nonparametric regression model, called the depth-weighted regression model, is introduced and then the depth-weighted wavelet estimation is defined. The new estimation is robust to the perturbations in data, which attains very high breakdown value close to 1/2. On the other hand, some asymptotic behaviours such as asymptotic normality are obtained. Some simulations illustrate that the proposed wavelet estimator is more robust than the original wavelet estimator and, as a price to pay for the robustness, the new method is slightly less efficient than the original method.     

Real-Time Density and Mode Estimation With Application to Time-Dynamic Mode Tracking

We introduce a nonparametric time-dynamic kernel type density estimate for the situation where an underlying multivariate distribution evolves with time. Based on this time-dynamic density estimate, we propose nonparametric estimates for the time-dynamic mode of the underlying distribution. Our estimators involve boundary kernels for the time dimension so that the estimator is always centered at current time, and multivariate kernels for the spatial dimension of the time-evolving distribution. Under certain mild conditions, the asymptotic behavior of density and mode estimators, especially their uniform convergence in both time and space, is derived. A time-dynamic algorithm for mode tracking is proposed, including automatic bandwidth choices, and is implemented via a mean update algorithm. Simulation studies and real data illustrations demonstrate that the proposed methods work well in practice.     

Time series regression models with locally stationary disturbance

Time series linear regression models with stationary residuals are a well studied topic, and have been widely applied in a number of fields. However, the stationarity assumption on the residuals seems to be restrictive. The analysis of relatively long stretches of time series data that may contain changes in the spectrum is of interest in many areas. Locally stationary processes have time-varying spectral densities, the structure of which smoothly changes in time. Therefore, we extend the model to the case of locally stationary residuals. The best linear unbiased estimator (BLUE) of vector of regression coefficients involves the residual covariance matrix which is usually unknown. Hence, we often use the least squares estimator (LSE), which is always feasible, but in general is not efficient. We evaluate the asymptotic covariance matrices of the BLUE and the LSE. We also study the efficiency of the LSE relative to the BLUE. Numerical examples illustrate the situation under locally stationary disturbances.     

Functional-coefficient partially linear regression model

In this paper, the functional-coefficient partially linear regression (FCPLR) model is proposed by combining nonparametric and functional-coefficient regression (FCR) model. It includes the FCR model and the nonparametric regression (NPR) model as its special cases. It is also a generalization of the partially linear regression (PLR) model obtained by replacing the parameters in the PLR model with some functions of the covariates. The local linear technique and the integrated method are employed to give initial estimators of all functions in the FCPLR model. These initial estimators are asymptotically normal. The initial estimator of the constant part function shares the same bias as the local linear estimator of this function in the univariate nonparametric model, but the variance of the former is bigger than that of the latter. Similarly, initial estimators of every coefficient function share the same bias as the local linear estimates in the univariate FCR model, but the variance of the former is bigger than that of the latter. To decrease the variance of the initial estimates, a one-step back-fitting technique is used to obtain the improved estimators of all functions. The improved estimator of the constant part function has the same asymptotic normality property as the local linear nonparametric regression for univariate data. The improved estimators of the coefficient functions have the same asymptotic normality properties as the local linear estimates in FCR model. The bandwidths and the smoothing variables are selected by a data-driven method. Both simulated and real data examples related to nonlinear time series modeling are used to illustrate the applications of the FCPLR model.