Nonparametric Estimation of Hazard Rate Under the Constraint of Monotonicity

This article shows how to smoothly “monotonize” standard kernel estimators of hazard rate, using bootstrap weights. Our method takes a variety of forms, depending on choice of kernel estimator and on the distance function used to define a certain constrained optimization problem. We confine attention to a particularly simple kernel approach and explore a range of distance functions. It is straightforward to reduce “quadratic” inequality constraints to “linear” equality constraints, and so our method may be implemented using little more than conventional Newton–Raphson iteration. Thus, the necessary computational techniques are very familiar to statisticians. We show both numerically and theoretically that monotonicity, in either direction, can generally be imposed on a kernel hazard rate estimator regardless of the monotonicity or otherwise of the true hazard rate. The case of censored data is easily accommodated. Our methods have straightforward extension to the problem of testing for monotonicity of hazard rate, where the distance function plays the role of a test statistic.     

Hazard Rate Estimation in Nonparametric Regression with Censored Data

Consider a regression model in which the responses are subject to random right censoring. In this model, Beran studied the nonparametric estimation of the conditional cumulative hazard function and the corresponding cumulative distribution function. The main idea is to use smoothing in the covariates. Here we study asymptotic properties of the corresponding hazard function estimator obtained by convolution smoothing of Beran's cumulative hazard estimator. We establish asymptotic expressions for the bias and the variance of the estimator, which together with an asymptotic representation lead to a weak convergence result. Also, the uniform strong consistency of the estimator is obtained.     

Polynomial Regression with Censored Data based on Preliminary Nonparametric Estimation

Consider the polynomial regression model , where σ²(X)=Var(Y|X) is unknown, and ε is independent of X and has zero mean. Suppose that Y is subject to random right censoring. A new estimation procedure for the parameters β₀,...,β _p is proposed, which extends the classical least squares procedure to censored data. The proposed method is inspired by the method of Buckley and James (1979, Biometrika, 66, 429–436), but is, unlike the latter method, a noniterative procedure due to nonparametric preliminary estimation of the conditional regression function. The asymptotic normality of the estimators is established. Simulations are carried out for both methods and they show that the proposed estimators have usually smaller variance and smaller mean squared error than the Buckley–James estimators. The two estimation procedures are also applied to a medical and an astronomical data set.     

截尾数据非参数回归函数加权核估计

在截尾数据下研究非参数回归函数加权核估计的相合性,对强相合性给出一些较弱的充分条件,这些结论较大程度地改进了现有的结论．     

Local Linear Smoothers Using Asymmetric Kernels

This paper considers using asymmetric kernels in local linear smoothing to estimate a regression curve with bounded support. The asymmetric kernels are either beta kernels if the curve has a compact support or gamma kernels if the curve is bounded from one end only. While possessing the standard benefits of local linear smoothing, the local linear smoother using the beta or gamma kernels offers some extra advantages in aspects of having finite variance and resistance to sparse design. These are due to their flexible kernel shape and the support of the kernel matching the support of the regression curve.     

Penalized Nonparametric Scalar-on-Function Regression via Principal Coordinates

A number of classical approaches to nonparametric regression have recently been extended to the case of functional predictors. This article introduces a new method of this type, which extends intermediate-rank penalized smoothing to scalar-on-function regression. In the proposed method, which we call principal coordinate ridge regression, one regresses the response on leading principal coordinates defined by a relevant distance among the functional predictors, while applying a ridge penalty. Our publicly available implementation, based on generalized additive modeling software, allows for fast optimal tuning parameter selection and for extensions to multiple functional predictors, exponential family-valued responses, and mixed-effects models. In an application to signature verification data, principal coordinate ridge regression, with dynamic time warping distance used to define the principal coordinates, is shown to outperform a functional generalized linear model. Supplementary materials for this article are available online.     

删失数据中删失指标随机缺失下回归函数的非参数估计

本文在删失数据中删失指标随机缺失的情况下,运用非参数方法给出了回归函数的两种估计量,给出了估计量的一致收敛速度以及渐近分布,并进一步通过数值模拟验证了所提方法在有限样本下的性质.     

非参数局部多项式回归估计的最优子抽样算法

随着科学技术的发展,虽然人们提高了收集和处理数据的能力,但仍存在一些大数据集超出了现有计算机的计算能力.目前,抽取一部分样本来替代全样本进行建模计算是减轻计算负担的一种方法.大数据背景下线性模型的子抽样方法已经得到了相对成熟的研究,在减轻计算量方面获得了很大的优势.文章将线性模型下的子抽样方法推广到非参数回归模型,并推...     

Asymptotic Properties of a Nonparametric Regression Function Estimator with Randomly Truncated Data

In this paper, we define a new kernel estimator of the regression function under a left truncation model. We establish the pointwise and uniform strong consistency over a compact set and give a rate of convergence of the estimate. The pointwise asymptotic normality of the estimate is also given. Some simulations are given to show the asymptotic behavior of the estimate in different cases. The distribution function and the covariable’s density are also estimated.     

Fast Nonparametric Quantile Regression With Arbitrary Smoothing Methods

The calculation of nonparametric quantile regression curve estimates is often computationally intensive, as typically an expensive nonlinear optimization problem is involved. This article proposes a fast and easy-to-implement method for computing such estimates. The main idea is to approximate the costly nonlinear optimization by a sequence of well-studied penalized least squares-type nonparametric mean regression estimation problems. The new method can be paired with different nonparametric smoothing methods and can also be applied to higher dimensional settings. Therefore, it provides a unified framework for computing different types of nonparametric quantile regression estimates, and it also greatly broadens the scope of the applicability of quantile regression methodology. This wide applicability and the practical performance of the proposed method are illustrated with smoothing spline and wavelet curve estimators, for both uni- and bivariate settings. Results from numerical experiments suggest that estimates obtained from the proposed method are superior to many competitors. This article has supplementary material online.     

Nonparametric Regression on a Graph

The ‘Signal plus Noise’ model for nonparametric regression can be extended to the case of observations taken at the vertices of a graph. This model includes many familiar regression problems. This article discusses the use of the edges of a graph to measure roughness in penalized regression. Distance between estimate and observation is measured at every vertex in the L₂ norm, and roughness is penalized on every edge in the L₁ norm. Thus the ideas of total variation penalization can be extended to a graph. The resulting minimization problem presents special computational challenges, so we describe a new and fast algorithm and demonstrate its use with examples.

The examples include image analysis, a simulation applicable to discrete spatial variation, and classification. In our examples, penalized regression improves upon kernel smoothing in terms of identifying local extreme values on planar graphs. In all examples we use fully automatic procedures for setting the smoothing parameters. Supplemental materials are available online.     

线性模型中加权混合估计相对于最小二乘估计的两种相对效率

本文提出了线性模型中加权混合估计相对于最小二乘估计的两种相对效率,并给出了这些相对效率的上下界.     

NA样本非参数回归权函数估计的强相合性

在 NA样本下 ,讨论了非参数回归模型中权函数估计的强相合性及强一致相合性 ,并把这个结果应用于 Gasser- Muller估计和 Priestley and Chao估计 .     

线性过程误差下的非参数回归模型的注记

对于非参数回归模型Yni=g(xni)+εni,1in,用一般非参数方法,定义了未知函数g(.)的估计量gn(x),当误差序列{εni,1in}为一弱平稳线性过程序列时,在一定条件下,获得了估计量gn(x)的一致强相合性.     

非参数回归函数核估计的Lp收敛速度

在p≥1和适当的条件下，给出了回归函数m(x)＝E（Y|X＝x）的核估计的若干种Lp收敛速度，改进并推广了韦来生（1984）的结果。     

相依样本下非参数回归函数估计的强收敛速度

设(X,Y),(X_1,Y_1,),…,(X_n,Y_n)是一个平稳、φ—混合过程((X,Y)∈R~d×R,E|Y|~(s δ)<∞,s≥2,δ>0),用m(x)记E{Y|X=x},本文讨论了m(x)的如下估计m_n(x)的强收敛速度:     

Spatial Nonparametric Regression Estimation: Non-isotropic Case

Data collected on the surface of the earth often has spatial interaction. In this paper, a non-isotropic mixing spatial data process is introduced, and under such a spatial structure a nonparametric kernel method is suggested to estimate a spatial conditional regression. Under mild regularities, sufficient conditions are derived to ensure the weak consistency as well as the convergence rates for the kernel estimator. Of interest are the following: (1) All the conditions imposed on the mixing coefficient and the bandwidth are simple; (2) Differently from the time series setting, the bandwidth is found to be dependent on the dimension of the site in space as well; (3) For weak consistency, the mixing coefficient is allowed to be unsummable and the tendency of sample size to infinity may be in different manners along different direction in space; (4) However, to have an optimal convergence rate, faster decreasing rates of mixing coefficient and the tendency of sample size to infinity along each direction a     

Mixed Model-Based Hazard Estimation

This article proposes a new method for estimation of the hazard function from a set of censored failure time data, with a view to extending the general approach to more complicated models. The approach is based on a mixed model representation of penalized spline hazard estimators. One payoff is the automation of the smoothing parameter choice through restricted maximum likelihood. Another is the option to use standard mixed model software for automatic hazard estimation.     

Fixed Design Nonparametric Regression with Truncated and Censored Data

In this paper we consider a fixed design model in which the observations axe subject to left truncation and right censoring. A generalized product-limit estimator for the conditional distribution at a given covaxiate value is proposed, and an almost sure asymptotic representation of this estimator is established. We also obtain the rate of uniform consistency, weak convergence and a modulus of continuity for this estimator.Applications include trimmed mean and quantile function estimators.