Asymptotic distributions of two “synthetic data” estimators for censored single-index models

The censored single-index model provides a flexible way for modelling the association between a response and a set of predictor variables when the response variable is randomly censored and the link function is unknown. It presents a technique for “dimension reduction” in semiparametric censored regression models and generalizes the existing accelerated failure time models for survival analysis. This paper proposes two methods for estimation of single-index models with randomly censored samples. We first transform the censored data into synthetic data or pseudo-responses unbiasedly, then obtain estimates of the index coefficients by the rOPG or rMAVE procedures of Xia (2006) [1]. Finally, we estimate the unknown nonparametric link function using techniques for univariate censored nonparametric regression. The estimators for the index coefficients are shown to be root-n consistent and asymptotically normal. In addition, the estimator for the unknown regression function is a local linear kernel regression estimator and can be estimated with the same efficiency as the parameters are known. Monte Carlo simulations are conducted to illustrate the proposed methodologies.     

Censored multiple regression by the method of average derivatives

This paper proposes a technique [termed censored average derivative estimation (CADE)] for studying estimation of the unknown regression function in nonparametric censored regression models with randomly censored samples. The CADE procedure involves three stages: firstly-transform the censored data into synthetic data or pseudo-responses using the inverse probability censoring weighted (IPCW) technique, secondly estimate the average derivatives of the regression function, and finally approximate the unknown regression function by an estimator of univariate regression using techniques for one-dimensional nonparametric censored regression. The CADE provides an easily implemented methodology for modelling the association between the response and a set of predictor variables when data are randomly censored. It also provides a technique for “dimension reduction” in nonparametric censored regression models. The average derivative estimator is shown to be root-n consistent and asymptotically normal. The estimator of the unknown regression function is a local linear kernel regression estimator and is shown to converge at the optimal one-dimensional nonparametric rate. Monte Carlo experiments show that the proposed estimators work quite well.     

Asymptotics for a censored generalized linear model with unknown link function

For censored response variable against projected co-variable, a generalized linear model with an unknown link function can cover almost all existing models under censorship. Its special cases include the accelerated failure time model with censored data. Such a model in the uncensored case is called the single-index model in econometrics. In this paper, we systematically study the asymptotic properties. We derive the central limit theorem and the law of the iterated logarithm for an estimator of the direction parameter. We also obtain the optimal convergence rate of an estimator of the unknown link function in the model.      

Statistical inference in partially-varying-coefficient single-index model

Consider a varying-coefficient single-index model which consists of two parts: the linear part with varying coefficients and the nonlinear part with a single-index structure, and are hence termed as varying-coefficient single-index models. This model includes many important regression models such as single-index models, partially linear single-index models, varying-coefficient model and varying-coefficient partially linear models as special examples. In this paper, we mainly study estimating problems of the varying-coefficient vector, the nonparametric link function and the unknown parametric vector describing the single-index in the model. A stepwise approach is developed to obtain asymptotic normality estimators of the varying-coefficient vector and the parametric vector, and estimators of the nonparametric link function with a convergence rate. The consistent estimator of the structural error variance is also obtained. In addition, asymptotic pointwise confidence intervals and confidence regions are constructed for the varying coefficients and the parametric vector. The bandwidth selection problem is also considered. A simulation study is conducted to evaluate the proposed methods, and real data analysis is also used to illustrate our methods.     

Efficient estimation of a varying-coefficient partially linear binary regression model

This article considers a semiparametric varying-coefficient partially linear binary regression model. The semiparametric varying-coefficient partially linear regression binary model which is a generalization of binary regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. One of our main objects is to estimate nonparametric component and the unknowen parameters simultaneously. It is easier to compute, and the required computation burden is much less than that of the existing two-stage estimation method. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained, and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are carried out to investigate the performance of the proposed method.     

Ⅱ型区间删失数据下广义部分线性模型的筛极大似然估计(英文)

This article concerded with a semiparametric generalized partial linear model （GPLM） with the type Ⅱ censored data. A sieve maximum likelihood estimator （MLE） is proposed to estimate the parameter component, allowing exploration of the nonlinear relationship between a certain covariate and the response function. Asymptotic properties of the proposed sieve MLEs are discussed. Under some mild conditions, the estimators are shown to be strongly consistent. Moreover, the estimators of the unknown parameters are asymptotically normal and efficient, and the estimator of the nonparametric function has an optimal convergence rate.     

Local influence analysis for penalized Gaussian likelihood estimation in partially linear single-index models

Single-index model is a potentially tool for multivariate nonparametric regression, generalizes both the generalized linear models(GLM) and the missing-link function problem in GLM. In this paper, we extend Cook’s local influence analysis to the penalized Gaussian likelihood estimator based on P-spline for the partially linear single-index model. Some influence measures, based on the minor perturbation of the model, are derived for the penalized least squares estimation. An illustrative example is also presented.     

Estimation of Linear Error-in-Covariables Models with Validation Data Under Random Censorship

Consider the linear models of the form Y=X^τβ+ with the response Y censored randomly on the right and X measured erroneously. Without specifying any error models, in this paper, a semiparametric method is applied to the estimation of the parametric vector β with the help of proper validation data. For the proposed estimator, an asymptotic representation is established and the asymptotic normality is also proved.     

响应变量删失时函数型部分线性分位数回归模型的估计

最近几年,函数型数据分析的理论和应用飞速发展.在许多实际应用里,响应变量往往存在随机右删失的情况.考虑利用函数型部分线性分位数回归模型来刻画函数型和标量预测量与右删失响应变量之间的关系.基于函数型主成分基函数来逼近未知的斜率函数,通过极小化逆概率加权分位数损失函数得到未知系数的估计量.文章的估计方法容易通过加权分位数回归程序实现.在一定的假设条件下,给出了有限维参数估计量的渐近正态性与斜率函数估计量的收敛速度.最后,通过模拟计算与应用实例证明了所提方法的有效性.     

Double penalized variable selection procedure for partially linear models with longitudinal data

Based on the double penalized estimation method,a new variable selection procedure is proposed for partially linear models with longitudinal data.The proposed procedure can avoid the effects of the nonparametric estimator on the variable selection for the parameters components.Under some regularity conditions,the rate of convergence and asymptotic normality of the resulting estimators are established.In addition,to improve efficiency for regression coefficients,the estimation of the working covariance matrix is involved in the proposed iterative algorithm.Some simulation studies are carried out to demonstrate that the proposed method performs well.     

Variable selection for the partial linear single-index model

In this paper, we consider the issue of variable selection in partial linear single-index models under the assumption that the vector of regression coefficients is sparse. We apply penalized spline to estimate the nonparametric function and SCAD penalty to achieve sparse estimates of regression parameters in both the linear and single-index parts of the model. Under some mild conditions, it is shown that the penalized estimators have oracle property, in the sense that it is asymptotically normal with the same mean and covariance that they would have if zero coefficients are known in advance. Our model owns a least square representation, therefore standard least square programming algorithms can be implemented without extra programming efforts. In the meantime, parametric estimation, variable selection and nonparametric estimation can be realized in one step, which incredibly increases computational stability. The finite sample performance of the penalized estimators is evaluated through Monte Carlo studies and illustrated with a real data set.     

左截断右删失数据下半参数模型风险率函数估计

文章给出了右删失左截断数据半参数模型下的风险率函数估计,讨论了风险率函数估计的渐近性质,获得了这些估计的渐近正态性,对数律和重对数律.由于假定删失机制服从半参数模型下,从而知道模型的更多信息,因此对于给出参数的极大似然估计,可以改进风险率函数估计的渐近性质.也就是说,删失数据模型具有半参数的辅助信息下, 风险率函数估计的渐近方差比通常的完全非参数的估计的渐近方差更小.这说明加入了额外的信息提高了风险率函数估计的效率.     

Shrinkage estimation of partially linear single-index models

In this paper, we propose shrinkage estimation for partially linear single-index models. A profile least squares approximation is used to estimate the model parameters and select informative variables simultaneously. The resulting estimator is shown to be consistent and to enjoy the oracle properties.     

On Hsu's theorem in multivariate regression

The paper deals with optimal quadratic unbiased estimation of the unknown dispersion matrix in multivariate regression models without assuming normality of the errors. We show that Hsu's theorem for univariate regression models continues to multivariate models with no additional assumptions. Furthermore optimal quadratic plus linear estimating functions for regression coefficients are considered, and we investigate whether the ordinary linear estimates are the best. This leads to a new theorem which is similar to that of Hsu.     

Nonparametric regression with interval-censored data

In many medical studies,the prevalence of interval censored data is increasing due to periodic monitoring of the progression status of a disease.In nonparametric regression model,when the response variable is subjected to interval-censoring,the regression function could not be estimated by traditional methods directly.With the censored data,we construct a new response variable which has the same conditional expectation as the original one.Based on the new variable,we get a nearest neighbor estimator of the regression function.It is established that the estimator has strong consistency and asymptotic normality.The relevant simulation reports are given.     

Wavelet estimation of the diffusion coefficient in time dependent diffusion models

The estimation problem for diffusion coefficients in diffusion processes has been studied in many papers,where the diffusion coefficient function is assumed to be a 1-dimensional bounded Lipschitzian function of the state or the time only.There is no previous work for the nonparametric estimation of time-dependent diffusion models where the diffusion coefficient depends on both the state and the time.This paper introduces and studies a wavelet estimation of the time-dependent diffusion coefficient under a more general assumption that the diffusion coefficient is a linear growth Lipschitz function.Using the properties of martingale,we translate the problems in diffusion into the nonparametric regression setting and give the L~r convergence rate.A strong consistency of the estimate is established.With this result one can estimate the time-dependent diffusion coefficient using the same structure of the wavelet estimators under any equivalent probability measure.For example, in finance,the wavelet estimator is strongly consistent under the market probability measure as well as the risk neutral probability measure.     

Asymptotic properties of the maximum likelihood estimator for the proportional hazards model with doubly censored data

Doubly censored data, which include left as well as right censored observations, are frequently met in practice. Though estimation of the distribution function with doubly censored data has seen much study, relatively little is known about the inference of regression coefficients in the proportional hazards model for doubly censored data. In particular, theoretical properties of the maximum likelihood estimator of the regression coefficients in the proportional hazards model have not been proved yet. In this paper, we show the consistency and asymptotic normality of the maximum likelihood estimator and prove its semiparametric efficiency. The proposed methods are illustrated with simulation studies and analysis of an application from a medical study.     

Efficient estimation for semiparametric varying- coefficient partially linear regression models with current status data

This article considers a semiparametric varying-coefficient partially linear regression model with current status data. The semiparametric varying-coefficient partially linear regression model which is a generalization of the partially linear regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are conducted to examine the small-sample properties of the proposed estimates and a real dataset is used to illustrate our approach.     

Local Walsh-average-based estimation and variable selection for single-index models

We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions; the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency(ARE) has a lower bound compared with the least squares(LS) estimates; the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty; this procedure is shown to possess the oracle property. We also propose a Bayes information criterion(BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.     

Robust estimation of common regression coefficients under spherical symmetry

Consider the problem of estimating the common regression coefficients of two linear regression models where the two distributions of the errors may be different and unknown. Under the spherical symmetry assumption, the paper proves the superiority of a Graybill-Deal type combined estimator and the further improvement by the Stein effect which were exhibited by Shinozaki (1978, Comm. Statist. Theory Methods, 7, 1421–1432) in the normal case. This shows the robustness of the dominations since the conditions for the dominations are independent of the errors distributions.Research supported by NSERC Grant No. A3088 and GR-5 Grant from Faculty of Graduate Studies, Carleton University, Ottawa, Canada.