Efficient estimation in conditional single-index regression

Semiparametric single-index regression involves an unknown finite-dimensional parameter and an unknown (link) function. We consider estimation of the parameter via the pseudo-maximum likelihood method. For this purpose we estimate the conditional density of the response given a candidate index and maximize the obtained likelihood. We show that this technique of adaptation yields an asymptotically efficient estimator: it has minimal variance among all estimators.     

Bias-corrected empirical likelihood in a multi-link semiparametric model

In this paper, we investigate the empirical likelihood for constructing a confidence region of the parameter of interest in a multi-link semiparametric model when an infinite-dimensional nuisance parameter exists. The new model covers the commonly used varying coefficient, generalized linear, single-index, multi-index, hazard regression models and their generalizations, as its special cases. Because of the existence of the infinite-dimensional nuisance parameter, the classical empirical likelihood with plug-in estimation cannot be asymptotically distribution-free, and the existing bias correction is not extendable to handle such a general model. We then propose a link-based correction approach to solve this problem. This approach gives a general rule of bias correction via an inner link, and consists of two parts. For the model whose estimating equation contains the score functions that are easy to estimate, we use a centering for the scores to correct the bias; for the model of which the score functions are of complex structure, a bias-correction procedure using simpler functions instead of the scores is given without loss of asymptotic efficiency. The resulting empirical likelihood shares the desired features: it has a chi-square limit and, under-smoothing technique, high order kernel and parameter estimation are not needed. Simulation studies are carried out to examine the performance of the new method.     

Empirical likelihood for single-index models

The empirical likelihood method is especially useful for constructing confidence intervals or regions of the parameter of interest. This method has been extensively applied to linear regression and generalized linear regression models. In this paper, the empirical likelihood method for single-index regression models is studied. An estimated empirical log-likelihood approach to construct the confidence region of the regression parameter is developed. An adjusted empirical log-likelihood ratio is proved to be asymptotically standard chi-square. A simulation study indicates that compared with a normal approximation-based approach, the proposed method described herein works better in terms of coverage probabilities and areas (lengths) of confidence regions (intervals).     

Statistical inference in partially-varying-coefficient single-index model

Consider a varying-coefficient single-index model which consists of two parts: the linear part with varying coefficients and the nonlinear part with a single-index structure, and are hence termed as varying-coefficient single-index models. This model includes many important regression models such as single-index models, partially linear single-index models, varying-coefficient model and varying-coefficient partially linear models as special examples. In this paper, we mainly study estimating problems of the varying-coefficient vector, the nonparametric link function and the unknown parametric vector describing the single-index in the model. A stepwise approach is developed to obtain asymptotic normality estimators of the varying-coefficient vector and the parametric vector, and estimators of the nonparametric link function with a convergence rate. The consistent estimator of the structural error variance is also obtained. In addition, asymptotic pointwise confidence intervals and confidence regions are constructed for the varying coefficients and the parametric vector. The bandwidth selection problem is also considered. A simulation study is conducted to evaluate the proposed methods, and real data analysis is also used to illustrate our methods.     

Partially linear single-index beta regression model and score test

An important model in handling the multivariate data is the partially linear single-index regression model with a very flexible distribution—beta distribution, which is commonly used to model data restricted to some open intervals on the line. In this paper, the score test is extended to the partially linear single-index beta regression model. The penalized likelihood estimation based on P-spline is proposed. Based on the estimation, the score test statistics about varying dispersion parameter is given. Its asymptotical property is investigated. Both simulated examples are used to illustrate our proposed methods.     

Asymptotic distributions of two “synthetic data” estimators for censored single-index models

The censored single-index model provides a flexible way for modelling the association between a response and a set of predictor variables when the response variable is randomly censored and the link function is unknown. It presents a technique for “dimension reduction” in semiparametric censored regression models and generalizes the existing accelerated failure time models for survival analysis. This paper proposes two methods for estimation of single-index models with randomly censored samples. We first transform the censored data into synthetic data or pseudo-responses unbiasedly, then obtain estimates of the index coefficients by the rOPG or rMAVE procedures of Xia (2006) [1]. Finally, we estimate the unknown nonparametric link function using techniques for univariate censored nonparametric regression. The estimators for the index coefficients are shown to be root-n consistent and asymptotically normal. In addition, the estimator for the unknown regression function is a local linear kernel regression estimator and can be estimated with the same efficiency as the parameters are known. Monte Carlo simulations are conducted to illustrate the proposed methodologies.     

响应变量存在缺失时部分线性模型的经验似然推断

考虑响应变量带有缺失的部分线性模型,采用借补的思想,研究了参数部分和非参数部分的经验似然推断,证明了所提出的经验对数似然比统计量依分布收敛到χ2分布,由此构造参数部分和函数部分的置信域和逐点置信区间.对参数部分,模拟比较了经验似然与正态逼近方法;对函数部分,模拟了函数的逐点置信区间.     

Empirical likelihood for heteroscedastic partially linear models

We make empirical-likelihood-based inference for the parameters in heteroscedastic partially linear models. Unlike the existing empirical likelihood procedures for heteroscedastic partially linear models, the proposed empirical likelihood is constructed using components of a semiparametric efficient score. We show that it retains the double robustness feature of the semiparametric efficient estimator for the parameters and shares the desirable properties of the empirical likelihood for linear models. Compared with the normal approximation method and the existing empirical likelihood methods, the empirical likelihood method based on the semiparametric efficient score is more attractive not only theoretically but empirically. Simulation studies demonstrate that the proposed empirical likelihood provides smaller confidence regions than that based on semiparametric inefficient estimating equations subject to the same coverage probabilities. Hence, the proposed empirical likelihood is preferred to the normal approximation method as well as the empirical likelihood method based on semiparametric inefficient estimating equations, and it should be useful in practice.     

Empirical likelihood inference in partially linear single-index models for longitudinal data

The empirical likelihood method is especially useful for constructing confidence intervals or regions of parameters of interest. Yet, the technique cannot be directly applied to partially linear single-index models for longitudinal data due to the within-subject correlation. In this paper, a bias-corrected block empirical likelihood (BCBEL) method is suggested to study the models by accounting for the within-subject correlation. BCBEL shares some desired features: unlike any normal approximation based method for confidence region, the estimation of parameters with the iterative algorithm is avoided and a consistent estimator of the asymptotic covariance matrix is not needed. Because of bias correction, the BCBEL ratio is asymptotically chi-squared, and hence it can be directly used to construct confidence regions of the parameters without any extra Monte Carlo approximation that is needed when bias correction is not applied. The proposed method can naturally be applied to deal with pure single-index models and partially linear models for longitudinal data. Some simulation studies are carried out and an example in epidemiology is given for illustration.     

单指标模型的统计推断

本文对单指标模型的统计推断方法进行了系统阐述,其中包括联系函数和指标系数的估计,经验似然,模型检验和变量选择等。本文的取材来自近二十年来的最新研究成果。     

单指标模型的统计推断

本文对单指标模型的统计推断方法进行了系统阐述,其中包括联系函数和指标系数的估计,经验似然,模型检验和变量选择等。本文的取材来自近二十年来的最新研究成果。     

Corrected empirical likelihood inference for right-censored partially linear single-index model

This article deals with the inference on a right-censored partially linear single-index model (RCPLSIM). The main focus is the local empirical likelihood-based inference on the nonparametric part in RCPLSIM. With a synthetic data approach, an empirical log-likelihood ratio statistic for the nonparametric part is defined and it is shown that its limiting distribution is not a central chi-squared distribution. To increase the accuracy of the confidence interval, we also propose a corrected empirical log-likelihood ratio statistic for the nonparametric function. The resulting statistic is proved to follow a standard chi-squared limiting distribution. Simulation studies are undertaken to assess the finite sample performance of the proposed confidence intervals. A real example is also considered.     

Robust estimation in single-index models when the errors have a unimodal density with unknown nuisance parameter

This paper develops a robust profile estimation method for the parametric and nonparametric components of a single-index model when the errors have a strongly unimodal density with unknown nuisance parameter. We derive consistency results for the link function estimators as well as consistency and asymptotic distribution results for the single-index parameter estimators. Under a log-Gamma model, the sensitivity to anomalous observations is studied using the empirical influence curve. We also discuss a robust K-fold cross-validation procedure to select the smoothing parameters. A numerical study carried on with errors following a log-Gamma model and for contaminated schemes shows the good robustness properties of the proposed estimators and the advantages of considering a robust approach instead of the classical one. A real data set illustrates the use of our proposal.

     

Estimation for a marginal generalized single-index longitudinal model

In this paper, we suggest an estimating equations based approach to study a general single-index model with a given out-layer link for longitudinal data and treat the classical one as its special case. Within a wide range of bandwidths which is for estimating the inner-layer nonparametric link, the root-n consistency of the estimator of the index can be proved. The estimation efficiency can be achieved even when there is an infinite-dimensional nuisance parameter to be estimated. The performance of the new method is assessed through the comparison with other existing methods and through an application to an epileptic seizure study.     

On an asymptotically more efficient estimation of the single-index model

In this note, we revisit the single-index model with heteroscedastic error, and recommend an estimating equation method in terms of transferring restricted least squares to unrestricted least squares: the estimator of the index parameter is asymptotically more efficient than existing estimators in the literature in the sense that it is of a smaller limiting variance.     

Semi-parametric estimation of partially linear single-index models

One of the most difficult problems in applications of semi-parametric partially linear single-index models (PLSIM) is the choice of pilot estimators and complexity parameters which may result in radically different estimators. Pilot estimators are often assumed to be root-n consistent, although they are not given in a constructible way. Complexity parameters, such as a smoothing bandwidth are constrained to a certain speed, which is rarely determinable in practical situations.In this paper, efficient, constructible and practicable estimators of PLSIMs are designed with applications to time series. The proposed technique answers two questions from Carroll et al. [Generalized partially linear single-index models, J. Amer. Statist. Assoc. 92 (1997) 477-489]: no root-n pilot estimator for the single-index part of the model is needed and complexity parameters can be selected at the optimal smoothing rate. The asymptotic distribution is derived and the corresponding algorithm is easily implemented. Examples from real data sets (credit-scoring and environmental statistics) illustrate the technique and the proposed methodology of minimum average variance estimation (MAVE).     

Empirical likelihood for single-index models with responses missing at random

The missing response problem in single-index models is studied, and a bias-correction method to infer the index coefficients is developed. Two weighted empirical log-likelihood ratios with asymptotic chisquare are derived, and the corresponding empirical likelihood confidence regions for the index coefficients are constructed. In addition, the estimators of the index coefficients and the link function are defined, and their asymptotic normalities are proved. A simulation study is conducted to compare the empirical likelihood and the normal approximation based method in terms of coverage probabilities and average lengths of confidence intervals. A real example illustrates our methods.     

Empirical likelihood inference for censored median regression model via nonparametric kernel estimation

An alternative to the accelerated failure time model is to regress the median of the failure time on the covariates. In the recent years, censored median regression models have been shown to be useful for analyzing a variety of censored survival data with the robustness property. Based on missing information principle, a semiparametric inference procedure for regression parameter has been developed when censoring variable depends on continuous covariate. In order to improve the low coverage accuracy of such procedure, we apply an empirical likelihood ratio method (EL) to the model and derive the limiting distributions of the estimated and adjusted empirical likelihood ratios for the vector of regression parameter. Two kinds of EL confidence regions for the unknown vector of regression parameters are obtained accordingly. We conduct an extensive simulation study to compare the performance of the proposed methods with that normal approximation based method. The simulation results suggest that the EL methods outperform the normal approximation based method in terms of coverage probability. Finally, we make some discussions about our methods.     

Statistical inference for the index parameter in single-index models

In this paper, we are concerned with statistical inference for the index parameter in the single-index model . Based on the estimates obtained by the local linear method, we extend the generalized likelihood ratio test to the single-index model. We investigate the asymptotic behaviour of the proposed test and demonstrate that its limiting null distribution follows a χ²-distribution, with the scale constant and the number of degrees of freedom being independent of nuisance parameters or functions, which is called the Wilks phenomenon. A simulated example is used to illustrate the performance of the testing approach.     

Asymptotic properties of conditional maximum likelihood estimator in a certain exponential model

The conditional maximum likelihood estimator is suggested as an alternative to the maximum likelihood estimator and is favorable for an estimator of a dispersion parameter in the normal distribution, the inverse-Gaussian distribution, and so on. However, it is not clear whether the conditional maximum likelihood estimator is asymptotically efficient in general. Consider the case where it is asymptotically efficient and its asymptotic covariance depends only on an objective parameter in an exponential model. This remand implies that the exponential model possesses a certain parallel foliation. In this situation, this paper investigates asymptotic properties of the conditional maximum likelihood estimator and compares the conditional maximum likelihood estimator with the maximum likelihood estimator. We see that the bias of the former is more robust than that of the latter and that two estimators are very close, especially in the sense of bias-corrected version. The mean Pythagorean relation is also discussed.