Empirical likelihood for single-index models

The empirical likelihood method is especially useful for constructing confidence intervals or regions of the parameter of interest. This method has been extensively applied to linear regression and generalized linear regression models. In this paper, the empirical likelihood method for single-index regression models is studied. An estimated empirical log-likelihood approach to construct the confidence region of the regression parameter is developed. An adjusted empirical log-likelihood ratio is proved to be asymptotically standard chi-square. A simulation study indicates that compared with a normal approximation-based approach, the proposed method described herein works better in terms of coverage probabilities and areas (lengths) of confidence regions (intervals).     

Bias-corrected empirical likelihood in a multi-link semiparametric model

In this paper, we investigate the empirical likelihood for constructing a confidence region of the parameter of interest in a multi-link semiparametric model when an infinite-dimensional nuisance parameter exists. The new model covers the commonly used varying coefficient, generalized linear, single-index, multi-index, hazard regression models and their generalizations, as its special cases. Because of the existence of the infinite-dimensional nuisance parameter, the classical empirical likelihood with plug-in estimation cannot be asymptotically distribution-free, and the existing bias correction is not extendable to handle such a general model. We then propose a link-based correction approach to solve this problem. This approach gives a general rule of bias correction via an inner link, and consists of two parts. For the model whose estimating equation contains the score functions that are easy to estimate, we use a centering for the scores to correct the bias; for the model of which the score functions are of complex structure, a bias-correction procedure using simpler functions instead of the scores is given without loss of asymptotic efficiency. The resulting empirical likelihood shares the desired features: it has a chi-square limit and, under-smoothing technique, high order kernel and parameter estimation are not needed. Simulation studies are carried out to examine the performance of the new method.     

Empirical likelihood for a varying coefficient partially linear model with diverging number of parameters

The purpose of this paper is two-fold. First, for the estimation or inference about the parameters of interest in semiparametric models, the commonly used plug-in estimation for infinite-dimensional nuisance parameter creates non-negligible bias, and the least favorable curve or under-smoothing is popularly employed for bias reduction in the literature. To avoid such strong structure assumptions on the models and inconvenience of estimation implementation, for the diverging number of parameters in a varying coefficient partially linear model, we adopt a bias-corrected empirical likelihood (BCEL) in this paper. This method results in the distribution of the empirical likelihood ratio to be asymptotically tractable. It can then be directly applied to construct confidence region for the parameters of interest. Second, different from all existing methods that impose strong conditions to ensure consistency of estimation when diverging the number of the parameters goes to infinity as the sample size goes to infinity, we provide techniques to show that, other than the usual regularity conditions, the consistency holds under moment conditions alone on the covariates and error with a diverging rate being even faster than those in the literature. A simulation study is carried out to assess the performance of the proposed method and to compare it with the profile least squares method. A real dataset is analyzed for illustration.     

Statistical inference in partially-varying-coefficient single-index model

Consider a varying-coefficient single-index model which consists of two parts: the linear part with varying coefficients and the nonlinear part with a single-index structure, and are hence termed as varying-coefficient single-index models. This model includes many important regression models such as single-index models, partially linear single-index models, varying-coefficient model and varying-coefficient partially linear models as special examples. In this paper, we mainly study estimating problems of the varying-coefficient vector, the nonparametric link function and the unknown parametric vector describing the single-index in the model. A stepwise approach is developed to obtain asymptotic normality estimators of the varying-coefficient vector and the parametric vector, and estimators of the nonparametric link function with a convergence rate. The consistent estimator of the structural error variance is also obtained. In addition, asymptotic pointwise confidence intervals and confidence regions are constructed for the varying coefficients and the parametric vector. The bandwidth selection problem is also considered. A simulation study is conducted to evaluate the proposed methods, and real data analysis is also used to illustrate our methods.     

Empirical likelihood for the parametric part in partially linear errors-in-function models

Partially linear errors-in-function models were proposed by Liang (2000), but their inferences have not been systematically studied. This article proposes an empirical likelihood method to construct confidence regions of the parametric components. Under mild regularity conditions, the nonparametric version of the Wilk’s theorem is derived. Simulation studies show that the proposed empirical likelihood method provides narrower confidence regions, as well as higher coverage probabilities than those based on the traditional normal approximation method.     

Empirical likelihood for semiparametric regression model with missing response data

A bias-corrected technique for constructing the empirical likelihood ratio is used to study a semiparametric regression model with missing response data. We are interested in inference for the regression coefficients, the baseline function and the response mean. A class of empirical likelihood ratio functions for the parameters of interest is defined so that undersmoothing for estimating the baseline function is avoided. The existing data-driven algorithm is also valid for selecting an optimal bandwidth. Our approach is to directly calibrate the empirical log-likelihood ratio so that the resulting ratio is asymptotically chi-squared. Also, a class of estimators for the parameters of interest is constructed, their asymptotic distributions are obtained, and consistent estimators of asymptotic bias and variance are provided. Our results can be used to construct confidence intervals and bands for the parameters of interest. A simulation study is undertaken to compare the empirical likelihood with the normal approximation-based method in terms of coverage accuracies and average lengths of confidence intervals. An example for an AIDS clinical trial data set is used for illustrating our methods.     

Semiparametric inference for transformation models via empirical likelihood

Recent advances in the transformation model have made it possible to use this model for analyzing a variety of censored survival data. For inference on the regression parameters, there are semiparametric procedures based on the normal approximation. However, the accuracy of such procedures can be quite low when the censoring rate is heavy. In this paper, we apply an empirical likelihood ratio method and derive its limiting distribution via U-statistics. We obtain confidence regions for the regression parameters and compare the proposed method with the normal approximation based method in terms of coverage probability. The simulation results demonstrate that the proposed empirical likelihood method overcomes the under-coverage problem substantially and outperforms the normal approximation based method. The proposed method is illustrated with a real data example. Finally, our method can be applied to general U-statistic type estimating equations.     

Empirical likelihood for LAD estimators in infinite variance ARMA models

In this paper, we use an empirical likelihood method to construct confidence regions for the stationary ARMA(p,q) models with infinite variance. An empirical log-likelihood ratio is derived by the estimating equation of the self-weighted LAD estimator. It is proved that the proposed statistic has an asymptotic standard chi-squared distribution. Simulation studies show that in a small sample case, the performance of empirical likelihood method is better than that of normal approximation of the LAD estimator in terms of the coverage accuracy.     

Semi-parametric estimation of partially linear single-index models

One of the most difficult problems in applications of semi-parametric partially linear single-index models (PLSIM) is the choice of pilot estimators and complexity parameters which may result in radically different estimators. Pilot estimators are often assumed to be root-n consistent, although they are not given in a constructible way. Complexity parameters, such as a smoothing bandwidth are constrained to a certain speed, which is rarely determinable in practical situations.In this paper, efficient, constructible and practicable estimators of PLSIMs are designed with applications to time series. The proposed technique answers two questions from Carroll et al. [Generalized partially linear single-index models, J. Amer. Statist. Assoc. 92 (1997) 477-489]: no root-n pilot estimator for the single-index part of the model is needed and complexity parameters can be selected at the optimal smoothing rate. The asymptotic distribution is derived and the corresponding algorithm is easily implemented. Examples from real data sets (credit-scoring and environmental statistics) illustrate the technique and the proposed methodology of minimum average variance estimation (MAVE).     

Partially linear single-index beta regression model and score test

An important model in handling the multivariate data is the partially linear single-index regression model with a very flexible distribution—beta distribution, which is commonly used to model data restricted to some open intervals on the line. In this paper, the score test is extended to the partially linear single-index beta regression model. The penalized likelihood estimation based on P-spline is proposed. Based on the estimation, the score test statistics about varying dispersion parameter is given. Its asymptotical property is investigated. Both simulated examples are used to illustrate our proposed methods.     

Empirical likelihood for heteroscedastic partially linear models

We make empirical-likelihood-based inference for the parameters in heteroscedastic partially linear models. Unlike the existing empirical likelihood procedures for heteroscedastic partially linear models, the proposed empirical likelihood is constructed using components of a semiparametric efficient score. We show that it retains the double robustness feature of the semiparametric efficient estimator for the parameters and shares the desirable properties of the empirical likelihood for linear models. Compared with the normal approximation method and the existing empirical likelihood methods, the empirical likelihood method based on the semiparametric efficient score is more attractive not only theoretically but empirically. Simulation studies demonstrate that the proposed empirical likelihood provides smaller confidence regions than that based on semiparametric inefficient estimating equations subject to the same coverage probabilities. Hence, the proposed empirical likelihood is preferred to the normal approximation method as well as the empirical likelihood method based on semiparametric inefficient estimating equations, and it should be useful in practice.     

Efficient empirical-likelihood-based inferences for the single-index model

This article proposes the efficient empirical-likelihood-based inferences for the single component of the parameter and the link function in the single-index model. Unlike the existing empirical likelihood procedures for the single-index model, the proposed profile empirical likelihood for the parameter is constructed by using some components of the maximum empirical likelihood estimator (MELE) based on a semiparametric efficient score. The empirical-likelihood-based inference for the link function is also considered. The resulting statistics are proved to follow a standard chi-squared limiting distribution. Simulation studies are undertaken to assess the finite sample performance of the proposed confidence intervals. An application to real data set is illustrated.     

删失数据下单指标模型的经验似然推断

考虑删失数据下单指标模型, 研究了模型中参数的经验似然推断, 证明了所提出的调整的经验对数似然比渐近于卡方分布, 由此构造相应兴趣参数的置信域. 进一步, 由于模型中参数向量的范数等于1,利用该约束条件来降低参数的维数, 从而增加置信域的精度.模拟研究比较了经验似然方法和正态逼近方法的有限样本性质,从置信域的面积和覆盖概率两方面进行了比较,模拟结果表明经验似然方法优于正态逼近方法.     

Empirical likelihood inference for censored median regression model via nonparametric kernel estimation

An alternative to the accelerated failure time model is to regress the median of the failure time on the covariates. In the recent years, censored median regression models have been shown to be useful for analyzing a variety of censored survival data with the robustness property. Based on missing information principle, a semiparametric inference procedure for regression parameter has been developed when censoring variable depends on continuous covariate. In order to improve the low coverage accuracy of such procedure, we apply an empirical likelihood ratio method (EL) to the model and derive the limiting distributions of the estimated and adjusted empirical likelihood ratios for the vector of regression parameter. Two kinds of EL confidence regions for the unknown vector of regression parameters are obtained accordingly. We conduct an extensive simulation study to compare the performance of the proposed methods with that normal approximation based method. The simulation results suggest that the EL methods outperform the normal approximation based method in terms of coverage probability. Finally, we make some discussions about our methods.     

Bartlett correctable two-sample adjusted empirical likelihood

We propose a two-sample adjusted empirical likelihood (AEL) to construct confidence regions for the difference of two d-dimensional population means. This method eliminates the non-definition of the usual two-sample empirical likelihood (EL) and is shown to be Bartlett correctable. We further show that when the adjustment level is half the Bartlett correction factor for the usual two-sample EL, the two-sample AEL has the same high-order precision as the EL with Bartlett correction. To enhance the performance of the two-sample AEL with adjustment level being half the Bartlett correction factor, we propose a less biased estimate of the Bartlett correction factor. The efficiency of the proposed method is illustrated by simulations and a real data example.     

A profile-type smoothed score function for a varying coefficient partially linear model

The varying coefficient partially linear model is considered in this paper. When the plug-in estimators of coefficient functions are used, the resulting smoothing score function becomes biased due to the slow convergence rate of nonparametric estimations. To reduce the bias of the resulting smoothing score function, a profile-type smoothed score function is proposed to draw inferences on the parameters of interest without using the quasi-likelihood framework, the least favorable curve, a higher order kernel or under-smoothing. The resulting profile-type statistic is still asymptotically Chi-squared under some regularity conditions. The results are then used to construct confidence regions for the parameters of interest. A simulation study is carried out to assess the performance of the proposed method and to compare it with the profile least-squares method. A real dataset is analyzed for illustration.     

Corrected empirical likelihood inference for right-censored partially linear single-index model

This article deals with the inference on a right-censored partially linear single-index model (RCPLSIM). The main focus is the local empirical likelihood-based inference on the nonparametric part in RCPLSIM. With a synthetic data approach, an empirical log-likelihood ratio statistic for the nonparametric part is defined and it is shown that its limiting distribution is not a central chi-squared distribution. To increase the accuracy of the confidence interval, we also propose a corrected empirical log-likelihood ratio statistic for the nonparametric function. The resulting statistic is proved to follow a standard chi-squared limiting distribution. Simulation studies are undertaken to assess the finite sample performance of the proposed confidence intervals. A real example is also considered.     

Empirical likelihood for single-index models with responses missing at random

The missing response problem in single-index models is studied, and a bias-correction method to infer the index coefficients is developed. Two weighted empirical log-likelihood ratios with asymptotic chisquare are derived, and the corresponding empirical likelihood confidence regions for the index coefficients are constructed. In addition, the estimators of the index coefficients and the link function are defined, and their asymptotic normalities are proved. A simulation study is conducted to compare the empirical likelihood and the normal approximation based method in terms of coverage probabilities and average lengths of confidence intervals. A real example illustrates our methods.     

Empirical likelihood confidence regions of the parameters in a partially linear single-index model

In this paper,a partially linear single-index model is investigated,and three empirical log-likelihood ratio statistics for the unknown parameters in the model are sug- gested.It is proved that the proposed statistics are asymptotically standard chi-square un- der some suitable conditions,and hence can be used to construct the confidence regions of the parameters.Our methods can also deal with the confidence region construction for the index in the pure single-index model.A simulation study indicates that,in terms of cov- erage probabilities and average areas of the confidence regions,the proposed methods perform better than the least-squares method.     

An empirical likelihood method in a partially linear single-index model with right censored data

Empirical-likelihood-based inference for the parameters in a partially linear single-index model with randomly censored data is investigated. We introduce an estimated empirical likelihood for the parameters using a synthetic data approach and show that its limiting distribution is a mixture of central chi-squared distribution. To attack this difficulty we propose an adjusted empirical likelihood to achieve the standard χ2-limit. Furthermore, since the index is of norm 1, we use this constraint to reduce the dimension of parameters, which increases the accuracy of the confidence regions. A simulation study is carried out to compare its finite-sample properties with the existing method. An application to a real data set is illustrated.