On an asymptotically more efficient estimation of the single-index model

In this note, we revisit the single-index model with heteroscedastic error, and recommend an estimating equation method in terms of transferring restricted least squares to unrestricted least squares: the estimator of the index parameter is asymptotically more efficient than existing estimators in the literature in the sense that it is of a smaller limiting variance.     

Efficient estimation in conditional single-index regression

Semiparametric single-index regression involves an unknown finite-dimensional parameter and an unknown (link) function. We consider estimation of the parameter via the pseudo-maximum likelihood method. For this purpose we estimate the conditional density of the response given a candidate index and maximize the obtained likelihood. We show that this technique of adaptation yields an asymptotically efficient estimator: it has minimal variance among all estimators.     

Versatile estimation in censored single-index hazards regression

One attractive advantage of the presented single-index hazards regression is that it can take into account possibly time-dependent covariates. In such a model formulation, the main theme of this research is to develop a theoretically valid and practically feasible estimation procedure for the index coefficients and the induced survival function. In particular, compared with the existing pseudo-likelihood approaches, our one proposes an automatic bandwidth selection and suppresses an influence of outliers. By making an effective use of the considered versatile survival process, we further reduce a substantial finite-sample bias in the Chambless-Diao type estimator of the most popular time-dependent accuracy summary. The asymptotic properties of estimators and data-driven bandwidths are also established under some suitable conditions. It is found in simulations that the proposed estimators and inference procedures exhibit quite satisfactory performances. Moreover, the general applicability of our methodology is illustrated by two empirical data.     

Shrinkage estimation of partially linear single-index models

In this paper, we propose shrinkage estimation for partially linear single-index models. A profile least squares approximation is used to estimate the model parameters and select informative variables simultaneously. The resulting estimator is shown to be consistent and to enjoy the oracle properties.     

Semi-parametric estimation of partially linear single-index models

One of the most difficult problems in applications of semi-parametric partially linear single-index models (PLSIM) is the choice of pilot estimators and complexity parameters which may result in radically different estimators. Pilot estimators are often assumed to be root-n consistent, although they are not given in a constructible way. Complexity parameters, such as a smoothing bandwidth are constrained to a certain speed, which is rarely determinable in practical situations.In this paper, efficient, constructible and practicable estimators of PLSIMs are designed with applications to time series. The proposed technique answers two questions from Carroll et al. [Generalized partially linear single-index models, J. Amer. Statist. Assoc. 92 (1997) 477-489]: no root-n pilot estimator for the single-index part of the model is needed and complexity parameters can be selected at the optimal smoothing rate. The asymptotic distribution is derived and the corresponding algorithm is easily implemented. Examples from real data sets (credit-scoring and environmental statistics) illustrate the technique and the proposed methodology of minimum average variance estimation (MAVE).     

Semiparametric estimation of the link function in binary-choice single-index models

We propose a new, easy to implement, semiparametric estimator for binary-choice single-index models which uses parametric information in the form of a known link (probability) function and nonparametrically corrects it. Asymptotic properties are derived and the finite sample performance of the proposed estimator is compared to those of the parametric probit and semiparametric single-index model estimators of Ichimura (J Econ 58:71–120, 1993) and Klein and Spady (Econometrica 61:387–421, 1993). Results indicate that if the parametric start is correct, the proposed estimator achieves significant bias reduction and efficiency gains compared to Ichimura (1993) and Klein and Spady (1993). Interestingly, the proposed estimator still achieves significant bias reduction and efficiency gains even if the parametric start is not correct.     

Rank-based inference for the single-index model

This paper is concerned with estimating the coefficients in single-index models. We develop a robust estimator, which combines the ideas of rank-based regression inference and outer product of gradients. Both asymptotic and numerical results show that the proposed procedure has better performance than the least-squares-based method when the errors deviate from normal.     

Statistical inference in partially-varying-coefficient single-index model

Consider a varying-coefficient single-index model which consists of two parts: the linear part with varying coefficients and the nonlinear part with a single-index structure, and are hence termed as varying-coefficient single-index models. This model includes many important regression models such as single-index models, partially linear single-index models, varying-coefficient model and varying-coefficient partially linear models as special examples. In this paper, we mainly study estimating problems of the varying-coefficient vector, the nonparametric link function and the unknown parametric vector describing the single-index in the model. A stepwise approach is developed to obtain asymptotic normality estimators of the varying-coefficient vector and the parametric vector, and estimators of the nonparametric link function with a convergence rate. The consistent estimator of the structural error variance is also obtained. In addition, asymptotic pointwise confidence intervals and confidence regions are constructed for the varying coefficients and the parametric vector. The bandwidth selection problem is also considered. A simulation study is conducted to evaluate the proposed methods, and real data analysis is also used to illustrate our methods.     

Adaptive covariance estimation with model selection

We provide in this paper a fully adaptive penalized procedure to select a covariance among a collection of models observing i.i.d. replications of the process at fixed observation points. For this we generalize the results of [3] and propose to use a data driven penalty to obtain an oracle inequality for the estimator. We prove that this method is an extension of the work by Baraud in [1] to the matrix regression model.     

Efficient empirical-likelihood-based inferences for the single-index model

This article proposes the efficient empirical-likelihood-based inferences for the single component of the parameter and the link function in the single-index model. Unlike the existing empirical likelihood procedures for the single-index model, the proposed profile empirical likelihood for the parameter is constructed by using some components of the maximum empirical likelihood estimator (MELE) based on a semiparametric efficient score. The empirical-likelihood-based inference for the link function is also considered. The resulting statistics are proved to follow a standard chi-squared limiting distribution. Simulation studies are undertaken to assess the finite sample performance of the proposed confidence intervals. An application to real data set is illustrated.     

Semiparametric estimation in regression with missing covariates using single-index models

We investigate semiparametric estimation of regression coefficients through generalized estimating equations with single-index models when some covariates are missing at random. Existing popular semiparametric estimators may run into difficulties when some selection probabilities are small or the dimension of the covariates is not low. We propose a new simple parameter estimator using a kernel-assisted estimator for the augmentation by a single-index model without using the inverse of selection probabilities. We show that under certain conditions the proposed estimator is as efficient as the existing methods based on standard kernel smoothing, which are often practically infeasible in the case of multiple covariates. A simulation study and a real data example are presented to illustrate the proposed method. The numerical results show that the proposed estimator avoids some numerical issues caused by estimated small selection probabilities that are needed in other estimators.

     

Beran-based approach for single-index models under censoring

In this paper we propose a new method for estimating parameters in a single-index model under censoring based on the Beran estimator for the conditional distribution function. This, likelihood-based method is also a useful and simple tool used for bandwidth selection. Additionally, we perform an extensive simulation study comparing this new Beran-based approach with other existing method based on Kaplan–Meier integrals. Finally, we apply both methods to a primary biliary cirrhosis data set and propose a bootstrap test for the parameters.     

Variable selection for the partial linear single-index model

In this paper, we consider the issue of variable selection in partial linear single-index models under the assumption that the vector of regression coefficients is sparse. We apply penalized spline to estimate the nonparametric function and SCAD penalty to achieve sparse estimates of regression parameters in both the linear and single-index parts of the model. Under some mild conditions, it is shown that the penalized estimators have oracle property, in the sense that it is asymptotically normal with the same mean and covariance that they would have if zero coefficients are known in advance. Our model owns a least square representation, therefore standard least square programming algorithms can be implemented without extra programming efforts. In the meantime, parametric estimation, variable selection and nonparametric estimation can be realized in one step, which incredibly increases computational stability. The finite sample performance of the penalized estimators is evaluated through Monte Carlo studies and illustrated with a real data set.     

Local Walsh-average-based estimation and variable selection for single-index models

We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions; the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency(ARE) has a lower bound compared with the least squares(LS) estimates; the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty; this procedure is shown to possess the oracle property. We also propose a Bayes information criterion(BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.     

Variable selection for single-index varying-coefficient model

We consider the problem of variable selection for single-index varying-coefficient model, and present a regularized variable selection procedure by combining basis function approximations with SCAD penalty. The proposed procedure simultaneously selects significant covariates with functional coefficients and local significant variables with parametric coefficients. With appropriate selection of the tuning parameters, the consistency of the variable selection procedure and the oracle property of the estimators are established. The proposed method can naturally be applied to deal with pure single-index model and varying-coefficient model. Finite sample performances of the proposed method are illustrated by a simulation study and the real data analysis.     

Dynamic single-index model for functional data

We propose a new functional single index model, which called dynamic single-index model for functional data, or DSIM, to efficiently perform non-linear and dynamic relationships between functional predictor and functional response. The proposed model naturally allows for some curvature not captured by the ordinary functional linear model. By using the proposed two-step estimating algorithm, we develop the estimates for both the link function and the regression coefficient function, and then provide predictions of new response trajectories. Besides the asymptotic properties for the estimates of the unknown functions, we also establish the consistency of the predictions of new response trajectories under mild conditions. Finally, we show through extensive simulation studies and a real data example that the proposed DSIM can highly outperform existed functional regression methods in most settings.     

Testing for the parametric parts in a single-index varying-coefficient model

Single-index varying-coefficient models (SIVCMs) are very useful in multivariate nonparametric regression.However,there has less attention focused on inferences of the SIVCMs.Using the local linear method,we propose estimates of the unknowns in the SIVCMs.In this article,our main purpose is to examine whether the generalized likelihood ratio (GLR) tests are applicable to the testing problem for the index parameter in the SIVCMs.Under the null hypothesis our proposed GLR statistic follows the chi-squared distribution asymptotically with scale constant and degree of freedom independent of the nuisance parameters or functions,which is called as Wilks’ phenomenon (see Fan et al.,2001).A simulation study is conducted to illustrate the proposed methodology.