Delete-group Jackknife Estimate in Partially Linear Regression Models with Heteroscedasticity

Abstract Consider a partially linear regression model with an unknown vector parameter β,an unknownfunction g(.),and unknown heteroscedastic error variances.Chen,You proposed a semiparametric generalizedleast squares estimator(SGLSE)for β,which takes the heteroscedasticity into account to increase efficiency.Forinference based on this SGLSE,it is necessary to construct a consistent estimator for its asymptotic covariancematrix.However,when there exists within-group correlation, the traditional delta method and the delete-1jackknife estimation fail to offer such a consistent estimator.In this paper, by deleting grouped partial residualsa delete-group jackknife method is examined.It is shown that the delete-group jackknife method indeed canprovide a consistent estimator for the asymptotic covariance matrix in the presence of within-group correlations.This result is an extension of that in[21].     

Asymptotics of Huber-Dutter Estimators for Partial Linear Model with Nonstochastic Designs

For partial linear model Y=X~τβ_0 _(g0)(T) εwith unknown β_0∈R~d and an unknown smooth function go, this paper considers the Huber-Dutter estimators of β_0, scale σfor the errors and the function go respectively, in which the smoothing B-spline function is used. Under some regular conditions, it is shown that the Huber-Dutter estimators of β_0 and σare asymptotically normal with convergence rate n~((-1)/2) and the B-spline Huber-Dutter estimator of go achieves the optimal convergence rate in nonparametric regression. A simulation study demonstrates that the Huber-Dutter estimator of β_0 is competitive with its M-estimator without scale parameter and the ordinary least square estimator. An example is presented after the simulation study.     

Consistency and normality of Huber-Dutter estimators for partial linear model

For partial linear model Y = Xτβ0 g0(T) with unknown β0 ∈ Rd and an unknown smooth function g0, this paper considers the Huber-Dutter estimators of β0, scale σ for the errors and the function g0 approximated by the smoothing B-spline functions, respectively. Under some regularity conditions, the Huber-Dutter estimators of β0 and σ are shown to be asymptotically normal with the rate of convergence n-1/2 and the B-spline Huber-Dutter estimator of g0 achieves the optimal rate of convergence in nonparametric regression. A simulation study and two examples demonstrate that the Huber-Dutter estimator of β0 is competitive with its M-estimator without scale parameter and the ordinary least square estimator.     

Pooled marginal slicing approach via SIR<Subscript><Emphasis Type="Italic">α</Emphasis></Subscript> with discrete covariables

In this paper, we consider a semiparametric regression model involving both p-dimensional quantitative covariable X and categorical predictor Z, and including a dimension reduction of X via K indices X′β _k . The dependent variable Y can be real or q-dimensional. We propose an approach based on SIR _α and pooled marginal slicing methods in order to estimate the space spanned by the β _k ’s. We establish -consistency of the proposed estimator. Simulation studies show the numerical qualities of our estimator.     

Empirical Bayes Estimation in Regression Model

This paper considers the empirical Bayes （EB） estimation problem for the parameter β of the linear regression model y = Xβ＋ ε with ε- N（0, σ^2I） given β. Based on Pitman closeness （PC） criterion and mean square error matrix （MSEM） criterion, we prove the superiority of the EB estimator over the ordinary least square estimator （OLSE）.     

Empirical Bayes estimation in a multiple linear regression model

Summary Estimation of the vector β of the regression coefficients in a multiple linear regressionY=Xβ+ε is considered when β has a completely unknown and unspecified distribution and the error-vector ε has a multivariate standard normal distribution. The optimal estimator for β, which minimizes the overall mean squared error, cannot be constructed for use in practice. UsingX, Y and the information contained in the observation-vectors obtained fromn independent past experiences of the problem, (empirical Bayes) estimators for β are exhibited. These estimators are compared with the optimal estimator and are shown to be asymptotically optimal. Estimators asymptotically optimal with rates nearO(n ⁻¹) are constructed. Supported in part by a Natural Sciences and Engineering Research Council of Canada grant.     

Asymptotic Properties of a Modified Semi-Parametric MLE in Linear Regression with Right-Censored Data

Consider a linear regression model, Y=β′X+ε where Y may be right censored and the cdf F _o of ε is unknown. We show that a modified semi-parametric MLE, denoted by is strongly consistent under certain regularity conditions. Moreover, if F _o is discontinuous, then P(≠β i.o.)=0, which means that P(=β if the sample size is large)=1. The latter property has not been reported for the existing estimators. By contrast, most estimators, such as the Buckley-James estimator and M-estimators , satisfy that P(≠β i.o.)=1. Received April 23, 2001, Accepted November 13, 2001     

Statistical inference in a panel data semiparametric regression model with serially correlated errors

We consider a panel data semiparametric partially linear regression model with an unknown vector β of regression coefficients, an unknown nonparametric function g(·) for nonlinear component, and unobservable serially correlated errors. The correlated errors are modeled by a vector autoregressive process which involves a constant intraclass correlation. Applying the pilot estimators of β and g(·), we construct estimators of the autoregressive coefficients, the intraclass correlation and the error variance, and investigate their asymptotic properties. Fitting the error structure results in a new semiparametric two-step estimator of β, which is shown to be asymptotically more efficient than the usual semiparametric least squares estimator in terms of asymptotic covariance matrix. Asymptotic normality of this new estimator is established, and a consistent estimator of its asymptotic covariance matrix is presented. Furthermore, a corresponding estimator of g(·) is also provided. These results can be used to make asymptotically efficient statistical inference. Some simulation studies are conducted to illustrate the finite sample performances of these proposed estimators.     

Statistical inference for panel data semiparametric partially linear regression models with heteroscedastic errors

We consider a panel data semiparametric partially linear regression model with an unknown parameter vector for the linear parametric component, an unknown nonparametric function for the nonlinear component, and a one-way error component structure which allows unequal error variances (referred to as heteroscedasticity). We develop procedures to detect heteroscedasticity and one-way error component structure, and propose a weighted semiparametric least squares estimator (WSLSE) of the parametric component in the presence of heteroscedasticity and/or one-way error component structure. This WSLSE is asymptotically more efficient than the usual semiparametric least squares estimator considered in the literature. The asymptotic properties of the WSLSE are derived. The nonparametric component of the model is estimated by the local polynomial method. Some simulations are conducted to demonstrate the finite sample performances of the proposed testing and estimation procedures. An example of application on a set of panel data of medical expenditures in Australia is also illustrated.     

Stein shrinkage and second-order efficiency for semiparametric estimation of the shift

The problem of estimating the shift (or, equivalently, the center of symmetry) of an unknown symmetric and periodic function f observed in Gaussian white noise is considered. Using the blockwise Stein method, a penalized profile likelihood with a data-driven penalization is introduced so that the estimator of the center of symmetry is defined as the maximizer of the penalized profile likelihood. This estimator has the advantage of being independent of the functional class to which the signal f is assumed to belong and, furthermore, is shown to be semiparametrically adaptive and efficient. Moreover, the second-order term of the risk expansion of the proposed estimator is proved to behave at least as well as the second-order term of the risk of the best possible estimator using monotone smoothing filter. Under mild assumptions, this estimator is shown to be second-order minimax sharp adaptive over the whole scale of Sobolev balls with smoothness β > 1. Thus, these results extend those of [10], where second-order asymptotic minimaxity is proved for an estimator depending on the functional class containing f and β ≥ 2 is required.      

Full likelihood inferences in the Cox model: an empirical likelihood approach

For the regression parameter β ₀ in the Cox model, there have been several estimators constructed based on various types of approximated likelihood, but none of them has demonstrated small-sample advantage over Cox’s partial likelihood estimator. In this article, we derive the full likelihood function for (β ₀, F ₀), where F ₀ is the baseline distribution in the Cox model. Using the empirical likelihood parameterization, we explicitly profile out nuisance parameter F ₀ to obtain the full-profile likelihood function for β ₀ and the maximum likelihood estimator (MLE) for (β ₀, F ₀). The relation between the MLE and Cox’s partial likelihood estimator for β ₀ is made clear by showing that Taylor’s expansion gives Cox’s partial likelihood estimating function as the leading term of the full-profile likelihood estimating function. We show that the log full-likelihood ratio has an asymptotic chi-squared distribution, while the simulation studies indicate that for small or moderate sample sizes, the MLE performs favorably over Cox’s partial likelihood estimator. In a real dataset example, our full likelihood ratio test and Cox’s partial likelihood ratio test lead to statistically different conclusions.     

Polynomial Regression with Censored Data based on Preliminary Nonparametric Estimation

Consider the polynomial regression model , where σ²(X)=Var(Y|X) is unknown, and ε is independent of X and has zero mean. Suppose that Y is subject to random right censoring. A new estimation procedure for the parameters β₀,...,β _p is proposed, which extends the classical least squares procedure to censored data. The proposed method is inspired by the method of Buckley and James (1979, Biometrika, 66, 429–436), but is, unlike the latter method, a noniterative procedure due to nonparametric preliminary estimation of the conditional regression function. The asymptotic normality of the estimators is established. Simulations are carried out for both methods and they show that the proposed estimators have usually smaller variance and smaller mean squared error than the Buckley–James estimators. The two estimation procedures are also applied to a medical and an astronomical data set.     

NS Condition of Admissibility for the Linear Estimator of Normal Mean with Unknown Variance

Suppose Y - N（β, σ^2 In）, where β ∈ R^n and σ^2 〉 0 are unknown. We study the admissibility of linear estimators of mean vector under a quadratic loss function. A necessary and sufficient condition of the admissible linear estimator is given.     

Estimation of the distribution of random shifts deformation

Consider discrete values of functions shifted by unobserved translation effects, which are independent realizations of a random variable with unknown distribution μ modeling the variability in the response of each individual. Our aim is to construct a nonparametric estimator of the density of these random translation deformations using semiparametric preliminary estimates of the shifts. Based on the results of Dalalyan et al. [7], semiparametric estimators are obtained in our discrete framework and their performance studied. From these estimates we construct a nonparametric estimator of the target density. Both rates of convergence and an algorithm to construct the estimator are provided.      

Empirical likelihood-based dimension reduction inference for linear error-in-responses models with validation study

In this paper, linear errors-in-response models are considered in the presence of validation data on the responses. A semiparametric dimension reduction technique is employed to define an estimator of β with asymptotic normality, the estimated empirical loglikelihoods and the adjusted empirical loglikelihoods for the vector of regression coefficients and linear combinations of the regression coefficients, respectively. The estimated empirical log-likelihoods are shown to be asymptotically distributed as weighted sums of independent x12 and the adjusted empirical loglikelihoods are proved to be asymptotically distributed as standard chi-squares, respectively.     

Testing Serial Correlation in Semiparametric Varying-Coefficient Partially Linear EV Models

This paper studies estimation and serial correlation test of a semiparametric varying-coefficient partially linear EV model of the form Y = X^Tβ ＋Z^Tα（T） ＋ε,ξ = X ＋ η with the identifying condition E[（ε,η^T）^T] =0, Cov[（ε,η^T）^T] = σ^2Ip＋1. The estimators of interested regression parameters /3 , and the model error variance σ2, as well as the nonparametric components α（T）, are constructed. Under some regular conditions, we show that the estimators of the unknown vector β and the unknown parameter σ2 are strongly consistent and asymptotically normal and that the estimator of α（T） achieves the optimal strong convergence rate of the usual nonparametric regression. Based on these estimators and asymptotic properties, we propose the VN,p test statistic and empirical log-likelihood ratio statistic for testing serial correlation in the model. The proposed statistics are shown to have asymptotic normal or chi-square distributions under the null hypothesis of no serial correlation. Some simulation studies are conducted to illustrate the finite sample performance of the proposed tests.     

Bootstrap choice of tuning parameters

Consider the problem of estimating θ=θ(P) based on datax _n from an unknown distributionP. Given a family of estimatorsT _{n, β} of θ(P), the goal is to choose β among β∈I so that the resulting estimator is as good as possible. Typically, β can be regarded as a tuning or smoothing parameter, and proper choice of β is essential for good performance ofT _{n, β} . In this paper, we discuss the theory of β being chosen by the bootstrap. Specifically, the bootstrap estimate of β, , is chosen to minimize an empirical bootstrap estimate of risk. A general theory is presented to establish the consistency and weak convergence properties of these estimators. Confidence intervals for θ(P) based on , are also asymptotically valid. Several applications of the theory are presented, including optimal choice of trimming proportion, bandwidth selection in density estimation and optimal combinations of estimates.     

Asymptotic properties for the semiparametric regression model with randomly censored data

Suppose that the patients’ survival times.Y, are random variables following the semiparametric regression modelY = Xβ +g(T) + ε, where (X,T) is a radom vector taking values inR×[0,1],βis an unknown parameter,g (*) is an unknown smooth regression function andE is the random error with zero mean and variance σ². It is assumed that (X,T) is independent of E. The estimators andg _n (*) of P andg(*) are defined, respectively, when the observations are randomly censored on the right and the censoring distribution is unknown. Moreover, it is shown that is asymptotically normal andg _n (*) is weak consistence with rateO _p(n-1/3). Project supported by China Postdoctoral Science Foundation and the National Natural Science Foundation of China.     

The efficiency of the second-order nonlinear least squares estimator and its extension

We revisit the second-order nonlinear least square estimator proposed in Wang and Leblanc (Anne Inst Stat Math 60:883–900, 2008) and show that the estimator reaches the asymptotic optimality concerning the estimation variability. Using a fully semiparametric approach, we further modify and extend the method to the heteroscedastic error models and propose a semiparametric efficient estimator in this more general setting. Numerical results are provided to support the results and illustrate the finite sample performance of the proposed estimator.     

k-NN METHOD IN PARTIAL LINEAR MODEL UNDER RANDOM CENSORSHIP

ｋ－ＮＮＭＥＴＨＯＤＩＮＰＡＲＴＩＡＬＬＩＮＥＡＲＭＯＤＥＬＵＮＤＥＲＲＡＮＤＯＭＣＥＮＳＯＲＳＨＩＰＱＩＮＧＥＮＧＳＨＥＮＧ（ＤｅｐａｒｔｍｅｎｔｏｆＭａｔｈｅｍａｔｉｃｓ，ＳｉｃｈｕａｎＵｎｉｖｅｒｓｉｔｙ，Ｃｈｅｎｇｄｕ６１００６４）．Ａｂｓｔ...