Combining conditional and unconditional moment restrictions with missing responses

Many statistical models, e.g. regression models, can be viewed as conditional moment restrictions when distributional assumptions on the error term are not assumed. For such models, several estimators that achieve the semiparametric efficiency bound have been proposed. However, in many studies, auxiliary information is available as unconditional moment restrictions. Meanwhile, we also consider the presence of missing responses. We propose the combined empirical likelihood (CEL) estimator to incorporate such auxiliary information to improve the estimation efficiency of the conditional moment restriction models. We show that, when assuming responses are strongly ignorable missing at random, the CEL estimator achieves better efficiency than the previous estimators due to utilization of the auxiliary information. Based on the asymptotic property of the CEL estimator, we also develop Wilks’ type tests and corresponding confidence regions for the model parameter and the mean response. Since kernel smoothing is used, the CEL method may have difficulty for problems with high dimensional covariates. In such situations, we propose an instrumental variable-based empirical likelihood (IVEL) method to handle this problem. The merit of the CEL and IVEL are further illustrated through simulation studies.     

The Estimation of Accelerated Failure Time Model with Right-Censored Data

The accelerated failure time model provides a natural formulation of the effects of covariates on the failure time variable. The presence of censoring poses major challenges in the semi-parametric analysis. The existing semi-parametric estimators are computationally intractable. In this article we propose an unbiased transformation for the potential censored response variable, thus least square estimators of regression parameters can be gotten easily. The resulting estimators are consistent and asymptotically normal. Based on these, we can get a strongly consistent K-M estimator for the distribution of random error. Extensive simulation studies show that the asymptotic approximations are accurate in practical situations.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

Simple and efficient improvements of multivariate local linear regression

This paper studies improvements of multivariate local linear regression. Two intuitively appealing variance reduction techniques are proposed. They both yield estimators that retain the same asymptotic conditional bias as the multivariate local linear estimator and have smaller asymptotic conditional variances. The estimators are further examined in aspects of bandwidth selection, asymptotic relative efficiency and implementation. Their asymptotic relative efficiencies with respect to the multivariate local linear estimator are very attractive and increase exponentially as the number of covariates increases. Data-driven bandwidth selection procedures for the new estimators are straightforward given those for local linear regression. Since the proposed estimators each has a simple form, implementation is easy and requires much less or about the same amount of effort. In addition, boundary corrections are automatic as in the usual multivariate local linear regression.     

Conditional likelihood estimation and efficiency comparisons in proportional odds model with missing covariates

In this article, a conditional likelihood approach is developed for dealing with ordinal data with missing covariates in proportional odds model. Based on the validation data set, we propose the Breslow and Cain (Biometrika 75:11–20, 1988) type estimators using different estimates of the selection probabilities, which may be treated as nuisance parameters. Under the assumption that the observed covariates and surrogate variables are categorical, we present large sample theory for the proposed estimators and show that they are more efficient than the estimator using the true selection probabilities. Simulation results support the theoretical analysis. We also illustrate the approaches using data from a survey of cable TV satisfaction.     

Robust Hierarchical Bayes Estimation of Small Area Characteristics in the Presence of Covariates and Outliers

A robust hierarchical Bayes method is developed to smooth small area means when a number of covariates are available. The method is particularly suited when one or more outliers are present in the data. It is well known that the regular Bayes estimators of small. area means, under normal prior distribution, perform poorly in presence of even one extreme observation. In this case the Bayes estimators collapse to the direct survey estimators. This paper introduces a general theory for robust hierarchical Bayes estimation procedure using a fairly rich class of scale mixtures of normal prior distributions. To retain maximum benefit from combining information from related sources, we suggest to use Cauchy prior distribution for the outlying areas and an appropriate scale mixture of normal prior whose tail is lighter than the Cauchy prior for the rest of the areas. It is shown that, unlike the hierarchical Bayes estimator under a normal prior, our estimator has more protection against outlying observations.     

方差分量的改进估计

本文研究一类方差分量模型中方差分量的改进估计问题,对单向分类随机模型的对应于随机效应的方差分量,我们研究了一个不变估计类,它包含了一些常用重要估计。证明了在均方误差准则下,在该估计类中不存在一致最优不变估计,且方差分析估计是不容许估计。在一个重要子估计类中,找到了一致最优估计。对于较一般的含两个方差分量的混合模型,我们研究了一个非负估计类的性质,给出了它们的分布,并建立了它们优于方差分析估计的充分     

Semiparametric estimation in regression with missing covariates using single-index models

We investigate semiparametric estimation of regression coefficients through generalized estimating equations with single-index models when some covariates are missing at random. Existing popular semiparametric estimators may run into difficulties when some selection probabilities are small or the dimension of the covariates is not low. We propose a new simple parameter estimator using a kernel-assisted estimator for the augmentation by a single-index model without using the inverse of selection probabilities. We show that under certain conditions the proposed estimator is as efficient as the existing methods based on standard kernel smoothing, which are often practically infeasible in the case of multiple covariates. A simulation study and a real data example are presented to illustrate the proposed method. The numerical results show that the proposed estimator avoids some numerical issues caused by estimated small selection probabilities that are needed in other estimators.

     

Gaining efficiency via weighted estimators for multivariate failure time data

Multivariate failure time data arise frequently in survival analysis. A commonly used technique is the working independence estimator for marginal hazard models. Two natural questions are how to improve the efficiency of the working independence estimator and how to identify the situations under which such an estimator has high statistical efficiency. In this paper, three weighted estimators are proposed based on three different optimal criteria in terms of the asymptotic covariance of weighted estimators. Simplified close-form solutions are found, which always outperform the working independence estimator. We also prove that the working independence estimator has high statistical efficiency, when asymptotic covariance of derivatives of partial log-likelihood functions is nearly exchangeable or diagonal. Simulations are conducted to compare the performance of the weighted estimator and working independence estimator. A data set from Busselton population health surveys is analyzed using the proposed estimators. This work was supported by National Natural Science Foundation of China (Grant No. 10628104), Fan was also supported by National Institutes of Health (Grant No. R01-GM072611) and Natural Science Foundation (Grant No. DMS-0714554), Zhou was supported by National Natural Science Funds for Distinguisheel Young Scholar (Grant No. 70825004), National Natural Science Foundation of China (Grant Nos. 10731010, 10628104), the National Basic Research Program (Grant No. 2007CB814902), Creative Research Groups of China (Grant No. 10721101) and Leading Academic Disipline Program, the 10 ^th five year plan of 211 Project for Shanghai University of Finance and Economics (the 3 ^rd phase), Cai was supported by National Institutes of Health (Grant No. R01-HL57444)     

Multivariate generalized S-estimators

In this paper we introduce generalized S-estimators for the multivariate regression model. This class of estimators combines high robustness and high efficiency. They are defined by minimizing the determinant of a robust estimator of the scatter matrix of differences of residuals. In the special case of a multivariate location model, the generalized S-estimator has the important independence property, and can be used for high breakdown estimation in independent component analysis. Robustness properties of the estimators are investigated by deriving their breakdown point and the influence function. We also study the efficiency of the estimators, both asymptotically and at finite samples. To obtain inference for the regression parameters, we discuss the fast and robust bootstrap for multivariate generalized S-estimators. The method is illustrated on a real data example.     

IMPROVED ESTIMATES OF THE COVARIANCE MATRIX IN GENERAL LINEAR MIXED MODELS

In this article, the problem of estimating the covariance matrix in general linear mixed models is considered. Two new classes of estimators obtained by shrinking the eigenvalues towards the origin and the arithmetic mean, respectively, are proposed. It is shown that these new estimators dominate the unbiased estimator under the squared error loss function. Finally, some simulation results to compare the performance of the proposed estimators with that of the unbiased estimator are reported. The simulation results indicate that these new shrinkage estimators provide a substantial improvement in risk under most situations.     

On Huber's contaminated model

Huber's contaminated model is a basic model for data with outliers. This paper aims at addressing several fundamental problems about this model. We first study its identifiability properties. Several theorems are presented to determine whether the model is identifiable for various situations. Based on these results, we discuss the problem of estimating the parameters with observations drawn from Huber's contaminated model. A definition of estimation consistency is introduced to handle the general case where the model may be unidentifiable. This consistency is a strong robustness property. After showing that existing estimators cannot be consistent in this sense, we propose a new estimator that possesses the consistency property under mild conditions. Its adaptive version, which can simultaneously possess this consistency property and optimal asymptotic efficiency, is also provided. Numerical examples show that our estimators have better overall performance than existing estimators no matter how many outliers in the data.     

Comparison of three semiparametric methods for estimating dependence parameters in copula models

Three semiparametric methods for estimating dependence parameters in copula models are compared, namely maximum pseudo-likelihood estimation and the two method-of-moment approaches based on the inversion of Spearman’s rho and Kendall’s tau. For each of these three asymptotically normal estimators, an estimator of their asymptotic (co)variance is stated in three different situations, namely the bivariate one-parameter case, the multivariate one-parameter case and the multivariate multiparameter case. An extensive Monte Carlo study is carried out to compare the finite-sample performance of the three estimators under consideration in these three situations. In the one-parameter case, it involves up to six bivariate and four-variate copula families, and up to five levels of dependence. In the multiparameter case, attention is restricted to trivariate and four-variate normal and t copulas. The maximum pseudo-likelihood estimator appears as the best choice in terms of mean square error in all situations except for small and weakly dependent samples. It is followed by the method-of-moment estimator based on Kendall’s tau, which overall appears to be significantly better than its analogue based on Spearman’s rho. The simulation results are complemented by asymptotic relative efficiency calculations. The numerical computation of Spearman’s rho, Kendall’s tau and their derivatives in the case of copula families for which explicit expressions are not available is also investigated.     

Estimating hazard ratios in nested case-control studies by mantel-haenszel method

1. IntroductionConsider a follow-up study which is carried out to investigate the association betweenexposure variables and mortality rate in a cohort. In the case where the cohort is of 1argesise, the complete follow-up ndght be too expensive or difficult, and various nested samplingmethod8 have been suggested by Thomas[l], Prenti..[2] 5 Goldstein and Langholzl'] and otherauthors. Most of the authors employ Coxl4] regression mode1 for estimating the hazard ratio8of exposures.Now a well-reco…     

Local Polynomial Regression: Optimal Kernels and Asymptotic Minimax Efficiency

We consider local polynomial fitting for estimating a regression function and its derivatives nonparametrically. This method possesses many nice features, among which automatic adaptation to the boundary and adaptation to various designs. A first contribution of this paper is the derivation of an optimal kernel for local polynomial regression, revealing that there is a universal optimal weighting scheme. Fan (1993, Ann. Statist., 21, 196-216) showed that the univariate local linear regression estimator is the best linear smoother, meaning that it attains the asymptotic linear minimax risk. Moreover, this smoother has high minimax risk. We show that this property also holds for the multivariate local linear regression estimator. In the univariate case we investigate minimax efficiency of local polynomial regression estimators, and find that the asymptotic minimax efficiency for commonly-used orders of fit is 100% among the class of all linear smoothers. Further, we quantify the loss in efficiency when going beyond this class.     

Necessary conditions for dominating the James-Stein estimator

This paper develops necessary conditions for an estimator to dominate the James-Stein estimator and hence the James-Stein positive-part estimator. The ultimate goal is to find classes of such dominating estimators which are admissible. While there are a number of results giving classes of estimators dominating the James-Stein estimator, the only admissible estimator known to dominate the James-Stein estimator is the generalized Bayes estimator relative to the fundamental harmonic function in three and higher dimension. The prior was suggested by Stein and the domination result is due to Kubokawa. Shao and Strawderman gave a class of estimators dominating the James-Stein positive-part estimator but were unable to demonstrate admissiblity of any in their class. Maruyama, following a suggestion of Stein, has studied generalized Bayes estimators which are members of a point mass at zero and a prior similar to the harmonic prior. He finds a subclass which is minimax and admissible but is unable to show that any in his class with positive point mass at zero dominate the James-Stein estimator. The results in this paper show that a subclass of Maruyama's procedures including the class that Stein conjectured might contain members dominating the James-Stein estimator cannot dominate the James-Stein estimator. We also show that under reasonable conditions, the “constant” in shrinkage factor must approachp-2 for domination to hold.     

Improved estimation of a covariance matrix in an elliptically contoured matrix distribution

In this paper, the problem of estimating the covariance matrix of the elliptically contoured distribution (ECD) is considered. A new class of estimators which shrink the eigenvalues towards their arithmetic mean is proposed. It is shown that this new estimator dominates the unbiased estimator under the squared error loss function. Two special classes of ECD, namely, the multivariate-elliptical t distribution and the ε-contaminated normal distribution are considered. A simulation study is carried out and indicates that this new shrinkage estimator provides a substantial improvement in risk under most situations.     

纵向数据非参数混合效应模型的一个局部不变估计

非参数核回归方法近年来已被用于纵向数据的分析(Lin和Carroll,2000)．一个颇具争议性的问题是在非参数核回归中是否需要考虑纵向数据间的相关性．Lin和Carroll (2000)证明了基于独立性(即忽略相关性)的核估计在一类核GEE估计量中是(渐近)最有效的．基于混合效应模型方法作者提出了一个不同的核估计类,它自然而有效地结合了纵向数据的相关结构．估计量达到了与Lin和Carroll的估计量相同的渐近有效性,且在有限样本情形下表现更好．由此方法可以很容易地获得对于总体和个体的非参数曲线估计．所提出的估计量具有较好的统计性质,且实施方便,从而对实际工作者具有较大的吸引力．     

Estimation and confidence bands of a conditional survival function with censoring indicators missing at random

The nonparametric estimator of the conditional survival function proposed by Beran is a useful tool to evaluate the effects of covariates in the presence of random right censoring. However, censoring indicators of right censored data may be missing for different reasons in many applications. We propose some estimators of the conditional cumulative hazard and survival functions which allow to handle this situation. We also construct the likelihood ratio confidence bands for them and obtain their asymptotic properties. Simulation studies are used to evaluate the performances of the estimators and their confidence bands.     

Hazard Rate Regression Using Ordinary Nonparametric Regression Smoothers

Abstract

This article proposes a method for nonparametric estimation of hazard rates as a function of time and possibly multiple covariates. The method is based on dividing the time axis into intervals, and calculating number of event and follow-up time contributions from the different intervals. The number of event and follow-up time data are then separately smoothed on time and the covariates, and the hazard rate estimators obtained by taking the ratio. Pointwise consistency and asymptotic normality are shown for the hazard rate estimators for a certain class of smoothers, which includes some standard approaches to locally weighted regression and kernel regression. It is shown through simulation that a variance estimator based on this asymptotic distribution is reasonably reliable in practice. The problem of how to select the smoothing parameter is considered, but a satisfactory resolution to this problem has not been identified. The method is illustrated using data from several breast cancer clinical trials.