Improved estimation of regression parameters in measurement error models

The problem of simultaneous estimation of the regression parameters in a multiple regression model with measurement errors is considered when it is suspected that the regression parameter vector may be the null-vector with some degree of uncertainty. In this regard, we propose two sets of four estimators, namely, (i) the unrestricted estimator, (ii) the preliminary test estimator, (iii) the Stein-type estimator and (iv) the postive-rule Stein-type estimator. In an asymptotic setup, properties of these estimators are studied based on asymptotic distributional bias, MSE matrices, and risks under a quadratic loss function. In addition to the asymptotic dominance of the Stein-type estimators, the paper contains discussion of dominating confidence sets based on the Stein-type estimation. Asymptotic analysis is considered based on a sequence of local alternatives to obtain the desired results.     

Positive shrinkage, improved pretest and absolute penalty estimators in partially linear models

Shrinkage estimators of a partially linear regression parameter vector are constructed by shrinking estimators in the direction of the estimate which is appropriate when the regression parameters are restricted to a linear subspace. We investigate the asymptotic properties of positive Stein-type and improved pretest semiparametric estimators under quadratic loss. Under an asymptotic distributional quadratic risk criterion, their relative dominance picture is explored analytically. It is shown that positive Stein-type semiparametric estimators perform better than the usual Stein-type and least square semiparametric estimators and that an improved pretest semiparametric estimator is superior to the usual pretest semiparametric estimator. We also consider an absolute penalty type estimator for partially linear models and give a Monte Carlo simulation comparisons of positive shrinkage, improved pretest and the absolute penalty type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty type estimation method when the dimension of the parameter space is much larger than that of the linear subspace.     

Asymptotic distribution of Wishart matrix for block-wise dispersion of population eigenvalues

This paper deals with the asymptotic distribution of Wishart matrix and its application to the estimation of the population matrix parameter when the population eigenvalues are block-wise infinitely dispersed. We show that the appropriately normalized eigenvectors and eigenvalues asymptotically generate two Wishart matrices and one normally distributed random matrix, which are mutually independent. For a family of orthogonally equivariant estimators, we calculate the asymptotic risks with respect to the entropy or the quadratic loss function and derive the asymptotically best estimator among the family. We numerically show (1) the convergence in both the distributions and the risks are quick enough for a practical use, (2) the asymptotically best estimator is robust against the deviation of the population eigenvalues from the block-wise infinite dispersion.     

Estimators of scale parameters in linear regression

This note discusses the asymptotic distribution of two scale and location invariant estimators of two scale parameters in the multiple linear regression model. Both of these estimators need an initial estimator of the regression parameter vector. The asymptotic distribution of one of these estimators does not depend on this initial estimator. Both of these estimators are useful in the computation of scale and translation invariant adaptive estimators and M-estimators of the regression parameter vector.     

Multivariate Locally Weighted Polynomial Fitting and Partial Derivative Estimation

Nonparametric regression estimator based on locally weighted least squares fitting has been studied by Fan and Ruppert and Wand. The latter paper also studies, in the univariate case, nonparametric derivative estimators given by a locally weighted polynomial fitting. Compared with traditional kernel estimators, these estimators are often of simpler form and possess some better properties. In this paper, we develop current work on locally weighted regression and generalize locally weighted polynomial fitting to the estimation of partial derivatives in a multivariate regression context. Specifically, for both the regression and partial derivative estimators we prove joint asymptotic normality and derive explicit asymptotic expansions for their conditional bias and conditional convariance matrix (given observations of predictor variables) in each of the two important cases of local linear fit and local quadratic fit.     

Multiple imputation and other resampling schemes for imputing missing observations

The problem of imputing missing observations under the linear regression model is considered. It is assumed that observations are missing at random and all the observations on the auxiliary or independent variables are available. Estimates of the regression parameters based on singly and multiply imputed values are given. Jackknife as well as bootstrap estimates of the variance of the singly imputed estimator of the regression parameters are given. These estimators are shown to be consistent estimators. The asymptotic distributions of the imputed estimators are also given to obtain interval estimates of the parameters of interest. These interval estimates are then compared with the interval estimates obtained from multiple imputation. It is shown that singly imputed estimators perform at least as good as multiply imputed estimators. A new nonparametric multiply imputed estimator is proposed and shown to perform as good as a multiply imputed estimator under normality. The singly imputed estimator, however, still remains at least as good as a multiply imputed estimator.     

Testing for small bias of tail index estimators

We determine the joint asymptotic normality of kernel and weighted least-squares estimators of the upper tail index of a regularly varying distribution when each estimator is a bivariate function of two parameters: the tuning parameter is motivated by possible underlying second-order behavior in regular variation, while no such behavior is assumed, and the fraction parameter determines that upper portion of the sample on which the estimator is based. Under the hypothesis that the scaled asymptotic biases of the estimators vanish uniformly in the parameter points considered, these results imply joint asymptotic normality for deviations of ratios of the estimators from 1, which in turn yield asymptotic chi-square tests for checking the small-bias hypothesis, equivalent to the constructibility of asymptotic confidence intervals. The test procedure suggests adaptive choices of the tuning and fraction parameters: data-driven (t)estimators.     

Stein–type shrinkage quantile estimation

The simultaneous asymptotic estimation theory of quantiles is considered for an arbitrary population. The Stein–type estimator and its positive version are considered. The relative merits of the proposed estimators are compared with those of the usual estimator using asymptotic quadratic distributional risk those of the usual estimator using asymptotic quadratic distributional risk under local alternatives. It is shown that both proposed estimators are asymptotically superior to the classical estimator. Further, it is demonstrated that the Stein-type estimator is dominated by its positive part     

Asymptotics of Bayesian median loss estimation

We establish the consistency, asymptotic normality, and efficiency for estimators derived by minimizing the median of a loss function in a Bayesian context. We contrast this procedure with the behavior of two Frequentist procedures, the least median of squares (LMS) and the least trimmed squares (LTS) estimators, in regression problems. The LMS estimator is the Frequentist version of our estimator, and the LTS estimator approaches a median-based estimator as the trimming approaches 50% on each side. We argue that the Bayesian median-based method is a good tradeoff between the two Frequentist estimators.     

A subclass of bayes linear estimators that are minimax

In the linear regression model with ellipsoidal parameter constraints, the problem of estimating the unknown parameter vector is studied. A well-described subclass of Bayes linear estimators is proposed in the paper. It is shown that for each member of this subclass, a generalized quadratic risk function exists so that the estimator is minimax. Moreover, some of the proposed Bayes linear estimators are admissible with respect to all possible generalized quadratic risks. Also, a necessary and sufficient condition is given to ensure that the considered Bayes linear estimator improves the least squares estimator over the whole ellipsoid whatever generalized risk function is chosen.     

Estimation of Multinomial Probabilities under a Model Constraint

In this paper estimation of the probabilities of a multinomial distribution has been studied. The five estimators considered are: unrestricted estimator (UE), restricted estimator (RE) (under model ), preliminary test estimator (PTE) based on a test of the model , shrinkage estimator (SE) and the positive-rule shrinkage estimator (PRSE). Asymptotic distributions of these estimators are given under Pitman alternatives and the asymptotic risk under a quadratic loss has been evaluated. The relative performance of the five estimators is then studied with respect to their asymptotic distributional risks (ADR). It is seen that neither of the preliminary test and shrinkage estimators dominates the other, though each fares well relative to the other estimators. However, the positive rule estimator is recommended for use for dimension 3 or more while the PTE is recommended for dimension less than 3.     

Probability density estimation with surrogate data and validation sample

The probability density estimation problem with surrogate data and validation sample is considered. A regression calibration kernel density estimator is defined to incorporate the information contained in both surrogate variates and validation sample. Also, we define two weighted estimators which have less asymptotic variances but have bigger biases than the regression calibration kernel density estimator. All the proposed estimators are proved to be asymptotically normal. And the asymptotic representations for the mean squared error and mean integrated square error of the proposed estimators are established, respectively. A simulation study is conducted to compare the finite sample behaviors of the proposed estimators.     

纵向数据边际模型非参数光滑方法的比较

对于纵向数据边际模型的均值函数, 有很多非参数估计方法, 其中回归样条, 光滑样条, 似乎不相关(SUR)核估计等方法在工作协方差阵正确指定时具有最小的渐近方差. 回归样条的渐近偏差与工作协方差阵无关, 而SUR核估计和光滑样条估计的渐近偏差却依赖于工作协方差阵. 本文主要研究了回归样条, 光滑样条和SUR核估计的效率问题. 通过模拟比较发现回归样条估计的表现比较稳定, 在大多数情况下比光滑样条估计和SUR核估计的效率高.     

Estimating cumulative incidence functions when the life distributions are constrained

In competing risks studies, the Kaplan-Meier estimators of the distribution functions (DFs) of lifetimes and the corresponding estimators of cumulative incidence functions (CIFs) are used widely when no prior information is available for these distributions. In some cases better estimators of the DFs of lifetimes are available when they obey some inequality constraints, e.g., if two lifetimes are stochastically or uniformly stochastically ordered, or some functional of a DF obeys an inequality in an empirical likelihood estimation procedure. If the restricted estimator of a lifetime differs from the unrestricted one, then the usual estimators of the CIFs will not add up to the lifetime estimator. In this paper we show how to estimate the CIFs in this case. These estimators are shown to be strongly uniformly consistent. In all cases we consider, when the inequality constraints are strict the asymptotic properties of the restricted and the unrestricted estimators are the same, thus providing the asymptotic properties of the restricted estimators essentially “free of charge”. We give an example to illustrate our procedure.     

Robust Depth-Weighted Wavelet for Nonparametric Regression Models

In the nonparametric regression models, the original regression estimators including kernel estimator, Fourier series estimator and wavelet estimator are always constructed by the weighted sum of data, and the weights depend only on the distance between the design points and estimation points. As a result these estimators are not robust to the perturbations in data. In order to avoid this problem, a new nonparametric regression model, called the depth-weighted regression model, is introduced and then the depth-weighted wavelet estimation is defined. The new estimation is robust to the perturbations in data, which attains very high breakdown value close to 1/2. On the other hand, some asymptotic behaviours such as asymptotic normality are obtained. Some simulations illustrate that the proposed wavelet estimator is more robust than the original wavelet estimator and, as a price to pay for the robustness, the new method is slightly less efficient than the original method.     

The Minimax Estimator of Stochastic Regression Coefficients and Parameters in the Class of All Estimators

In this paper, the authors address the problem of the minimax estimator of linear combinations of stochastic regression coefficients and parameters in the general normal linear model with random effects. Under a quadratic loss function, the minimax property of linear estimators is investigated. In the class of all estimators, the minimax estimator of estimable functions, which is unique with probability 1, is obtained under a multivariate normal distribution.     

Minimum Disparity Estimation in Linear Regression Models: Distribution and Efficiency

This paper deals with the minimum disparity estimation in linear regression models. The estimators are defined as statistical quantities which minimize the blended weight Hellinger distance between a weighted kernel density estimator of errors and a smoothed model density of errors. It is shown that the estimators of the regression parameters are asymptotic normally distributed and efficient at the model if the weights of the density estimators are appropriately chosen.     

Nonparametric regression with current status data

We apply nonparametric regression to current status data, which often arises in survival analysis and reliability analysis. While no parametric assumption on the distributions has been imposed, most authors have employed parametric models like linear models to measure the covariate effects on failure times in regression analysis with current status data. We construct a nonparametric estimator of the regression function by modifying the maximum rank correlation (MRC) estimator. Our estimator can deal with the cases where the other estimators do not work. We present the asymptotic bias and the asymptotic distribution of the estimator by adapting a result on equicontinuity of degenerate U-processes to the setup of this paper.     

M-estimation in nonparametric regression under strong dependence and infinite variance

A robust local linear regression smoothing estimator for a nonparametric regression model with heavy-tailed dependent errors is considered in this paper. Under certain regularity conditions, the weak consistency and asymptotic distribution of the proposed estimators are obtained. If the errors are short-range dependent, then the limiting distribution of the estimator is normal. If the data are long-range dependent, then the limiting distribution of the estimator is a stable distribution.     

Optimal variance estimation based on lagged second-order difference in nonparametric regression

Differenced estimators of variance bypass the estimation of regression function and thus are simple to calculate. However, there exist two problems: most differenced estimators do not achieve the asymptotic optimal rate for the mean square error; for finite samples the estimation bias is also important and not further considered. In this paper, we estimate the variance as the intercept in a linear regression with the lagged Gasser-type variance estimator as dependent variable. For the equidistant design, our estimator is not only \(n^{1/2}\)-consistent and asymptotically normal, but also achieves the optimal bound in terms of estimation variance with less asymptotic bias. Simulation studies show that our estimator has less mean square error than some existing differenced estimators, especially in the cases of immense oscillation of regression function and small-sized sample.