Estimators of scale parameters in linear regression

This note discusses the asymptotic distribution of two scale and location invariant estimators of two scale parameters in the multiple linear regression model. Both of these estimators need an initial estimator of the regression parameter vector. The asymptotic distribution of one of these estimators does not depend on this initial estimator. Both of these estimators are useful in the computation of scale and translation invariant adaptive estimators and M-estimators of the regression parameter vector.     

关于回归函数核估计的叠对数律

讨论了非参数回归函数的核估计，用核估计误差分解方法，较弱条件下，到了回归函数核估计的叠对数值。     

Minimax estimator of regression coefficient in normal distribution under balanced loss function

This article investigates linear minimax estimators of regression coefficient in a linear model with an assumption that the underlying distribution is a normal one with a nonnegative definite covariance matrix under a balanced loss function. Some linear minimax estimators of regression coefficient in the class of all estimators are obtained. The result shows that the linear minimax estimators are unique under some conditions.     

Double Shrinkage Estimation of Common Coefficients in Two Regression Equations with Heteroscedasticity

The problem of estimating the common regression coefficients is addressed in this paper for two regression equations with possibly different error variances. The feasible generalized least squares (FGLS) estimators have been believed to be admissible within the class of unbiased estimators. It is, nevertheless, established that the FGLS estimators are inadmissible in light of minimizing the covariance matrices if the dimension of the common regression coefficients is greater than or equal to three. Double shrinkage unbiased estimators are proposed as possible candidates of improved procedures.     

截断与删失数据下的一个回归方法

对于截断与删失下的反映变量,我们提出了一类广义乘积限估计,并获得了它的弱收敛性.在回归分析中,利用这类广义乘积限估计来定义一种最小距离的参数估计,并获得了这种参数估计的相合性和渐近正态性.     

非零截距线性和非线性回归模型的T-型稳健估计算法

首先给出非零截距线性模型T-型估计的模型与EM算法,其次给出非线性回归模型参数的T-型估计,利用泰勒级数对模型线性化,得到参数估计的迭代算法,最后用数值模拟实验验证了该算法的正确性和证实了T-型估计的稳健性.     

Estimation in partially linear models with missing responses at random

A partially linear model is considered when the responses are missing at random. Imputation, semiparametric regression surrogate and inverse marginal probability weighted approaches are developed to estimate the regression coefficients and the nonparametric function, respectively. All the proposed estimators for the regression coefficients are shown to be asymptotically normal, and the estimators for the nonparametric function are proved to converge at an optimal rate. A simulation study is conducted to compare the finite sample behavior of the proposed estimators.     

纵向数据边际模型非参数光滑方法的比较

对于纵向数据边际模型的均值函数, 有很多非参数估计方法, 其中回归样条, 光滑样条, 似乎不相关(SUR)核估计等方法在工作协方差阵正确指定时具有最小的渐近方差. 回归样条的渐近偏差与工作协方差阵无关, 而SUR核估计和光滑样条估计的渐近偏差却依赖于工作协方差阵. 本文主要研究了回归样条, 光滑样条和SUR核估计的效率问题. 通过模拟比较发现回归样条估计的表现比较稳定, 在大多数情况下比光滑样条估计和SUR核估计的效率高.     

Non-parametric kernel regression for multinomial data

This paper presents a kernel smoothing method for multinomial regression. A class of estimators of the regression functions is constructed by minimizing a localized power-divergence measure. These estimators include the bandwidth and a single parameter originating in the power-divergence measure as smoothing parameters. An asymptotic theory for the estimators is developed and the bias-adjusted estimators are obtained. A data-based algorithm for selecting the smoothing parameters is also proposed. Simulation results reveal that the proposed algorithm works efficiently.     

Minimum Disparity Estimation in Linear Regression Models: Distribution and Efficiency

This paper deals with the minimum disparity estimation in linear regression models. The estimators are defined as statistical quantities which minimize the blended weight Hellinger distance between a weighted kernel density estimator of errors and a smoothed model density of errors. It is shown that the estimators of the regression parameters are asymptotic normally distributed and efficient at the model if the weights of the density estimators are appropriately chosen.     

Regression estimation with transformed auxiliary variates

The regression estimation of the mean of a primary survey variable and the estimation of the regression equation are considered in the finite population with transformed auxiliary variables. Large sample properties of estimators are developed. The effects of estimating auxiliary variates on estimators are investigated.     

Strong consistency of nearest neighbor regression function estimators

For a well-known class of nonparametric regression function estimators of nearest neighbor type the uniform measure of deviation from the estimators to the true regression function is studied. Under weak regularity conditions it is shown that the estimators are uniformly consistent with probability one and the corresponding rate of convergence is near-optimal.     

Asymptotically optimal estimation in the linear regression problem in the case of violation of some classical assumptions

We consider the problem of estimating the unknown parameters of linear regression in the case when the variances of observations depend on the unknown parameters of the model. A two-step method is suggested for constructing asymptotically linear estimators. Some general sufficient conditions for the asymptotic normality of the estimators are found, and an explicit form is established of the best asymptotically linear estimators. The behavior of the estimators is studied in detail in the case when the parameter of the regression model is one-dimensional.     

Simple and efficient improvements of multivariate local linear regression

This paper studies improvements of multivariate local linear regression. Two intuitively appealing variance reduction techniques are proposed. They both yield estimators that retain the same asymptotic conditional bias as the multivariate local linear estimator and have smaller asymptotic conditional variances. The estimators are further examined in aspects of bandwidth selection, asymptotic relative efficiency and implementation. Their asymptotic relative efficiencies with respect to the multivariate local linear estimator are very attractive and increase exponentially as the number of covariates increases. Data-driven bandwidth selection procedures for the new estimators are straightforward given those for local linear regression. Since the proposed estimators each has a simple form, implementation is easy and requires much less or about the same amount of effort. In addition, boundary corrections are automatic as in the usual multivariate local linear regression.     

Efficient Quantile Estimation for Functional-Coefficient Partially Linear Regression Models

The quantile estimation methods are proposed for functional-coefficient partially linear regression (FCPLR) model by combining nonparametric and functional-coefficient regression (FCR) model. The local linear scheme and the integrated method are used to obtain local quantile estimators of all unknown functions in the FCPLR model. These resulting estimators are asymptotically normal, but each of them has big variance. To reduce variances of these quantile estimators, the one-step backfitting technique is used to obtain the efficient quantile estimators of all unknown functions, and their asymptotic normalities are derived. Two simulated examples are carried out to illustrate the proposed estimation methodology.     

Multivariate Locally Weighted Polynomial Fitting and Partial Derivative Estimation

Nonparametric regression estimator based on locally weighted least squares fitting has been studied by Fan and Ruppert and Wand. The latter paper also studies, in the univariate case, nonparametric derivative estimators given by a locally weighted polynomial fitting. Compared with traditional kernel estimators, these estimators are often of simpler form and possess some better properties. In this paper, we develop current work on locally weighted regression and generalize locally weighted polynomial fitting to the estimation of partial derivatives in a multivariate regression context. Specifically, for both the regression and partial derivative estimators we prove joint asymptotic normality and derive explicit asymptotic expansions for their conditional bias and conditional convariance matrix (given observations of predictor variables) in each of the two important cases of local linear fit and local quadratic fit.     

Multiple imputation and other resampling schemes for imputing missing observations

The problem of imputing missing observations under the linear regression model is considered. It is assumed that observations are missing at random and all the observations on the auxiliary or independent variables are available. Estimates of the regression parameters based on singly and multiply imputed values are given. Jackknife as well as bootstrap estimates of the variance of the singly imputed estimator of the regression parameters are given. These estimators are shown to be consistent estimators. The asymptotic distributions of the imputed estimators are also given to obtain interval estimates of the parameters of interest. These interval estimates are then compared with the interval estimates obtained from multiple imputation. It is shown that singly imputed estimators perform at least as good as multiply imputed estimators. A new nonparametric multiply imputed estimator is proposed and shown to perform as good as a multiply imputed estimator under normality. The singly imputed estimator, however, still remains at least as good as a multiply imputed estimator.     

Probability density estimation with surrogate data and validation sample

The probability density estimation problem with surrogate data and validation sample is considered. A regression calibration kernel density estimator is defined to incorporate the information contained in both surrogate variates and validation sample. Also, we define two weighted estimators which have less asymptotic variances but have bigger biases than the regression calibration kernel density estimator. All the proposed estimators are proved to be asymptotically normal. And the asymptotic representations for the mean squared error and mean integrated square error of the proposed estimators are established, respectively. A simulation study is conducted to compare the finite sample behaviors of the proposed estimators.     

Thresholding projection estimators in functional linear models

We consider the problem of estimating the regression function in functional linear regression models by proposing a new type of projection estimators which combine dimension reduction and thresholding. The introduction of a threshold rule allows us to get consistency under broad assumptions as well as minimax rates of convergence under additional regularity hypotheses. We also consider the particular case of Sobolev spaces generated by the trigonometric basis which permits us to get easily mean squared error of prediction as well as estimators of the derivatives of the regression function. We prove that these estimators are minimax and rates of convergence are given for some particular cases.     

Mean Integrated Squared Error of Nonlinear Wavelet-based Estimators with Long Memory Data

We consider the nonparametric regression model with long memory data that are not necessarily Gaussian and provide an asymptotic expansion for the mean integrated squared error (MISE) of nonlinear wavelet-based mean regression function estimators. We show this MISE expansion, when the underlying mean regression function is only piecewise smooth, is the same as analogous expansion for the kernel estimators. However, for the kernel estimators, this MISE expansion generally fails if an additional smoothness assumption is absent. Research supported in part by the NSF grant DMS-0103939.