长程相依情形下部分线性回归模型的估计理论

讨论固定设计点部分线性模型Yn,j=xn,jβ g（tn,j） En,jj=1,2,…;n,其中（xn,j,tn,j）∈R×[0,1]是非随机的固定设计点,β是待估计的本知参数,g（.）是定义在[0,1]则上的未知的光滑函数,{En,j}是长程相依的随机误差．本文在一定的正则性条件下得到了部分线性模型中参数β和函数g(.)的估计的弱相合性、均方相合性和收敛速度,同时得到了这些估计的渐近表示和渐近分布．本文所得到的结果与独立和弱相依情形下的结果有很大的差别．     

Regression Quantiles and Related Processes Under Long Range Dependent Errors

This paper obtains asymptotic representations of the regression quantiles and the regression rank-scores processes in linear regression setting when the errors are a function of Gaussian random variables that ale stationary and long range dependent. These representations are then used to obtain the limiting behavior of L- and linear regression rank-scores statistics based on the above processes. The paper also obtains the asymptotic uniform linearity of the linear regression rank-scores processes and statistics based on residuals under the long range dependent setup. It thus generalizes some of the results of Jure ková [In Proceedings of the Meeting on Nonparametric Statistics and Related topics (A. K. Md. E. Saleh, Ed.) pp. 217-228. Elsevier, Amsterdam/New York] and Gutenbrunner and Jure ková [Ann. Statist. 20 305-329] for the case of independent errors to one of the highly useful dependent errors setup.     

The nonparametric estimation of long memory spatio-temporal random field models

This paper considers the local linear estimation of a multivariate regression function and its derivatives for a stationary long memory(long range dependent) nonparametric spatio-temporal regression model.Under some mild regularity assumptions, the pointwise strong convergence, the uniform weak consistency with convergence rates and the joint asymptotic distribution of the estimators are established. A simulation study is carried out to illustrate the performance of the proposed estimators.     

On Koul's minimum distance estimators in the regression models with long memory moving averages

This paper discusses the asymptotic behavior of Koul's minimum distance estimators of the regression parameter vector in linear regression models with long memory moving average errors, when the design variables are known constants. It is observed that all these estimators are asymptotically equivalent to the least-squares estimator in the first order.     

Minimum Disparity Estimation in Linear Regression Models: Distribution and Efficiency

This paper deals with the minimum disparity estimation in linear regression models. The estimators are defined as statistical quantities which minimize the blended weight Hellinger distance between a weighted kernel density estimator of errors and a smoothed model density of errors. It is shown that the estimators of the regression parameters are asymptotic normally distributed and efficient at the model if the weights of the density estimators are appropriately chosen.     

On confidence bands for multivariate nonparametric regression

In a multivariate nonparametric regression problem with fixed, deterministic design asymptotic, uniform confidence bands for the regression function are constructed. The construction of the bands is based on the asymptotic distribution of the maximal deviation between a suitable nonparametric estimator and the true regression function which is derived by multivariate strong approximation methods and a limit theorem for the supremum of a stationary Gaussian field over an increasing system of sets. The results are derived for a general class of estimators which includes local polynomial estimators as a special case. The finite sample properties of the proposed asymptotic bands are investigated by means of a small simulation study.     

Asymptotic properties of wavelet estimators in partially linear errors-in-variables models with long-memory errors

While the random errors are a function of Gaussian random variables that are stationary and long dependent, we investigate a partially linear errors-in-variables (EV) model by the wavelet method. Under general conditions, we obtain asymptotic representation of the parametric estimator, and asymptotic distributions and weak convergence rates of the parametric and nonparametric estimators. At last, the validity of the wavelet method is illuminated by a simulation example and a real example.     

M-estimation in nonparametric regression under strong dependence and infinite variance

A robust local linear regression smoothing estimator for a nonparametric regression model with heavy-tailed dependent errors is considered in this paper. Under certain regularity conditions, the weak consistency and asymptotic distribution of the proposed estimators are obtained. If the errors are short-range dependent, then the limiting distribution of the estimator is normal. If the data are long-range dependent, then the limiting distribution of the estimator is a stable distribution.     

Minimum distance estimation in linear regression with unknown error distributions

This paper discusses minimum distance (m.d.) estimators of the paramter vector in the multiple linear regression model when the distributions of errors are unknown. These estimators are defined in terms of L₂-distances involving certain weighted empirical processes. Their finite sample properties and asymptotic behavior under heteroscedastic, symmetric and asymmetric errors are discussed. Some robustness properties of these estimators are also studied.     

Asymptotics and bootstrap for inverse Gaussian regression

This paper studies regression, where the reciprocal of the mean of a dependent variable is considered to be a linear function of the regressor variables, and the observations on the dependent variable are assumed to have an inverse Gaussian distribution. The large sample theory for the pseudo maximum likelihood estimators is available in the literature, only when the number of replications increase at a fixed rate. This is inadequate for many practical applications. This paper establishes consistency and derives the asymptotic distribution for the pseudo maximum likelihood estimators under very general conditions on the design points. This includes the case where the number of replications do not grow large, as well as the one where there are no replications. The bootstrap procedure for inference on the regression parameters is also investigated.Research supported in part by NSF Grant DMS-9208066.Research supported in part by NSERC of Canada.     

Asymptotics of estimators for nonparametric multivariate regression models with long memory

In this paper, a nonparametric multivariate regression model with long memory covariates and long memory errors is considered. We approximate the nonparametric multivariate regression function by the weighted additive one-dimensional functions. The local linear smoothing and least squares method are proposed for the one-dimensional regression estimation and the weight parameters estimation, respectively. The asymptotic behaviors of the proposed estimators are investigated.     

Estimating a mean matrix: boosting efficiency by multiple affine shrinkage

The unknown matrix M is the mean of the observed response matrix in a multivariate linear model with independent random errors. This paper constructs regularized estimators of M that dominate, in asymptotic risk, least squares fits to the model and to specified nested submodels. In the first construction, the response matrix is expressed as the sum of orthogonal components determined by the submodels; each component is replaced by an adaptive total least squares fit of possibly lower rank; and these fits are then summed. The second, lower risk, construction differs only in the second step: each orthogonal component is replaced by a modified Efron-Morris fit before summation. Singular value decompositions yield computable formulae for the estimators and their asymptotic and estimated risks. In the asymptotics, the row dimension of M tends to infinity while the column dimension remains fixed. Convergences are uniform when signal-to-noise ratio is bounded. This research was supported in part by National Science Foundation Grant DMS 0404547.     

Nonparametric Regression Estimation for Random Fields in a Fixed-Design

We investigate the nonparametric estimation for regression in a fixed-design setting when the errors are given by a field of dependent random variables. Sufficient conditions for kernel estimators to converge uniformly are obtained. These estimators can attain the optimal rates of uniform convergence and the results apply to a large class of random fields which contains martingale-difference random fields and mixing random fields. Articlenote: In final form 24 January 2005     

附加信息下的局部线性估计

在回归模型中，对一类因变量函数的条件期望方程的附加信息，我们提出了基于极大经验似然方法的局部线性点估计，在一定条件下证明了这些估计的相合性和渐近正态性，而且估计的方差小于通常不带附加信息核估计的方差．模拟结果也显示了估计的优良性．     

Minimax-rate adaptive nonparametric regression with unknown correlations of errors In Celebration of Professor Lincheng Zhao's 75th Birthday

Minimax-rate adaptive nonparametric regression has been intensively studied under the assumption of independent or uncorrelated errors in the literature. In many applications, however, the errors are dependent,including both short-and long-range dependent situations. In such a case, adaptation with respect to the unknown dependence is important. We present a general result in this direction under Gaussian errors. It is assumed that the covariance matrix of the errors is known to be in a list of specifications possibly including independence, short-range dependence and long-range dependence as well. The regression function is known to be in a countable(or uncountablu but well-structured) collection of function classes. Adaptive estimators are constructed to attain the minimax rate of convergence automatically for each function class under each correlation specification in the corresponding lists.     

A multivariate ultrastructural errors-in-variables model with equation error

This paper deals with asymptotic results on a multivariate ultrastructural errors-in-variables regression model with equation errors. Sufficient conditions for attaining consistent estimators for model parameters are presented. Asymptotic distributions for the line regression estimators are derived. Applications to the elliptical class of distributions with two error assumptions are presented. The model generalizes previous results aimed at univariate scenarios.     

Asymptotically optimal estimation in a linear regression problem with random errors in coefficients

We consider the problem of estimating an unknown one-dimensional parameter in the linear regression problem in the case when the independent variables (called coefficients in the article) are measured with errors, and the variances of the principal observations can depend on the main parameter. We study the behavior of two-step estimators, previously introduced by the authors, which are asymptotically optimal in the case when the independent variables are measured without errors. Under sufficiently general assumptions we find necessary and sufficient conditions for the asymptotic normality and asymptotic optimality of these estimators in the new setup.     

Improvement of estimators in a linear regression problem with random errors in coefficients

Under consideration is the problem of estimating the linear regression parameter in the case when the variances of observations depend on the unknown parameter of the model, while the coefficients (independent variables) are measured with random errors. We propose a new two-step procedure for constructing estimators which guarantees their consistency, find general necessary and sufficient conditions for the asymptotic normality of these estimators, and discuss the case in which these estimators have the minimal asymptotic variance.     

Stochastic integrals of empirical-type processes with applications to censored regression

Motivated by the analysis of linear rank estimators and the Buckley-James nonparametric EM estimator in censored regression models, we study herein the asymptotic properties of stochastic integrals of certain two-parameter empirical processes. Applications of these results on empirical processes and their stochastic integrals to the asymptotic analysis of censored regression estimators are also given.     

Improved estimation in multiple linear regression models with measurement error and general constraint

In this paper, we define two restricted estimators for the regression parameters in a multiple linear regression model with measurement errors when prior information for the parameters is available. We then construct two sets of improved estimators which include the preliminary test estimator, the Stein-type estimator and the positive rule Stein type estimator for both slope and intercept, and examine their statistical properties such as the asymptotic distributional quadratic biases and the asymptotic distributional quadratic risks. We remove the distribution assumption on the error term, which was generally imposed in the literature, but provide a more general investigation of comparison of the quadratic risks for these estimators. Simulation studies illustrate the finite-sample performance of the proposed estimators, which are then used to analyze a dataset from the Nurses Health Study.