Asymptotics of Huber-Dutter Estimators for Partial Linear Model with Nonstochastic Designs

For partial linear model Y=X~τβ_0 _(g0)(T) εwith unknown β_0∈R~d and an unknown smooth function go, this paper considers the Huber-Dutter estimators of β_0, scale σfor the errors and the function go respectively, in which the smoothing B-spline function is used. Under some regular conditions, it is shown that the Huber-Dutter estimators of β_0 and σare asymptotically normal with convergence rate n~((-1)/2) and the B-spline Huber-Dutter estimator of go achieves the optimal convergence rate in nonparametric regression. A simulation study demonstrates that the Huber-Dutter estimator of β_0 is competitive with its M-estimator without scale parameter and the ordinary least square estimator. An example is presented after the simulation study.     

Testing Serial Correlation in Semiparametric Varying-Coefficient Partially Linear EV Models

This paper studies estimation and serial correlation test of a semiparametric varying-coefficient partially linear EV model of the form Y = X^Tβ ＋Z^Tα（T） ＋ε,ξ = X ＋ η with the identifying condition E[（ε,η^T）^T] =0, Cov[（ε,η^T）^T] = σ^2Ip＋1. The estimators of interested regression parameters /3 , and the model error variance σ2, as well as the nonparametric components α（T）, are constructed. Under some regular conditions, we show that the estimators of the unknown vector β and the unknown parameter σ2 are strongly consistent and asymptotically normal and that the estimator of α（T） achieves the optimal strong convergence rate of the usual nonparametric regression. Based on these estimators and asymptotic properties, we propose the VN,p test statistic and empirical log-likelihood ratio statistic for testing serial correlation in the model. The proposed statistics are shown to have asymptotic normal or chi-square distributions under the null hypothesis of no serial correlation. Some simulation studies are conducted to illustrate the finite sample performance of the proposed tests.     

Consistency and normality of Huber-Dutter estimators for partial linear model

For partial linear model Y = Xτβ0 g0(T) with unknown β0 ∈ Rd and an unknown smooth function g0, this paper considers the Huber-Dutter estimators of β0, scale σ for the errors and the function g0 approximated by the smoothing B-spline functions, respectively. Under some regularity conditions, the Huber-Dutter estimators of β0 and σ are shown to be asymptotically normal with the rate of convergence n-1/2 and the B-spline Huber-Dutter estimator of g0 achieves the optimal rate of convergence in nonparametric regression. A simulation study and two examples demonstrate that the Huber-Dutter estimator of β0 is competitive with its M-estimator without scale parameter and the ordinary least square estimator.     

Empirical Bayes Estimation in Regression Model

This paper considers the empirical Bayes （EB） estimation problem for the parameter β of the linear regression model y = Xβ＋ ε with ε- N（0, σ^2I） given β. Based on Pitman closeness （PC） criterion and mean square error matrix （MSEM） criterion, we prove the superiority of the EB estimator over the ordinary least square estimator （OLSE）.     

A penalty method for nonparametric estimation of the logarithmic derivative of a density function

Summary Given a random sample of sizen from a densityf ₀ on the real line satisfying certain regularity conditions, we propose a nonparametric estimator forψ ₀=−f ₀ ^′ /f⁰. The estimate is the minimizer of a quadratic functional of the formλJ(ψ)+∫[ψ ²−2ψ′]dF_n where λ>0 is a smoothing parameter,J(·) is a roughness penalty, andF _n is the empirical c.d.f. of the sample. A characterization of the estimate (useful for computational purposes) is given which is related to spline functions. A more complete study of the caseJ(ψ)=∫[d ²ψ/dx²]² is given, since it has the desirable property of giving the maximum likelihood normal estimate in the infinite smoothness limit (λ→∞). Asymptotics under somewhat restrictive assumptions (periodicity) indicate that the estimator is asymptotically consistent and achieves the optimal rate of convergence. This type of estimator looks promising because the minimization problem is simple in comparison with the analogous penalized likelihood estimators. This research was supported by the Office of Naval Research under Grant Number N00014-82-C-0062.     

NS Condition of Admissibility for the Linear Estimator of Normal Mean with Unknown Variance

Suppose Y - N（β, σ^2 In）, where β ∈ R^n and σ^2 〉 0 are unknown. We study the admissibility of linear estimators of mean vector under a quadratic loss function. A necessary and sufficient condition of the admissible linear estimator is given.     

Asymptotic Properties of a Modified Semi-Parametric MLE in Linear Regression with Right-Censored Data

Consider a linear regression model, Y=β′X+ε where Y may be right censored and the cdf F _o of ε is unknown. We show that a modified semi-parametric MLE, denoted by is strongly consistent under certain regularity conditions. Moreover, if F _o is discontinuous, then P(≠β i.o.)=0, which means that P(=β if the sample size is large)=1. The latter property has not been reported for the existing estimators. By contrast, most estimators, such as the Buckley-James estimator and M-estimators , satisfy that P(≠β i.o.)=1. Received April 23, 2001, Accepted November 13, 2001     

Adaptive estimation in circular functional linear models

We consider the problem of estimating the slope parameter in circular functional linear regression, where scalar responses Y ₁, ..., Y _n are modeled in dependence of 1-periodic, second order stationary random functions X ₁, ...,X _n . We consider an orthogonal series estimator of the slope function β, by replacing the first m theoretical coefficients of its development in the trigonometric basis by adequate estimators. We propose a model selection procedure for m in a set of admissible values, by defining a contrast function minimized by our estimator and a theoretical penalty function; this first step assumes the degree of ill-posedness to be known. Then we generalize the procedure to a random set of admissible m’s and a random penalty function. The resulting estimator is completely data driven and reaches automatically what is known to be the optimal minimax rate of convergence, in terms of a general weighted L ²-risk. This means that we provide adaptive estimators of both β and its derivatives.     

THE ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION IN MULTIPLE LINEAR REGRESSION MODEL

ＴＨＥＡＳＹＭＰＴＯＴＩＣＡＬＬＹＯＰＴＩＭＡＬＥＭＰＩＲＩＣＡＬＢＡＹＥＳＥＳＴＩＭＡＴＩＯＮＩＮＭＵＬＴＩＰＬＥＬＩＮＥＡＲＲＥＧＲＥＳＳＩＯＮＭＯＤＥＬ￥ＺＨＡＮＧＳＨＵＮＰＵ；ＷＥＩＬＡＩＳＨＥＮＧ（ＤｅｐａｒｔｍｅｎｔｏｆＭａｔｈｅｍａｔｉ...     

Sharp adaptive estimation of quadratic functionals

Estimation of a quadratic functional of a function observed in the Gaussian white noise model is considered. A data-dependent method for choosing the amount of smoothing is given. The method is based on comparing certain quadratic estimators with each other. It is shown that the method is asymptotically sharp or nearly sharp adaptive simultaneously for the “regular” and “irregular” region. We consider l_p bodies and construct bounds for the risk of the estimator which show that for p=4 the estimator is exactly optimal and for example when p ∈[3,100], then the upper bound is at most 1.055 times larger than the lower bound. We show the connection of the estimator to the theory of optimal recovery. The estimator is a calibration of an estimator which is nearly minimax optimal among quadratic estimators. Writing of this article was financed by Deutsche Forschungsgemeinschaft under project MA1026/6-2, CIES, France, and Jenny and AnttiWihuri Foundation.