Thresholding projection estimators in functional linear models

We consider the problem of estimating the regression function in functional linear regression models by proposing a new type of projection estimators which combine dimension reduction and thresholding. The introduction of a threshold rule allows us to get consistency under broad assumptions as well as minimax rates of convergence under additional regularity hypotheses. We also consider the particular case of Sobolev spaces generated by the trigonometric basis which permits us to get easily mean squared error of prediction as well as estimators of the derivatives of the regression function. We prove that these estimators are minimax and rates of convergence are given for some particular cases.     

Weak consistency of least-squares estimators in linear models

Let Y_n, n≥1, be a sequence of integrable random variables with EY_n = x_n1β₁ + x_n2β₂ + … + x_npβ_p, where the x_ij's are known and β^T = (β₁, β₂,…, β_p) unknown. Let b_n be the least-squares estimator of β based on Y₁, Y₂,…, Y_n. Weak consistency of b_n, n≥1, has been considered in the literature under the assumption that each Y_n is square integrable. In this paper, we study weak consistency of b_n, n≥1, and associated rates of convergence under the minimal assumption that each Y_n is integrable.     

Some properties for the estimators in linear mixed models

Linear mixed models (LMMs) have become an important statistical method for analyzing cluster or longitudinal data. In most cases, it is assumed that the distributions of the random effects and the errors are normal. This paper removes this restrictions and replace them by the moment conditions. We show that the least square estimators of fixed effects are consistent and asymptotically normal in general LMMs. A closed-form estimator of the covariance matrix for the random effect is constructed and its consistent is shown. Based on this, the consistent estimate for the error variance is also obtained. A simulation study and a real data analysis show that the procedure is effective.     

Theory and computation of restricted linear models

Least squares inverses and complementary matrices are used to develop a comprehensive theory of estimation for a restricted linear model. Testable hypotheses as defined in Searle [8] are extended to involve nonestimable functions. An explicit expression for the sum of squares of deviation from the null hypothesis under the general setup with restrictions (Rao [7, p. 242]) and the corresponding number of degrees of freedom are obtained for implementation on computers.     

Quasi-maximum likelihood estimators in generalized linear models with autoregressive processes

The paper studies a generalized linear model(GLM)y_t = h(x_t~T β) + ε_t,t = l,2,...,n,where ε_1 = η_1,ε_1 =ρε_t +η_t,t = 2,3,...;n,h is a continuous differentiable function,η_t's are independent and identically distributed random errors with zero mean and finite variance σ~2.Firstly,the quasi-maximum likelihood(QML) estimators of β,p and σ~2 are given.Secondly,under mild conditions,the asymptotic properties(including the existence,weak consistency and asymptotic distribution) of the QML estimators are investigated.Lastly,the validity of method is illuminated by a simulation example.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

Adaptive Lasso estimators for ultrahigh dimensional generalized linear models

Generalized linear models have been more widely used than linear models which exclude categorical variables. The penalized method becomes an effective tool to study ultrahigh dimensional generalized linear models. In this paper, we study theoretical results of the adaptive Lasso for generalized linear models in terms of diverging number of parameters and ultrahigh dimensionality. The asymptotic results are examined by several simulation studies.     

Using thresholding difference-based estimators for variable selection in partial linear models

A commonly used semiparametric model is considered. We adopt two difference based estimators of the linear component of the model and propose corresponding thresholding estimators that can be used for variable selection. For each thresholding estimator, variable selection in the linear component is developed and consistency of the variable selection procedure is shown. We evaluate our method in a simulation study and implement it on a real data set.     

QUADRATIC ESTIMATORS OF QUADRATIC FUNCTIONS WITH PARAMETERS IN NORMAL LINEAR MODELS

ＱＵＡＤＲＡＴＩＣＥＳＴＩＭＡＴＯＲＳＯＦＱＵＡＤＲＡＴＩＣＦＵＮＣＴＩＯＮＳＷＩＴＨＰＡＲＡＭＥＴＥＲＳＩＮＮＯＲＭＡＬＬＩＮＥＡＲＭＯＤＥＬＳ￥ＷＵＱＩＧＵＡＮＧ（吴启光）（ＩｎｓｔｉｔｕｔｅｏｆＳｙｓｔｅｍｅＳｃｉｅｎｃｅ,ｔｈｅＣｈｉｎｅｓｅ...     

Robustness of dual divergence estimators for models satisfying linear constraints

We consider new classes of estimators and test statistics for models satisfying linear constraints with unknown parameter. These procedures are based on minimization of divergences through duality techniques. We prove that, for various divergences, the new approach provides robust estimation and test procedures, unlike the empirical likelihood method. We give general results using the influence function approach, which we exemplify in detail in the case of the Cressie–Read divergences. It is found that the Hellinger distance is one of the divergences that leads to robust procedures.     

Consistent and asymptotically normal estimators for cyclically time-dependent linear models

We consider a general class of time series linear models where parameters switch according to a known fixed calendar. These parameters are estimated by means of quasi-generalized least squares estimators. conditions for strong consistency and asymptotic normality are given. Applications to cyclical ARMA models with non constant periods are considered.     

Admissible polynomial estimators for quadratic polynomials of normal parameters

The problem of the statistical estimation of quadratic polynomials of the parameters of the normal law is considered.Translated from Zapiski Nauchnykh Seminarov Leningradskogo Otdeleniya Matematicheskogo Instituta im. V. A. Steklova Akademii Nauk SSSR, Vol. 184, pp. 234–247, 1990.     

On optimality of regular projective estimators for semimartingale models,part ii: asymptotically linear estimators

In this paper we consider estimators that (asymptotically) admit a so called linear representation. Using a parametrization of the model, that has been defined in a previous paper [1], and a certain notion of smoothness of the parametrization, it is possible to define a concept of optimality for these estimators and to characterize the optimal estimators. In contrast with the situation in [1], only the compensator is fully parametrized by the parameter we want to estimate. Embedding the problem under consideration in the previously developed framework then requires the introduction of several nuisance parameters, that are needed to describe certain stochastic integrals with respect to the compensator of the jump measure     

部分线性变系数模型Backfitting估计的渐近性质

作为部分线性模型与变系数模型的推广,部分线性变系数模型是一类应用广泛的数据分析模型.利用Backfitting方法拟合这类特殊的可加模型,可得到模型中常值系数估计量的精确解析表达式,该估计量被证明是n~(1/2)相合的.最后通过数值模拟考察了所提估计方法的有效性.     

Admissible estimators of the population total using trimming and Winsorization

In this article we provide admissibility and uniform admissibility results for estimators of the total of a finite population which employ trimming or Winsorization. These follow from application of recent Meeden-Ghosh techniques.     

Positive shrinkage, improved pretest and absolute penalty estimators in partially linear models

Shrinkage estimators of a partially linear regression parameter vector are constructed by shrinking estimators in the direction of the estimate which is appropriate when the regression parameters are restricted to a linear subspace. We investigate the asymptotic properties of positive Stein-type and improved pretest semiparametric estimators under quadratic loss. Under an asymptotic distributional quadratic risk criterion, their relative dominance picture is explored analytically. It is shown that positive Stein-type semiparametric estimators perform better than the usual Stein-type and least square semiparametric estimators and that an improved pretest semiparametric estimator is superior to the usual pretest semiparametric estimator. We also consider an absolute penalty type estimator for partially linear models and give a Monte Carlo simulation comparisons of positive shrinkage, improved pretest and the absolute penalty type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty type estimation method when the dimension of the parameter space is much larger than that of the linear subspace.