Adaptive Unified Biased Estimators of Parameters in Linear Model

To tackle multi collinearity or ill-conditioned design matrices in linear models,adaptive biasedestimators such as the time-honored Stein estimator,the ridge and the principal component estimators havebeen studied intensively.To study when a biased estimator uniformly outperforms the least squares estimator,some sufficient conditions are proposed in the literature.In this paper,we propose a unified framework toformulate a class of adaptive biased estimators.This class includes all existing biased estimators and some newones.A sufficient condition for outperforming the least squares estimator is proposed.In terms of selectingparameters in the condition,we can obtain all double-type conditions in the literature.     

Weighted Profile Least Squares Estimation for a Panel Data Varying-Coefficient Partially Linear Model

This paper is concerned with inference of panel data varying-coefficient partially linear models with a one-way error structure. The model is a natural extension of the well-known panel data linear model （due to Baltagi 1995） to the setting of semiparametric regressions. The authors propose a weighted profile least squares estimator （WPLSE） and a weighted local polynomial estimator （WLPE） for the parametric and nonparametric components, respectively. It is shown that the WPLSE is asymptotically more efficient than the usual profile least squares estimator （PLSE）, and that the WLPE is also asymptotically more efficient than the usual local polynomial estimator （LPE）. The latter is an interesting result. According to Ruckstuhl, Welsh and Carroll （2000） and Lin and Carroll （2000）, ignoring the correlation structure entirely and ＂pretending＂ that the data are really independent will result in more efficient estimators when estimating nonparametric regression with longitudinal or panel data. The result in this paper shows that this is not true when the design points of the nonparametric component have a closeness property within groups. The asymptotic properties of the proposed weighted estimators are derived. In addition, a block bootstrap test is proposed for the goodness of fit of models, which can accommodate the correlations within groups illustrate the finite sample performances of the Some simulation studies are conducted to proposed procedures.     

STRONG CONVERGENCE RATES OF SEVERAL ESTIMATORS IN SEMIPARAMETRIC VARYING-COEFFICIENT PARTIALLY LINEAR MODELS

This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang （2005） proposed a profile least squares estimator for the parametric component and established its asymptotic normality. We further show that the profile least squares estimator can achieve the law of iterated logarithm. Moreover, we study the estimators of the functions characterizing the non-linear part as well as the error variance. The strong convergence rate and the law of iterated logarithm are derived for them, respectively.     

Asymptotic Inference in the Random Coefficient Autoregressive Model with Time-functional Variance Noises

This paper considers the random coefficient autoregressive model with time-functional variance noises, hereafter the RCA-TFV model. We first establish the consistency and asymptotic normality of the conditional least squares estimator for the constant coefficient. The semiparametric least squares estimator for the variance of the random coefficient and the nonparametric estimator for the variance function are constructed,and their asymptotic results are reported. A simulation study is presented ...     

Truncated Estimator of Asymptotic Covariance Matrix in Partially Linear Models with Heteroscedastic Errors

A partially linear regression model with heteroscedastic and/or serially correlated errors is studied here. It is well known that in order to apply the semiparametric least squares estimation （SLSE） to make statistical inference a consistent estimator of the asymptotic covariance matrix is needed. The traditional residual-based estimator of the asymptotic covariance matrix is not consistent when the errors are heteroscedastic and/or serially correlated. In this paper we propose a new estimator by truncating, which is an extension of the procedure in White. This estimator is shown to be consistent when the truncating parameter converges to infinity with some rate.     

ON THE SINGULARITY OF LEAST SQUARES ESTIMATOR FOR MEAN-REVERTING α-STABLE MOTIONS

We study the problem of parameter estimation for mean-reverting α-stable motion, dXt = （a0 - θ0Xt）dt ＋ dZt, observed at discrete time instants. A least squares estimator is obtained and its asymptotics is discussed in the singular case （a0, θ0） = （0, 0）. If a0 = 0, then the mean-reverting α-stable motion becomes Ornstein-Uhlenbeck process and is studied in [7] in the ergodic case θ0 〉 0. For the Ornstein-Uhlenbeck process, asymptotics of the least squares estimators for the singular case （θ0 = 0） and for ergodic case （θ0 〉 0） are completely different.     

Delete-group Jackknife Estimate in Partially Linear Regression Models with Heteroscedasticity

Abstract Consider a partially linear regression model with an unknown vector parameter β,an unknownfunction g(.),and unknown heteroscedastic error variances.Chen,You proposed a semiparametric generalizedleast squares estimator(SGLSE)for β,which takes the heteroscedasticity into account to increase efficiency.Forinference based on this SGLSE,it is necessary to construct a consistent estimator for its asymptotic covariancematrix.However,when there exists within-group correlation, the traditional delta method and the delete-1jackknife estimation fail to offer such a consistent estimator.In this paper, by deleting grouped partial residualsa delete-group jackknife method is examined.It is shown that the delete-group jackknife method indeed canprovide a consistent estimator for the asymptotic covariance matrix in the presence of within-group correlations.This result is an extension of that in[21].     

Moderate Deviations for M-estimators in Linear Models with φ-mixing Errors

In this paper, the moderate deviations for the M-estimators of regression parameter in a linear model are obtained when the errors form a strictly stationary φ-mixing sequence. The results are applied to study many different types of M-estimators such as Huber's estimator, Lp-regression estimator, least squares estimator and least absolute deviation estimator.     

Generalized profile LSE in varying-coefficient partially linear models with measurement errors

This paper is concerned with the estimating problem of a semiparametric varying-coefficient partially linear errors-in-variables model Yi=Xτiβ+Zτiα(Ui)+εi , Wi=Xi+ξi,i=1, ··· , n. Due to measurement errors, the usual profile least square estimator of the parametric component, local polynomial estimator of the nonparametric component and profile least squares based estimator of the error variance are biased and inconsistent. By taking the measurement errors into account we propose a generalized profile least squares estimator for the parametric component and show it is consistent and asymptotically normal. Correspondingly, the consistent estimation of the nonparametric component and error variance are proposed as well. These results may be used to make asymptotically valid statistical inferences. Some simulation studies are conducted to illustrate the finite sample performance of these proposed estimations.     

Efficient statistical inference for partially nonlinear errors-in-variables models

In this paper, we consider the partially nonlinear errors-in-variables models when the non- parametric component is measured with additive error. The profile nonlinear least squares estimator of unknown parameter and the estimator of nonparametric component are constructed, and their asymptotic properties are derived under general assumptions. Finite sample performances of the proposed statistical inference procedures are illustrated by Monte Carlo simulation studies.     

回归系数的岭型主相关估计及其优良性

本文研究了线性模型中的一种有偏估计,利用均方误差和残差平方和,得到了岭型主相关估计的一些性质,是对[1]中相关结果的推广.     

r-k Class estimation in regression model with concomitant variables

We treat with the r-k class estimation in a regression model, which includes the ordinary least squares estimator, the ordinary ridge regression estimator and the principal component regression estimator as special cases of the r-k class estimator. Many papers compared total mean square error of these estimators. Sarkar (1989, Ann. Inst. Statist. Math., 41, 717–724) asserts that the results of this comparison are still valid in a misspecified linear model. We point out some confusions of Sarkar and show additional conditions under which his assertion holds.     

A stochastic restricted ridge regression estimator

Groß [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64] proposed a restricted ridge regression estimator when exact restrictions are assumed to hold. When there are stochastic linear restrictions on the parameter vector, we introduce a new estimator by combining ideas underlying the mixed and the ridge regression estimators under the assumption that the errors are not independent and identically distributed. Apart from [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64], we call this new estimator as the stochastic restricted ridge regression (SRRR) estimator. The performance of the SRRR estimator over the mixed estimator in respect of the variance and the mean square error matrices is examined. We also illustrate our findings with a numerical example. The shrinkage generalized least squares (GLS) and the stochastic restricted shrinkage GLS estimators are proposed.     

Generalized ridge regression,least squares with stochastic prior information,and Bayesian estimators

The ridge estimator of the usual linear model is generalized by the introduction of an a priori vector r and an associated positive semidefinite matrix S. It is then shown that the generalized ridge estimator can be justified in two ways: (a) by the minimization of the residual sum of squares subject to a constraint on the length, in the metric S, of the vector of differences between r and the estimated linear model coefficients, (b) by incorporating prior knowledge, r playing the role of the vector of means and S proportional to the precision matrix. Both a Bayesian and an Aitken generalized least squares frameworks are used for the latter. The properties of the new estimator are derived and compared to the ordinary least squares estimator. The new method is illustrated with different assumptions on the form of the S matrix.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

岭型主成分估计的几条最优性质

本文计论岭型主成分估计的最优性质。证明了在岭型降维估计类中,它的方差有ｎ种最小性,同时证明了在正交不变范数下了具有最小性。     

稳健性因子分析在城镇居民家庭现金消费支出中的应用

利用面向对象的稳健性因子分析R软件包Robustfa,对2011年全国除港、澳、湾以外的31个省、市、自治区的城镇居民家庭现金消费支出的8个指标进行了因子分析.通过使残差矩阵的元素平方和达到最小,发现了一个组合一主因子法与稳健性Mve估计量.通过由稳健性Mve估计量计算的马氏距离大于临界值,我们发现共有10个异常点.用经典估计量和稳健性Mve估计量计算的样本相关阵、旋转后的因子载荷矩阵、因子对原始变量的贡献、贡献率、累积贡献率、样本相关阵的特征值的碎石图、前两个因子得分的散点图、因子得分、按因子得分排序等结果均有较大的不同.最后通过组合主因子法与稳健性Mve估计量将8个指标归结为两个因子:基础消费因子和消费倾向因子,根据每个省份的两个因子得分情况对该省份的家庭现金消费支出情况作出综合评价,并根据稳健性因子分析的结果给出了相应建议.     

PLS regression: A directional signal-to-noise ratio approach

We present a new approach to univariate partial least squares regression (PLSR) based on directional signal-to-noise ratios (SNRs). We show how PLSR, unlike principal components regression, takes into account the actual value and not only the variance of the ordinary least squares (OLS) estimator. We find an orthogonal sequence of directions associated with decreasing SNR. Then, we state partial least squares estimators as least squares estimators constrained to be null on the last directions. We also give another procedure that shows how PLSR rebuilds the OLS estimator iteratively by seeking at each step the direction with the largest difference of signals over the noise. The latter approach does not involve any arbitrary scale or orthogonality constraints.     

Inequality constrained ridge regression estimator

We carry out the idea of inequality constrained least squares (ICLS) estimation of Liew (1976) to the inequality constrained ridge regression (ICRR) estimation. We propose ICRR estimator by reducing the primal–dual relation to the fundamental problem of Dantzig and Cottle, 1967, Cottle and Dantzig, 1974 with Lemke (1962) algorithm. Furthermore, we conduct a Monte Carlo experiment.