多元协方差阵扰动模型岭估计的影响分析

本文研究了多元线性同归模型岭估计的影响分析问题.利用最小二乘估计方法,获得了多元协方差阵扰动模型与原模型参数阵之间的岭估计的一些关系式,给出了度量影响大小的基于岭估计的广义Cook距离.     

生长曲线模型中基于奇异值分解的岭估计

在生长曲线模型中将设计阵的奇异值分解与普通的岭估计相结合,针对设计阵A与C至少有一个病态时的情况提出生长曲线模型中基于奇异值分解的岭估计.比较其在均方误差,均方误差矩阵,及PC准则下相对于最小二乘估计的优良性.证明其容许性并利用Hemmerle和Brantle用于确定广义岭估计参数的方法给出极小化均方误差的无偏估计法选取岭参数.     

岭回归估计的向量参数方法

本文提出岭回归估计的向量参数方法,选择均方误差函数的负梯度方向作为参数向量方向,根据均方误差与拟合误差的预期约束条件选择确定参数向量模长.文中获得了两个单调性结论,向量参数岭回归估计的均方误差是参数向量模长的单调减函数,而拟合误差是参数向量模长的单调增函数.基于两类误差的单调性结论,本文创建了关于两类误差的预期约束条件,预期条件约束下的向量参数岭回归方法有望成为兼备均方误差次优与拟合误差适度的双赢估计.文章最后是一个应用实例.     

半参数回归模型的几乎无偏岭估计

提出了半参数回归模型的几乎无偏岭估计,并与岭估计进行了比较,在均方误差意义下,几乎无偏岭估计优于岭估计. 然后讨论了有偏参数的选取问题. 最后,用模拟算例和实际应用说明了几乎无偏岭估计的有效性和可行性.     

改良PP回归最小二乘估计的相合性

本文考虑了PP回归估计问题，给出了PP方向和岭函数相合的改良估计，降低了文献中的限制条件．     

半参数回归模型的一类压缩估计

研究了半参数回归模型的参数估计问题,利用压缩估计方法给出了模型的一类有偏估计,并与最小二乘估计、岭估计、几乎无偏岭估计进行了比较.在均方误差意义下,新的压缩估计明显优于最小二乘估计.最后讨论了有偏参数选取的问题.     

混合系数线性模型的几乎无偏岭估计

本文研究了连续测量数据情况下的混合系数线性模型的参数估计问题.利用岭估计方法得到了该模型的几乎无偏岭估计,并证明了在均方误差意义下,几乎无偏岭估计优于岭估计.最后讨论了有偏参数的选取问题.     

基于泛岭估计对岭估计过度压缩的改进方法

岭估计是解决多元线性回归多重共线性问题的有效方法,是有偏的压缩估计。与普通最小二乘估计相比,岭估计可以降低参数估计的均方误差,但是却增大残差平方和,拟合效果变差。本文提出一种基于泛岭估计对岭估计过度压缩的改进方法,可以改进岭估计的拟合效果,减小岭估计残差平方和的增加幅度。     

岭型主成分估计的最优性

本文研究岭型主成分估计的回归最优性,证明了岭型降维估计类中。岭型主成分估计具有Φ-最小、E-最小和 D-最小性,且协方差阵的正交不变范数最小。推广了[2]中某些结果.     

部分线性模型的随机约束岭估计

研究了部分线性回归模型附加有随机约束条件时的估计问题.基于Profile最小二乘方法和混合估计方法提出了参数分量随机约束下的Profile混合估计,并研究了其性质.为了克服共线性问题,构造了参数分量的Profile混合岭估计,并给出了估计量的偏和方差.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

A stochastic restricted ridge regression estimator

Groß [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64] proposed a restricted ridge regression estimator when exact restrictions are assumed to hold. When there are stochastic linear restrictions on the parameter vector, we introduce a new estimator by combining ideas underlying the mixed and the ridge regression estimators under the assumption that the errors are not independent and identically distributed. Apart from [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64], we call this new estimator as the stochastic restricted ridge regression (SRRR) estimator. The performance of the SRRR estimator over the mixed estimator in respect of the variance and the mean square error matrices is examined. We also illustrate our findings with a numerical example. The shrinkage generalized least squares (GLS) and the stochastic restricted shrinkage GLS estimators are proposed.     

回归系数的广义岭型主相关估计及其优良性

In this paper, we propose a new biased estimator of the regression parameters, the generalized ridge and principal correlation estimator. We present its some properties and prove that it is superior to LSE （least squares estimator）, principal correlation estimator, ridge and principal correlation estimator under MSE （mean squares error） and PMC （Pitman closeness） criterion, respectively.     

Optimal generalized ridge estimator under the generalized cross-validation criterion in linear regression

In this short paper, we mainly aim to study the generalized ridge estimator in a linear regression model. Through matrix techniques including Hadamard product and derivative of a vector, the globally optimal generalized ridge estimator is derived under the generalized cross-validation criterion from the theoretical point of view. It will be seen that the notion of linearized ridge estimator plays an important role in the process. A numerical example is applied to illustrate the main results of the paper.     

Efficiency of a Liu-type estimator in semiparametric regression models

In this paper we consider the semiparametric regression model, y=Xβ+f+ε. Recently, Hu [11] proposed ridge regression estimator in a semiparametric regression model. We introduce a Liu-type (combined ridge-Stein) estimator (LTE) in a semiparametric regression model. Firstly, Liu-type estimators of both β and f are attained without a restrained design matrix. Secondly, the LTE estimator of β is compared with the two-step estimator in terms of the mean square error. We describe the almost unbiased Liu-type estimator in semiparametric regression models. The almost unbiased Liu-type estimator is compared with the Liu-type estimator in terms of the mean squared error matrix. A numerical example is provided to show the performance of the estimators.     

Rank-based Liu regression

Due to the complicated mathematical and nonlinear nature of ridge regression estimator, Liu (Linear-Unified) estimator has been received much attention as a useful method to overcome the weakness of the least square estimator, in the presence of multicollinearity. In situations where in the linear model, errors are far away from normal or the data contain some outliers, the construction of Liu estimator can be revisited using a rank-based score test, in the line of robust regression. In this paper, we define the Liu-type rank-based and restricted Liu-type rank-based estimators when a sub-space restriction on the parameter of interest holds. Accordingly, some improved estimators are defined and their asymptotic distributional properties are investigated. The conditions of superiority of the proposed estimators for the biasing parameter are given. Some numerical computations support the findings of the paper.     

岭回归中确定K值的一种方法

本文给出了岭估计中确定K值的一种新方法,这种方法改进了Hoerl和Kennard的相应方法。     

相依线性回归系统的泛岭改进估计

对于一类相依线性回归系统，本文提出了一种泛岭改进估计，并讨论了这种估计及相应的两步估计的优良性质，获得了若干深入的结果．     

A Dirichlet process functional approach to heteroscedastic-consistent covariance estimation

The mixture of Dirichlet process (MDP) defines a flexible prior distribution on the space of probability measures. This study shows that ordinary least-squares (OLS) estimator, as a functional of the MDP posterior distribution, has posterior mean given by weighted least-squares (WLS), and has posterior covariance matrix given by the (weighted) heteroscedastic-consistent sandwich estimator. This is according to a pairs bootstrap distribution approximation of the posterior, using a Pólya urn scheme. Also, when the MDP prior baseline distribution is specified as a product of independent probability measures, this WLS solution provides a new type of generalized ridge regression estimator. Such an estimator can handle multicollinear or singular design matrices even when the number of covariates exceeds the sample size, and can shrink the coefficient estimates of irrelevant covariates towards zero, which makes it useful for nonlinear regressions via basis expansions. Also, this MDP/OLS functional methodology can be extended to methods for analyzing the sensitivity of the heteroscedasticity-consistent causal effect size over a range of hidden biases, due to missing covariates omitted from the regression; and more generally, can be extended to a Vibration of Effects analysis. The methodology is illustrated through the analysis of simulated and real data sets. Overall, this study establishes new connections between Dirichlet process functional inference, the bootstrap, consistent sandwich covariance estimation, ridge shrinkage regression, WLS, and sensitivity analysis, to provide regression methodology useful for inferences of the mean dependent response.