r-k Class estimation in regression model with concomitant variables

We treat with the r-k class estimation in a regression model, which includes the ordinary least squares estimator, the ordinary ridge regression estimator and the principal component regression estimator as special cases of the r-k class estimator. Many papers compared total mean square error of these estimators. Sarkar (1989, Ann. Inst. Statist. Math., 41, 717–724) asserts that the results of this comparison are still valid in a misspecified linear model. We point out some confusions of Sarkar and show additional conditions under which his assertion holds.     

基于奇异值分解的岭型回归(英文)

本文基于设计阵的奇异值分解(SVD),从LS估计出发,应用岭回归估计方法,构造了回归系数的一个新的有偏估计,称为基于SVD的岭型回归估计,简称RRSVD估计,讨论了其性质和偏参数的选取问题,得到了许多重要结论.计算结果表明,在设计阵呈病态时,RRS善岭回归估计.     

Orthogonally invariant estimation of the skew-symmetric normal mean matrix

The unbiased estimator of risk of the orthogonally invariant estimator of the skew-symmetric normal mean matrix is obtained, and a class of minimax estimators and their order-preserving modification are proposed. The estimators have applications in paired comparisons model. A Monte Carlo study to compare the risks of the estimators is given.     

错误先验假定下Bayes线性无偏估计的稳健性

本文基于错误的先验假定获得了一般线性模型下可估函数的Bayes线性无偏估计(BLUE), 证明了在均方误差矩阵(MSEM)准则和后验Pitman Closeness (PPC)准则下BLUE相对于最小二乘估计(LSE)的优良性, 并导出了它们的相对效率的界, 从而获得BLUE的稳健性.     

线性模型和线性EV模型中的T-型回归估计和EM算法

本文对于线性函数关系EV模型定义了$t$\,-型回归估计, 并对于普通线性模型和线性函数关系EV模型给出了计算$t$\,-型回归估计的EM算法, 同时获得了估计的相合性\bd 模拟结果表明由EM算法获得的$t$\,-型回归估计的表现良好.     

A stochastic restricted ridge regression estimator

Groß [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64] proposed a restricted ridge regression estimator when exact restrictions are assumed to hold. When there are stochastic linear restrictions on the parameter vector, we introduce a new estimator by combining ideas underlying the mixed and the ridge regression estimators under the assumption that the errors are not independent and identically distributed. Apart from [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64], we call this new estimator as the stochastic restricted ridge regression (SRRR) estimator. The performance of the SRRR estimator over the mixed estimator in respect of the variance and the mean square error matrices is examined. We also illustrate our findings with a numerical example. The shrinkage generalized least squares (GLS) and the stochastic restricted shrinkage GLS estimators are proposed.     

Some closed form robust moment‐based estimators for the MEM(1,1)

In this paper, we extend the closed form moment estimator (ordinary MCFE) for the autoregressive conditional duration model given by Lu et al (2016) and propose some closed form robust moment‐based estimators for the multiplicative error model to deal with the additive and innovational outliers. The robustification of the closed form estimator is done by replacing the sample mean and sample autocorrelation with some robust estimators. These estimators are more robust than the quasi‐maximum likelihood estimator (QMLE) often used to estimate this model, and they are easy to implement and do not require the use of any numerical optimization procedure and the choice of initial value. The performance of our proposal in estimating the parameters and forecasting conditional mean μ_t of the MEM(1,1) process is compared with the proposals existing in the literature via Monte Carlo experiments, and the results of these experiments show that our proposal outperforms the ordinary MCFE, QMLE, and least absolute deviation estimator in the presence of outliers in general. Finally, we fit the price durations of IBM stock with the robust closed form estimators and the benchmarks and analyze their performances in estimating model parameters and forecasting the irregularly spaced intraday Value at Risk.     

The superiority of empirical bayes estimation of parameters in partitioned normal linear model

In this article,the empirical Bayes（EB）estimators are constructed for the estimable functions of the parameters in partitioned normal linear model.The superiorities of the EB estimators over ordinary least-squares（LS）estimator are investigated under mean square error matrix（MSEM）criterion.     

受约束回归模型参数的统一几乎无偏估计

考虑实际回归问题中存在更多受约束条件的情况,提出了带约束的统一几乎无偏估计类,统一了常见的具有线性约束的回归模型的几乎无偏估计,进一步的研究给出了在均方误差和均方误差矩阵意义下,带约束的统一几乎无偏估计优于一般带约束的最小二乘估计的充分条件和椭球范围.     

Second-order nonlinear least squares estimation

The ordinary least squares estimation is based on minimization of the squared distance of the response variable to its conditional mean given the predictor variable. We extend this method by including in the criterion function the distance of the squared response variable to its second conditional moment. It is shown that this “second-order” least squares estimator is asymptotically more efficient than the ordinary least squares estimator if the third moment of the random error is nonzero, and both estimators have the same asymptotic covariance matrix if the error distribution is symmetric. Simulation studies show that the variance reduction of the new estimator can be as high as 50% for sample sizes lower than 100. As a by-product, the joint asymptotic covariance matrix of the ordinary least squares estimators for the regression parameter and for the random error variance is also derived, which is only available in the literature for very special cases, e.g. that random error has a normal distribution. The results apply to both linear and nonlinear regression models, where the random error distributions are not necessarily known.     

PLS regression: A directional signal-to-noise ratio approach

We present a new approach to univariate partial least squares regression (PLSR) based on directional signal-to-noise ratios (SNRs). We show how PLSR, unlike principal components regression, takes into account the actual value and not only the variance of the ordinary least squares (OLS) estimator. We find an orthogonal sequence of directions associated with decreasing SNR. Then, we state partial least squares estimators as least squares estimators constrained to be null on the last directions. We also give another procedure that shows how PLSR rebuilds the OLS estimator iteratively by seeking at each step the direction with the largest difference of signals over the noise. The latter approach does not involve any arbitrary scale or orthogonality constraints.     

A Dirichlet process functional approach to heteroscedastic-consistent covariance estimation

The mixture of Dirichlet process (MDP) defines a flexible prior distribution on the space of probability measures. This study shows that ordinary least-squares (OLS) estimator, as a functional of the MDP posterior distribution, has posterior mean given by weighted least-squares (WLS), and has posterior covariance matrix given by the (weighted) heteroscedastic-consistent sandwich estimator. This is according to a pairs bootstrap distribution approximation of the posterior, using a Pólya urn scheme. Also, when the MDP prior baseline distribution is specified as a product of independent probability measures, this WLS solution provides a new type of generalized ridge regression estimator. Such an estimator can handle multicollinear or singular design matrices even when the number of covariates exceeds the sample size, and can shrink the coefficient estimates of irrelevant covariates towards zero, which makes it useful for nonlinear regressions via basis expansions. Also, this MDP/OLS functional methodology can be extended to methods for analyzing the sensitivity of the heteroscedasticity-consistent causal effect size over a range of hidden biases, due to missing covariates omitted from the regression; and more generally, can be extended to a Vibration of Effects analysis. The methodology is illustrated through the analysis of simulated and real data sets. Overall, this study establishes new connections between Dirichlet process functional inference, the bootstrap, consistent sandwich covariance estimation, ridge shrinkage regression, WLS, and sensitivity analysis, to provide regression methodology useful for inferences of the mean dependent response.     

错误先验假定下回归系数Bayes估计的小样本性质

本在于错误指定的先验假定获得了回归系数的Ｂａｙｅｓ估计（ＢＥ）,并在均方误差矩阵准则下对其与最小二乘（ＬＳ）估计进行了比较,导出了它们的相对效率的界、讨论了在后验ＰｉｔｍａｎＣｌｏｓｅｎｅｓｓ准则下ＢＥ相对于ＬＳ估计的优良性。     

An Isotonic Regression Problem for Infinite-Dimensional Parameters

We consider an infinite-dimensional isotonic regression problem which is an extension of the suitably revised classical isotonic regression problem. Given p-summable data, for p finite and at least one, there exists an optimal estimator to our problem. For p greater than one, this estimator is unique and is the limit in the p-norm of the sequence of unique estimators in canonical finite-dimensional truncations of our problem. However, for p equal to one, our problem, as well as the finite-dimensional truncations, admit multiple optimal estimators in general. In this case, the sequence of optimal estimator sets to the truncations converges to the optimal estimator set of the infinite problem in the sense of Kuratowski. Moreover, the selection of natural best optimal estimators to the truncations converges in the 1-norm to an optimal estimator of the infinite problem.     

On Adaptive Combination of Regression Estimators

Consider the problem of choosing between two estimators of the regression function, where one estimator is based on stronger assumptions than the other and thus the rates of convergence are different. We propose a linear combination of the estimators where the weights are estimated by Mallows' C _L . The adaptive estimator retains the optimal rates of convergence and is an extension of Stein-type estimators considered by Li and Hwang (1984, Ann. Statist., 12, 887-897) and related to an estimator in Burman and Chaudhuri (1999, Ann. Inst. Statist. Math. (to appear)).     

The Minimax Estimator of Stochastic Regression Coefficients and Parameters in the Class of All Estimators

In this paper, the authors address the problem of the minimax estimator of linear combinations of stochastic regression coefficients and parameters in the general normal linear model with random effects. Under a quadratic loss function, the minimax property of linear estimators is investigated. In the class of all estimators, the minimax estimator of estimable functions, which is unique with probability 1, is obtained under a multivariate normal distribution.     

Improved Estimation of Parameter Matrices in a One-Sample and Two-Sample Problems

In this paper, the problems of estimating the covariance matrix in a Wishart distribution (refer as one-sample problem) and the scale matrix in a multi-variate F distribution (which arise naturally from a two-sample setting) are considered. A new class of estimators which shrink the eigenvalues towards their harmonic mean is proposed. It is shown that the new estimator dominates the best linear estimator under two scale invariant loss functions.     

包含多余回归变量的错误指定模型的随机约束Liu估计

对由于包含多余回归自变量而导致的错误指定线性回归模型,本文导出了回归系数的最小二乘估计,普通混合估计以及随机约束Liu估计,并在均方误差矩阵准则下对这三个估计的优良性进行了比较,给出了随机约束Liu估计优于最小二乘估计和普通混合估计的充要条件.此外,对它们所对应的经典预测值的优良性也进行了讨论.     

方差分量的二次不变估计的非负改进

研究一类方差分量模型中的方差分量的估计改进问题,首先在含两个方差分量模型中给出σ21二次型估计类,并且此估计类还具有无偏性和不变性.考虑二次损失(δ-θ)2,在此估计类基础上放弃无偏性进行非负改进,不仅得到优于二次不变无偏估计类的σ21的非负二次不变估计类,而且还说明了它优于方差分析估计和最小均方误差估计,文献[5]中给出s>2时的非负改进,但是非负改进存在是有条件的,本文克服了这个缺陷.最后给出了非负改进存在的充分必要条件.     

回归系数的广义根方估计及其模拟

文献[1,2]中提出了回归系数的根方估计~(k),当回归自变量间存在复共线关系时,~(k)较回归系数的最小二乘估计有所改善,本文将根方估计作一拓广,得出了回归系数的广义根方估计~(K),其中K为对角阵,文中证明了广义根方估计~(K)较~(k)能更有效地改善最小二乘估计,并给出了广义根方估计的显式解,在此基础上,提出了广义根方估计的显式解和一种确定k_i的方法。