r-k Class estimation in regression model with concomitant variables

We treat with the r-k class estimation in a regression model, which includes the ordinary least squares estimator, the ordinary ridge regression estimator and the principal component regression estimator as special cases of the r-k class estimator. Many papers compared total mean square error of these estimators. Sarkar (1989, Ann. Inst. Statist. Math., 41, 717–724) asserts that the results of this comparison are still valid in a misspecified linear model. We point out some confusions of Sarkar and show additional conditions under which his assertion holds.     

部分线性模型的随机约束岭估计

研究了部分线性回归模型附加有随机约束条件时的估计问题.基于Profile最小二乘方法和混合估计方法提出了参数分量随机约束下的Profile混合估计,并研究了其性质.为了克服共线性问题,构造了参数分量的Profile混合岭估计,并给出了估计量的偏和方差.     

受约束回归模型参数的统一几乎无偏估计

考虑实际回归问题中存在更多受约束条件的情况,提出了带约束的统一几乎无偏估计类,统一了常见的具有线性约束的回归模型的几乎无偏估计,进一步的研究给出了在均方误差和均方误差矩阵意义下,带约束的统一几乎无偏估计优于一般带约束的最小二乘估计的充分条件和椭球范围.     

Minimax multivariate empirical Bayes estimators under multicollinearity

In this paper we consider the problem of estimating the matrix of regression coefficients in a multivariate linear regression model in which the design matrix is near singular. Under the assumption of normality, we propose empirical Bayes ridge regression estimators with three types of shrinkage functions, that is, scalar, componentwise and matricial shrinkage. These proposed estimators are proved to be uniformly better than the least squares estimator, that is, minimax in terms of risk under the Strawderman's loss function. Through simulation and empirical studies, they are also shown to be useful in the multicollinearity cases.     

Convergence rate of the best-r-point-average estimator for the maximizer of a nonparametric regression function

The best-r-point-average (BRPA) estimator of the maximizer of a regression function, proposed in Changchien (in: M.T. Chao, P.E. Cheng (Eds.), Proceedings of the 1990 Taipei Symposium in Statistics, June 28–30, 1990, pp. 63–78) has certain merits over the estimators derived through the estimation of the regression function. Some of the properties of the BRPA estimator have been studied in Chen et al. (J. Multivariate Anal. 57 (1996) 191) and Bai and Huang (Sankhya: Indian J. Statist. Ser. A. 61 (Pt. 2) (1999) 208–217). In this article, we further study the properties of the BRPA estimator and give its convergence rate under some quite general conditions. Simulation results are presented for the illustration of the convergence rate. Some comparisons with existing estimators such as the Müller estimator are provided.     

Improved ridge regression estimators for the logistic regression model

The estimation of the regression parameters for the ill-conditioned logistic regression model is considered in this paper. We proposed five ridge regression (RR) estimators, namely, unrestricted RR, restricted ridge regression, preliminary test RR, shrinkage ridge regression and positive rule RR estimators for estimating the parameters $(\beta )$ when it is suspected that the parameter $\beta $ may belong to a linear subspace defined by $H\beta =h$ . Asymptotic properties of the estimators are studied with respect to quadratic risks. The performances of the proposed estimators are compared based on the quadratic bias and risk functions under both null and alternative hypotheses, which specify certain restrictions on the regression parameters. The conditions of superiority of the proposed estimators for departure and ridge parameters are given. Some graphical representations and efficiency analysis have been presented which support the findings of the paper.     

Estimation of a Location Parameter with Restrictions or “vague information” for Spherically Symmetric Distributions

In this article we consider estimating a location parameter of a spherically symmetric distribution under restrictions on the parameter. First we consider a general theory for estimation on polyhedral cones which includes examples such as ordered parameters and general linear inequality restrictions. Next, we extend the theory to cones with piecewise smooth boundaries. Finally we consider shrinkage toward a closed convex set K where one has vague prior information that θ is in K but where θ is not restricted to be in K. In this latter case we give estimators which improve on the usual unbiased estimator while in the restricted parameter case we give estimators which improve on the projection onto the cone of the unbiased estimator. The class of estimators is somewhat non-standard as the nature of the constraint set may preclude weakly differentiable shrinkage functions. The technique of proof is novel in the sense that we first deduce the improvement results for the normal location problem and then extend them to the general spherically symmetric case by combining arguments about uniform distributions on the spheres, conditioning and completeness.     

Stein's phenomenon in estimation of means restricted to a polyhedral convex cone

This paper treats the problem of estimating the restricted means of normal distributions with a known variance, where the means are restricted to a polyhedral convex cone which includes various restrictions such as positive orthant, simple order, tree order and umbrella order restrictions. In the context of the simultaneous estimation of the restricted means, it is of great interest to investigate decision-theoretic properties of the generalized Bayes estimator against the uniform prior distribution over the polyhedral convex cone. In this paper, the generalized Bayes estimator is shown to be minimax. It is also proved that it is admissible in the one- or two-dimensional case, but is improved on by a shrinkage estimator in the three- or more-dimensional case. This means that the so-called Stein phenomenon on the minimax generalized Bayes estimator can be extended to the case where the means are restricted to the polyhedral convex cone. The risk behaviors of the estimators are investigated through Monte Carlo simulation, and it is revealed that the shrinkage estimator has a substantial risk reduction.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

带线性约束的回归模型参数的Liu估计方法

针对一般带约束的最小二乘估计(ORLSE)在参数估计中处理复共线性的不足,通过引入附加随机线性约束,提出了约束Liu型估计方法.经理论证明,此方法在均方误差下较已经提出的ORLSE和约束岭估计(RRE)效果更好,并且它可以作为两种方法的推广形式.讨论了其中k, d的确定原则,并将此方法推广到了广义形式和典则形式下的估计公式.     

Positive shrinkage, improved pretest and absolute penalty estimators in partially linear models

Shrinkage estimators of a partially linear regression parameter vector are constructed by shrinking estimators in the direction of the estimate which is appropriate when the regression parameters are restricted to a linear subspace. We investigate the asymptotic properties of positive Stein-type and improved pretest semiparametric estimators under quadratic loss. Under an asymptotic distributional quadratic risk criterion, their relative dominance picture is explored analytically. It is shown that positive Stein-type semiparametric estimators perform better than the usual Stein-type and least square semiparametric estimators and that an improved pretest semiparametric estimator is superior to the usual pretest semiparametric estimator. We also consider an absolute penalty type estimator for partially linear models and give a Monte Carlo simulation comparisons of positive shrinkage, improved pretest and the absolute penalty type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty type estimation method when the dimension of the parameter space is much larger than that of the linear subspace.     

正态线性模型中随机回归系数和参数的Minimax估计

该文在一般正态随机效应线性模型中研究了随机回归系数和参数的估计问题. 在二次损失下，得到了线性可估函数在一切估计类中的唯一Minimax估计.     

线性模型中的一类随机约束$s$--$K$估计

In this paper, we propose a stochastic restricted s–K estimator in the linear model with additional stochastic linear restrictions by combining the ordinary mixed estimator(OME) with the s–K estimator. It is shown that the proposed estimator is superior to the OME and the s–K estimator under the mean squared error matrix criterion under some conditions. Finally, a numerical example and a Monte Carlo simulation study are given to verify the theoretical results.     

变系数部分线性模型的加权随机约束s-K估计

研究随机约束条件下半参数变系数部分线性模型的参数估计问题,当回归模型线性部分变量存在多重共线性时,基于Profile最小二乘方法、s-K估计和加权混合估计构造参数向量的加权随机约束s-K估计,并在均方误差矩阵准则下给出新估计量优于s-K估计和加权混合估计的充要条件,最后通过蒙特卡洛数值模拟验证所提出估计量的有限样本性质.     

多元协方差阵扰动模型岭估计的影响分析

本文研究了多元线性同归模型岭估计的影响分析问题.利用最小二乘估计方法,获得了多元协方差阵扰动模型与原模型参数阵之间的岭估计的一些关系式,给出了度量影响大小的基于岭估计的广义Cook距离.     

Asymptotic theory of simultaneous estimation of Poisson means

The Poisson distribution is often a good approximation to the underlying sampling distribution and is central to the study of categorical data. In this paper, we propose a new unified approach to an investigation of point properties of simultaneous estimations of Poisson population parameters with general quadratic loss functions. The main accent is made on the shrinkage estimation. We build a series of estimators that could be represented as a convex combination of linear statistics such as maximum likelihood estimator (benchmark estimator), restricted estimator, composite estimator, preliminary test estimator, shrinkage estimator, positive rule shrinkage estimator (James-Stein type estimator). All these estimators are represented in a general integrated estimation approach, which allows us to unify our investigation and order them with respect to the risk. A simulation study with numerical and graphical results is conducted to illustrate the properties of the investigated estimators.     

基于轮换样本连续性调查的校准组合估计方法研究

校准估计是抽样调查中比较常用的一种利用辅助信息提高估计量精度的方法。回归组合估计量作为轮换样本连续性调查中使用的一种有效的估计量,是可以通过校准程序得到的。基于回归组合估计量和校准程序之间的关系,本文提出了轮换样本连续性抽样调查条件下的不同校准组合估计量及其方差估计。校准组合估计量的主要思想是在校准估计程序中将拼配样本和非拼配样本的辅助信息进行不同的组合利用。本文利用美国现时人口调查的微观数据进行数值模拟,来比较不同校准组合估计量的估计效率,模拟结果表明两步校准组合估计量和两步校准双组合估计量的表现相似,且估计精度都高于H-T估计量及回归组合估计量;而两步校准组合估计量由于其简便性更适合应用于实践中。最后以我国农村住户连续性抽样调查为例,设计一套符合我国实际的轮换样本连续性调查方案,并将提出的校准组合估计量运用于估计阶段,为中国政府统计调查提供一定的借鉴和参考.     

Asymptotic distributions of robust shape matrices and scales

It has been frequently observed in the literature that many multivariate statistical methods require the covariance or dispersion matrix Σ of an elliptical distribution only up to some scaling constant. If the topic of interest is not the scale but only the shape of the elliptical distribution, it is not meaningful to focus on the asymptotic distribution of an estimator for Σ or another matrix Γ∝Σ. In the present work, robust estimators for the shape matrix and the associated scale are investigated. Explicit expressions for their joint asymptotic distributions are derived. It turns out that if the joint asymptotic distribution is normal, the estimators presented are asymptotically independent for one and only one specific choice of the scale function. If it is non-normal (this holds for example if the estimators for the shape matrix and scale are based on the minimum volume ellipsoid estimator) only the scale function presented leads to asymptotically uncorrelated estimators. This is a generalization of a result obtained by Paindaveine [D. Paindaveine, A canonical definition of shape, Statistics and Probability Letters 78 (2008) 2240-2247] in the context of local asymptotic normality theory.     

Asymptotic properties of a maximum likelihood estimator with data from a Gaussian process

We consider an estimation problem with observations from a Gaussian process. The problem arises from a stochastic process modeling of computer experiments proposed recently by Sacks, Schiller, and Welch. By establishing various representations and approximations to the corresponding log-likelihood function, we show that the maximum likelihood estimator of the identifiable parameter θσ² is strongly consistent and converges weakly (when normalized by √n) to a normal random variable, whose variance does not depend on the selection of sample points. Some extensions to regression models are also obtained.     

Modifying estimators of ordered positive parameters under the Stein loss

This paper treats the problem of estimating positive parameters restricted to a polyhedral convex cone which includes typical order restrictions, such as simple order, tree order and umbrella order restrictions. In this paper, two methods are used to show the improvement of order-preserving estimators over crude non-order-preserving estimators without any assumption on underlying distributions. One is to use Fenchel’s duality theorem, and then the superiority of the isotonic regression estimator is established under the general restriction to polyhedral convex cones. The use of the Abel identity is the other method, and we can derive a class of improved estimators which includes order-statistics-based estimators in the typical order restrictions. When the underlying distributions are scale families, the unbiased estimators and their order-restricted estimators are shown to be minimax. The minimaxity of the restrictedly generalized Bayes estimator against the prior over the restricted space is also demonstrated in the two dimensional case. Finally, some examples and multivariate extensions are given.