回归系数的stein型主成分估计

对于设计阵Ｘ呈病态的线性回归模型，本文提出了一种新的关于回归系数的有偏估计─ｓｔｅｉｎ型主成分估计，并在均方误差意义下，论证了在一定条件下ｓｔｅｉｎ型主成分估计优于主成分估计，因此也优于ｓｔｅｉｎ型ＯＬＳ估计与ＯＬＳ估计，最后，我们又对偏参数的存在性，最优性进行了讨论，并得出了一些重要结论．     

主成分估计的一个性质

本文使用矩阵的奇异值分解技术，得到了主成分估计的两个表达式，在此基础上，证明了主成分估计的一个性质。     

多元线性模型参数的组合主成分估计

本文对多元线性模型的参数β=vec（B）提出了一种新的主成分估计─—组合主成分估计β，得到了它的一些良好的性质，证明了在均方误差准则下，在一定的条件下，此估计优于最小二乘估计（LSE），并给出了实例．     

非主成份与广义岭型估计

针对线性回归模型Y=Xp e,e～(0,σ2I)在设计矩阵X呈病态(存在复共线性关系)时,从主成分估计的思想出发,结合岭估计减少均方误差的方法,提出并推导了一类新的估计β(k)=(X'X Φx2kΦ'2)-1X'Y,称之为广义岭型估计.优点是只对主成分和非主成分添加两个不同的常数,均方误差大幅度降低的同时,相对于一般的广义岭估计,计算量减少,相对于主成分估计,便于对原变量做出解释.文中进一步讨论了该估计与主成分估计和岭估计的优劣.     

岭型主成分估计的最小方差和

讨论了岭型主成分估计在一类降维估计中的方差性质，证明了在一定条件下岭型主成分估计的方差和最小．文「１」的结果是本文的特例。     

高维稳健主成分聚类方法及其应用研究

随着信息技术的高速发展,每条数据所包含的信息越来越丰富,使得数据不可避免地含有异常值,且随着维数的增加,异常值出现的可能性更大。传统的主成分聚类分析对异常值特別敏感,基于MCD估计的主成分聚类方法虽然对异常值具有防御作用,但是在高维数据下MCD估计的偏差过大,其稳健性显著降低,而且当维数大于观测值个数时MCD估计失效。为此本文提出了基于MRCD估计的稳健主成分聚类方法,数值模拟和实证分析表明,基于MRCD估计的主成分聚类分析的效果优于传统的主成分聚类分析和基于MCD估计的主成分聚类分析,尤其是在维数大于样本观测值的情况下,MRCD估计更为有效。     

岭型主成分估计的最优性

本文研究岭型主成分估计的回归最优性。证明了岭型降维估计类中，岭型主成分估计具有Φq^0最小、E－最小和D－最小性，且协方差阵的正交不变范数最小，推广了[2]中某些结果。     

岭型组合主成分估计

本文提出了回归系数的一种新的改进估计－岭型组合主成分估计，讨论了它的可容许性，约束条件下的可容许性和相合性问题，分别在均方误差意义下和Ｐｉｔｍａｎ接近原则下，证明了在一定条件下，它优于最二乘估计和岭估计，并且证明了它有比它们更好的抗干扰能力和稳健性。     

主成分估计的最优性

一、引言 自从Hotelling从概率结构引进主成分概念之后,主成分估计受到了统计工作者的广泛重视.它已成为多元分析中减少数据维数的有效工具.许多人从不同角度研究了主成分的最优性质.但是,这些性质都是关于协方差阵的.本文力图从更能反映一个估     

单参数主成分回归估计

对于线性回归模型,本文提出了回归系数的一种单参数主成分估计,证明了它的可容许性、抗干扰性、有效性等主要性质。     

半变系数模型约束PLS估计的渐近正态性

变系数模型已获得了广泛的应用,半变系数模型是变系数模型的有效推广,本文给出半变系数模型在线性约束条件下的PLS估计,并证明了常系数和函数系数估计的渐近正态性.     

关于James-Stein估计的小样本性质

首先给出了Jam es-S te in估计优于岭估计的充分条件,随后在P itm an准则下给出了Jam es-S te in估计优于最小二乘估计的简短证明.     

COMPARISON OF TWO MODELS AND TWO ESTIMATION METHODS FOR CATCH AND EFFORT DATA

We consider the problem of estimating the optimal steady effort level from a time series of catch and effort data, taking account of errors in the observation of the “effective effort” as well as randomness in the stock-production function. The “total least squares” method ignores the time series nature of the data, while the “approximate likelihood” method takes it into account. We compare estimation schemes based upon these two methods by applying them to artificial data for which the “correct” parameters are known. We use a similar procedure to compare the effectiveness of a “power model” for stock and production with the “Ricker model.” We apply these estimation methods to some sets of real data, and obtain an interval estimate of the optimal effort.     

泛最小二乘法的改进及其容许性

考虑线性回归模型,当设计阵呈病态或秩亏时,我们用泛最小二乘法给出参数的估计,并证明其容许性;然后针对泛最小二乘估计对最小二乘估计过度压缩的缺点加以改进,使之更合理,有效.     

Minimax estimation and the least squares method

This paper is devoted to the problem of minimax estimation of parameters in linear regression models with uncertain second order statistics. The solution to the problem is shown to be the least squares estimator corresponding to the least favourable matrix of the second moments. This allows us to construct a new algorithm for minimax estimation closely connected with the least squares method. As an example, we consider the problem of polynomial regression introduced by A. N. Kolmogorov     

部分线性变系数模型改进的加权混合Profile-Liu估计

研究半参数部分线性变系数模型的有偏估计,当回归模型参数部分自变量存在多重共线性时,在随机线性约束条件下,融合Profile最小二乘估计、加权混合估计和Liu估计构造回归模型参数分量改进的加权混合Profile-Liu估计,并在一定正则条件下证明估计量的渐近性质,最后利用蒙特卡洛数值模拟验证所提出估计量的有限样本表现性.     

Parameter and state estimation algorithm for single-input single-output linear systems using the canonical state space models

This paper presents a new parameter and state estimation algorithm for single-input single-output systems based on canonical state space models from the given input–output data. Difficulties of identification for state space models lie in that there exist unknown noise terms in the formation vector and unknown state variables. By means of the hierarchical identification principle, those noise terms in the information vector are replaced with the estimated residuals and a new least squares algorithm is proposed for parameter estimation and the system states are computed by using the estimated parameters. Finally, an example is provided.     

On the Convergence of the Generalized Linear Least Squares Algorithm

This paper considers the issue of parameter estimation for biomedical applications using nonuniformly sampled data. The generalized linear least squares (GLLS) algorithm, first introduced by Feng and Ho (1993), is used in the medical imaging community for removal of bias when the data defining the model are correlated. GLLS provides an efficient iterative linear algorithm for the solution of the non linear parameter estimation problem. This paper presents a theoretical discussion of GLLS and introduces use of both Gauss Newton and an alternating Gauss Newton for solution of the parameter estimation problem in nonlinear form. Numerical examples are presented to contrast the algorithms and emphasize aspects of the theoretical discussion. AMS subject classification (2000) 65F10.R. A. Renaut: This work was partially supported by the Arizona Center for Alzheimer’s Disease Research, by NIH grant EB 2553301 and for the second author by NSF CMG-02223.Received December 2003. Revised November 2004. Communicated by Lars Eldén.     

Outlier Mining Based on Principal Component Estimation

Outlier mining is an important aspect in data mining and the outlier mining based on Cook distance is most commonly used. But we know that when the data have multicoUinearity, the traditional Cook method is no longer effective. Considering the excellence of the principal component estimation, we use it to substitute the least squares estimation, and then give the Cook distance measurement based on principal component estimation, which can be used in outlier mining. At the same time, we have done some research on related theories and application problems.