独立约束条件下线性模型的参数估计

对线性回归的未知参数估计问题,在某些种假设的条件下已有结论,对有约束条件的情况下,线性回归模型中参数估计如何,本文给出了带有独立的约束条件下线性回归模型中参数β的最小二乘估计。     

部分线性变系数模型改进的加权混合Profile-Liu估计

研究半参数部分线性变系数模型的有偏估计,当回归模型参数部分自变量存在多重共线性时,在随机线性约束条件下,融合Profile最小二乘估计、加权混合估计和Liu估计构造回归模型参数分量改进的加权混合Profile-Liu估计,并在一定正则条件下证明估计量的渐近性质,最后利用蒙特卡洛数值模拟验证所提出估计量的有限样本表现性.     

部分线性模型的随机约束岭估计

研究了部分线性回归模型附加有随机约束条件时的估计问题.基于Profile最小二乘方法和混合估计方法提出了参数分量随机约束下的Profile混合估计,并研究了其性质.为了克服共线性问题,构造了参数分量的Profile混合岭估计,并给出了估计量的偏和方差.     

约束线性模型的条件部分根方估计

对于线性约束下的线性回归模型,针对设计矩阵的病态问题,提出一种条件部分根方估计.并在均方误差矩阵准则和Pitman Closeness准则下,比较了条件部分根方估计相对于约束最小二乘估计的优良性.     

纵向数据半参数回归模型的估计方法

本文考虑纵向数据半参数回归模型,通过考虑纵向数据的协方差结构,基于Profile最小二乘法和局部线性拟合的方法建立了模型中参数分量、回归函数和误差方差的估计量,来提高估计的有效性,在适当条件下给出了这些估计量的相合性.并通过模拟研究将该方法与最小二乘局部线性拟合估计方法进行了比较,表明了Profile最小二乘局部线性拟合方法在有限样本情况下具有良好的性质.     

变系数部分线性模型的加权随机约束s-K估计

研究随机约束条件下半参数变系数部分线性模型的参数估计问题,当回归模型线性部分变量存在多重共线性时,基于Profile最小二乘方法、s-K估计和加权混合估计构造参数向量的加权随机约束s-K估计,并在均方误差矩阵准则下给出新估计量优于s-K估计和加权混合估计的充要条件,最后通过蒙特卡洛数值模拟验证所提出估计量的有限样本性质.     

线性模型参数向量的近似贝叶斯估计

用线性贝叶斯方法去同时估计线性模型中回归系数和误差方差,并在不知道先验分布具体形式的情况下,得到了线性贝叶斯估计的表达式.在均方误差矩阵准则下,证明了其优于最小二乘估计和极大似然估计.与利用MCMC算法得到的贝叶斯估计相比,线性贝叶斯估计具有显式表达式并且更方便使用.对于几种不同的先验分布,数值模拟结果表明线性贝叶斯估...     

约束Welsch—Kuh统计量与约束Cook距离

本文讨论线性回归模型中约束条件下最小二乘估计的影响问题,利用约束下的Welsch-Kuh统计量研讨了剔除第i组数据(x＇_4,y_4)后,对x_i和x_y处拟合值的影响,另又用Cook统计量讨论了第i组数据对约束最小二乘估计的影响。     

NA样本半参数回归模型估计的矩相合性

考虑了误差为NA序列的半参数回归模型,利用非参数估计方法给出了模型参数的最小二乘估计和加权最小二乘估计,并在适当条件下得到了它们的矩相合性.     

部分线性变系数模型的随机约束岭估计

作为变系数模型和部分线性模型的推广,部分线性变系数模型近年来得到越来越多的关注.本文考虑该模型在线性部分自变量存在多重共线性并且参数分量附加有随机约束条件时的估计问题.基于profile最小二乘技术以及岭估计和混合估计方法,构造参数分量的profile混合岭估计,并且研究所提估计量的渐近性质.最后利用数值模拟验证所提估计方法的有效性.     

Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density

In the context of semi-functional partial linear regression model, we study the problem of error density estimation. The unknown error density is approximated by a mixture of Gaussian densities with means being the individual residuals, and variance a constant parameter. This mixture error density has a form of a kernel density estimator of residuals, where the regression function, consisting of parametric and nonparametric components, is estimated by the ordinary least squares and functional Nadaraya–Watson estimators. The estimation accuracy of the ordinary least squares and functional Nadaraya–Watson estimators jointly depends on the same bandwidth parameter. A Bayesian approach is proposed to simultaneously estimate the bandwidths in the kernel-form error density and in the regression function. Under the kernel-form error density, we derive a kernel likelihood and posterior for the bandwidth parameters. For estimating the regression function and error density, a series of simulation studies show that the Bayesian approach yields better accuracy than the benchmark functional cross validation. Illustrated by a spectroscopy data set, we found that the Bayesian approach gives better point forecast accuracy of the regression function than the functional cross validation, and it is capable of producing prediction intervals nonparametrically.     

纵向数据边际模型非参数光滑方法的比较

对于纵向数据边际模型的均值函数, 有很多非参数估计方法, 其中回归样条, 光滑样条, 似乎不相关(SUR)核估计等方法在工作协方差阵正确指定时具有最小的渐近方差. 回归样条的渐近偏差与工作协方差阵无关, 而SUR核估计和光滑样条估计的渐近偏差却依赖于工作协方差阵. 本文主要研究了回归样条, 光滑样条和SUR核估计的效率问题. 通过模拟比较发现回归样条估计的表现比较稳定, 在大多数情况下比光滑样条估计和SUR核估计的效率高.     

Multivariate Locally Weighted Polynomial Fitting and Partial Derivative Estimation

Nonparametric regression estimator based on locally weighted least squares fitting has been studied by Fan and Ruppert and Wand. The latter paper also studies, in the univariate case, nonparametric derivative estimators given by a locally weighted polynomial fitting. Compared with traditional kernel estimators, these estimators are often of simpler form and possess some better properties. In this paper, we develop current work on locally weighted regression and generalize locally weighted polynomial fitting to the estimation of partial derivatives in a multivariate regression context. Specifically, for both the regression and partial derivative estimators we prove joint asymptotic normality and derive explicit asymptotic expansions for their conditional bias and conditional convariance matrix (given observations of predictor variables) in each of the two important cases of local linear fit and local quadratic fit.     

The superiorities of bayes linear unbiased estimator in multivariate linear models

In this article,the Bayes linear unbiased estimator (BALUE) of parameters is derived for the multivariate linear models.The superiorities of the BALUE over the least square estimator (LSE) is studied in terms of the mean square error matrix (MSEM) criterion and Bayesian Pitman closeness (PC) criterion.     

Stahel-Donoho kernel estimation for fixed design nonparametric regression models

This paper reports a robust kernel estimation for fixed design nonparametric regression models. A Stahel-Donoho kernel estimation is introduced, in which the weight functions depend on both the depths of data and the distances between the design points and the estimation points. Based on a local approximation, a computational technique is given to approximate to the incomputable depths of the errors. As a result the new estimator is computationally efficient. The proposed estimator attains a high breakdown point and has perfect asymptotic behaviors such as the asymptotic normality and convergence in the mean squared error. Unlike the depth-weighted estimator for parametric regression models, this depth-weighted nonparametric estimator has a simple variance structure and then we can compare its efficiency with the original one. Some simulations show that the new method can smooth the regression estimation and achieve some desirable balances between robustness and efficiency.     

Linear Least Squares Estimation of Regression Models for Two-Dimensional Random Fields

We consider the problem of estimating regression models of two-dimensional random fields. Asymptotic properties of the least squares estimator of the linear regression coefficients are studied for the case where the disturbance is a homogeneous random field with an absolutely continuous spectral distribution and a positive and piecewise continuous spectral density. We obtain necessary and sufficient conditions on the regression sequences such that a linear estimator of the regression coefficients is asymptotically unbiased and mean square consistent. For such regression sequences the asymptotic covariance matrix of the linear least squares estimator of the regression coefficients is derived.     

Spectral methods in linear minimax estimation

We consider the minimax-linear estimator in a linear regression model with circular constraints. Two necessary and sufficient conditions for the optimality of an estimator, the socalled left spectral equation and the right spectral equation (Girko spectral equation), are derived. For the special case of a simple maximal eigenvalue and a single eigenspace explicit estimation formulas are derived. These formulas also show some of the shortcomings of the minimax-linear estimator (MILE). Finally, the relation with Bayesian analysis and the Hoffmann-Läuter estimator is outlined.     

Principes de déviations modérées pour des modèles autorégressifs d'ordre p

We establish Moderate deviations principles (MDP) for some stable autoregressive models of order p: first for continuous unbounded additive functionnals of this process, second for the estimation error of the regression function (least-squares estimator in the stable linear case, kernel estimator in the Lipschitz non-linear case).     

回归系数的广义根方估计及其模拟

文献[1,2]中提出了回归系数的根方估计~(k),当回归自变量间存在复共线关系时,~(k)较回归系数的最小二乘估计有所改善,本文将根方估计作一拓广,得出了回归系数的广义根方估计~(K),其中K为对角阵,文中证明了广义根方估计~(K)较~(k)能更有效地改善最小二乘估计,并给出了广义根方估计的显式解,在此基础上,提出了广义根方估计的显式解和一种确定k_i的方法。