Iterative Weighted Semiparametric Least Squares Estimation in Repeated Measurement Partially Linear Regression Models

Consider a repeated measurement partially linear regression model with an unknown vector parameter β, an unknown function g(.), and unknown heteroscedastic error variances. In order to improve the semiparametric generalized least squares estimator (SGLSE) of β, we propose an iterative weighted semiparametric least squares estimator (IWSLSE) and show that it improves upon the SGLSE in terms of asymptotic covariance matrix. An adaptive procedure is given to determine the number of iterations. We also show that when the number of replicates is less than or equal to two, the IWSLSE can not improve upon the SGLSE. These results are generalizations of those in [2] to the case of semiparametric regressions.     

删失数据下线性回归模型的参数估计

主要叙述在数据观测不完全的情况下,采用最小二乘法对线性回归模型回归系数的估计及估计量的渐进性质,并给出数据模拟．     

On the Convergence of the Generalized Linear Least Squares Algorithm

This paper considers the issue of parameter estimation for biomedical applications using nonuniformly sampled data. The generalized linear least squares (GLLS) algorithm, first introduced by Feng and Ho (1993), is used in the medical imaging community for removal of bias when the data defining the model are correlated. GLLS provides an efficient iterative linear algorithm for the solution of the non linear parameter estimation problem. This paper presents a theoretical discussion of GLLS and introduces use of both Gauss Newton and an alternating Gauss Newton for solution of the parameter estimation problem in nonlinear form. Numerical examples are presented to contrast the algorithms and emphasize aspects of the theoretical discussion. AMS subject classification (2000) 65F10.R. A. Renaut: This work was partially supported by the Arizona Center for Alzheimer’s Disease Research, by NIH grant EB 2553301 and for the second author by NSF CMG-02223.Received December 2003. Revised November 2004. Communicated by Lars Eldén.     

线性模型中加权混合估计相对于最小二乘估计的两种相对效率

本文提出了线性模型中加权混合估计相对于最小二乘估计的两种相对效率,并给出了这些相对效率的上下界.     

偏最小二乘回归的应用效果分析

本文介绍了偏最小二乘回归 (PLS)的建模方法 ,比较了PLS与普通最小二乘回归 (OLS)及主成分回归的应用效果 ,并总结了PLS回归的基本特点 .     

拟线性回归预测模型的稳定最小二乘解

可线性化回归预测模型通过换元进行线性回归,换元前后的因变量具有异方差性,致使拟线性回归参数的精度较低.运用GL算法给出了此类模型的稳定最小二乘解,提高了参数的估计精度,最后给出了一个应用实例.     

模糊线性回归模型的约束最小二乘估计

自Tanaka等1982年提出模糊回归概念以来,该问题已得到广泛的研究。作为主要估计方法之一的模糊最小二乘估计以其与统计最小二乘估计的密切联系更受到人们的重视。本文依据适当定义的两个模糊数之间的距离,提出了模糊线性回归模型的一个约束最小二乘估计方法,该方法不仅能使估计的模糊参数的宽度具有非负性而且估计的模糊参数的中心线与传统的最小二乘估计相一致。最后,通过数值例子说明了所提方法的具体应用。     

Implicit Scaling of Linear Least Squares Problems

We consider the solution of weighted linear least squares problems by Householder transformations with implicit scaling, that is, with the weights stored separately. By holding inverse weights, the constrained case can be accommodated. The error analysis of the weighted and unconstrained case is readily extended and we show that iterative refinement may be applied.     

正交回归和一般最小二乘回归的几何误差分析

线性回归分析中,一般最小二乘回归的目标函数只考虑一个方向的扰动,采用基于几何距离的正交回归能克服固定单方向最优带来的拟合稳定性差的弊端。本文分析和比较了正交回归和一般最小二乘回归的误差,并定量地给出了两者的几何误差与原始数据的方差、相关系数之间的关系,指出正交回归的几何误差小于一般最小二乘回归,并且正交回归具有旋转不变性。最后,以平面直线拟合为例验证了这个结论。     

求解加权线性最小二乘问题的预处理迭代方法

给出了求解一类加权线性最小二乘问题的预处理迭代方法,也就是预处理的广义加速超松弛方法（GAOR）,得到了一些收敛和比较结果．比较结果表明当原来的迭代方法收敛时,预处理迭代方法会比原来的方法具有更好的收敛率．而且,通过数值算例也验证了新预处理迭代方法的有效性．     

纵向数据半参数回归模型的最小二乘局部线性估计

本文考虑纵向数据半参数回归模型:Yij=XiTjβ+g(Tij)+iεj,基于最小二乘法和局部线性拟合的方法建立了模型中参数分量β,回归函数g(.)和误差方差σ2的估计,在适当条件下给出了估计量的相合性,通过模拟研究说明了该方法在有限样本情况下具有良好的性质。     

不等式约束条件下部分线性回归模型的参数估计

本文研究了不等式约束条件下部分线性回归模型的参数估计问题，利用最优化方法和贝叶斯方法，给出了不等式约束条件下部分线性回归模型的最小二乘核估计和最佳贝叶斯估计，并且证明了在一定条件下，带约束条件的最小二乘核估计在均方误差意义下要优于无约束条件的最小二乘核估计。     

Infill Asymptotics Inside Increasing Domains for the Least Squares Estimator in Linear Models

A linear model observed in a spatial domain is considered. Consistency and asymptotic normality of the least squares estimator is proved when the observations become dense in a sequence of increasing domains and the error terms are weakly dependent. Similar statements are obtained for the linear errors-in-variables model. This revised version was published online in June 2006 with corrections to the Cover Date.     

对部分线性模型用惩罚最小二乘估计时最优光滑化的注记

部分线性模型也就是响应变量关于一个或者多个协变量是线性的, 但对于其他的协变量是非线性的关系\bd 对于部分线性模型中的参数和非参数部分的估计方法, 惩罚最小二乘估计是重要的估计方法之一\bd 对于这种估计方法, 广义交叉验证法提供了一种确定光滑参数的方法\bd 但是, 在部分线性模型中, 用广义交叉验证法确定光滑参数的最优性还没有被证明\bd 本文证明了利用惩罚最小二乘估计对于部分线性模型估计时, 用广义交叉验证法选择光滑参数的最优性\bd 通过模拟验证了本文中所提出的用广义交叉验证法选择光滑参数具有很好的效果, 同时, 本文在模拟部分比较了广义交叉验证和最小二乘交叉验证的优劣.     

非参数局部多项式回归估计的最优子抽样算法

随着科学技术的发展,虽然人们提高了收集和处理数据的能力,但仍存在一些大数据集超出了现有计算机的计算能力.目前,抽取一部分样本来替代全样本进行建模计算是减轻计算负担的一种方法.大数据背景下线性模型的子抽样方法已经得到了相对成熟的研究,在减轻计算量方面获得了很大的优势.文章将线性模型下的子抽样方法推广到非参数回归模型,并推...     

Least Absolute Deviation Estimation for Regression with ARMA Errors

The asymptotic normality for least absolute deviation estimates of the parameters in a linear regression model with autoregressive moving average errors is established under very general conditions. The method of proof is based on a functional limit theorem for the LAD objective function.     

On Least Squares Estimation for Stable Nonlinear AR Processes

Following a Markov chain approach, this paper establishes asymptotic properties of the least squares estimator in nonlinear autoregressive (NAR) models. Based on conditions ensuring the stability of the model and allowing the use of a strong law of large number for a wide class of functions, our approach improves some known results on strong consistency and asymptotic normality of the estimator. The exact convergence rate is established by a law of the iterated logarithm. Based on this law and a generalized Akaike's information criterion, we build a strongly consistent procedure for selection of NAR models. Detailed results are given for familiar nonlinear AR models like exponential AR models, threshold models or multilayer feedforward perceptions.     

Computation of Optimal Backward Perturbation Bounds for Large Sparse Linear Least Squares Problems

In this note we propose an algorithm based on the Lanczos bidiagonalization to approximate the backward perturbation bound for the large sparse linear squares problem. The algorithm requires ((m + n)l) operations where m and n are the size of the matrix under consideration and l <#60;<#60; min(m,n). The import of the proposed algorithm is illustrated by some examples coming from the Harwell-Boeing collection of test matrices.This revised version was published online in October 2005 with corrections to the Cover Date.     

��Ⱦ�������Իع�ģ�͵���Сһ�˹���

In this paper, linear regression models with contaminated data are considered. Estimation methods for the regression parameters based on least absolute deviations (LAD) are proposed, and properties of consistency and asymptotic normality of the proposed method are proved under some regular conditions. Simulations are done to assess the properties of the method when sample size is small, and simulation results show that the methods works well.     

多元线性模型参数的部分压缩估计

考虑多元线性回归模型Y=XB ε,其中E(Vec(ε))=0,Cov(Vec(ε))=∑In,当设计阵X呈病态时,模型参数的LS估计不再是一个优良估计,为此,提出了一种部分压缩估计,并分析了其性质.