残差自回归半参数模型的参数估计

研究了残差自回归半参数模型的参数估计,运用广义最小二乘法估计了参数部分．用随机模拟说明了运用广义最小二乘（GLSE）估计出的参数部分优于运用普通最小二乘法（OKSE）得到的估计．     

纵向数据半参数回归模型的估计方法

本文考虑纵向数据半参数回归模型,通过考虑纵向数据的协方差结构,基于Profile最小二乘法和局部线性拟合的方法建立了模型中参数分量、回归函数和误差方差的估计量,来提高估计的有效性,在适当条件下给出了这些估计量的相合性.并通过模拟研究将该方法与最小二乘局部线性拟合估计方法进行了比较,表明了Profile最小二乘局部线性拟合方法在有限样本情况下具有良好的性质.     

变系数线性结构关系EV模型的参数估计

利用加权正交回归最小二乘法给出了变系数一维线性结构关系EV模型中的参数 估计,证明了估计的弱相合性和强相合性.     

基于异方差的自回归预测模型的参数估计及其应用

从齐性方差的线性回归模型参数估计的最小二乘法出发,通过对统计资料的适当变换,利用加权最小二乘法,获得了异方差的线性自回归模型和四种异方差的非线性自回归模型的参数估计公式,并举例阐述了估计公式的应用.     

基于众数回归的变系数部分非线性模型的稳健估计

针对变系数部分非线性模型,提出了一种稳健的基于众数回归的两阶段估计方法.首先,基于B-样条函数近似系数函数,利用QR正交分解技术构造了非线性模型,得到了参数的非线性最小二乘估计.其次,提出了变系数函数的众数回归估计量.在一定条件下,证明了估计量的渐近性质.通过数值模拟和实际数据分析,说明了所提估计方法的有效性.     

非线性E-V回归模型中参数估计的渐近性质

本文讨论了非线性E-V回归模型中参数的估计问题,构造了未知参数β0的最小二乘估计β和误差方差σ2的估计σ2,证明了β具有渐近正态性,同时也证明了σ2依概率收敛于σ2的速度可达到n-1/2.     

半参数回归模型的一类压缩估计

研究了半参数回归模型的参数估计问题,利用压缩估计方法给出了模型的一类有偏估计,并与最小二乘估计、岭估计、几乎无偏岭估计进行了比较.在均方误差意义下,新的压缩估计明显优于最小二乘估计.最后讨论了有偏参数选取的问题.     

非线性E-V回归模型中参数估计的渐近性质

本文讨论了非线性E-V回归模型中参数的估计问题,构造了未知参数β0的最小二乘估计β和误差方差σ2的估计σ2,证明了β具有渐近正态性,同时也证明了σ2依概率收敛于σ2的速度可达到n-1/2.     

多机制半参数平滑转换回归模型——兼论我国宏观经济运行周期

本文结合多机制平滑转换回归模型和半参数平滑转换回归模型,提出多机制半参数平滑转换回归模型。对模型转换函数中的未知光滑有界函数采用级数估计,并给出了结合Back-fitting算法和非线性最小二乘法估计模型参数的具体执行步骤,随机模拟结果说明了本文模型和估计算法的可行性和灵活性。应用本文模型和估计算法对我国宏观经济运行周期的实证研究表明,我国经济增长的非线性结构可以分为四个显著不同的增长机制:扩张阶段、衰退阶段、收缩阶段、恢复阶段,并且宏观经济政策的作用有三到四个季度的迟滞效应。     

模糊线性回归模型的约束最小二乘估计

自Tanaka等1982年提出模糊回归概念以来,该问题已得到广泛的研究。作为主要估计方法之一的模糊最小二乘估计以其与统计最小二乘估计的密切联系更受到人们的重视。本文依据适当定义的两个模糊数之间的距离,提出了模糊线性回归模型的一个约束最小二乘估计方法,该方法不仅能使估计的模糊参数的宽度具有非负性而且估计的模糊参数的中心线与传统的最小二乘估计相一致。最后,通过数值例子说明了所提方法的具体应用。     

Abnormal behavior of the least squares estimate of multiple regression

An example is given to reveal the abnormal behavior of the least squares estimate of multiple regression. It is shown that the least squares estimate of the multiple linear regression may be “improved” in the sense of weak consistency when nuisance parameters are introduced into the model. A discussion on the implications of this finding is given.     

齐次线性约束回归模型参数的主成分压缩估计

当设计矩阵X复共线时,对齐次线性约束回归模型参数的约束最小二乘估计进行改进,提出参数的主成分压缩估计,并对新参数估计的性质进行了讨论,最后进行了数值模拟,验证了算法的参数估计优于约束最小二乘估计.     

Linear Versus Quadratic Estimators in Linearized Models

In nonlinear regression models an approximate value of an unknown parameter is frequently at our disposal. Then the linearization of the model is used and a linear estimate of the parameter can be calculated. Some criteria how to recognize whether a linearization is possible are developed. In the case that they are not satisfied, it is necessary to take into account either some quadratic corrections or to use the nonlinear least squares method. The aim of the paper is to find some criteria for an ordering linear and quadratic estimators.     

半参数回归模型的稳健补偿最小二乘估计

本文研究了一类半参数回归模型，利用稳健补偿最小二乘估计法，得到了稳健补偿最小二乘估计量，以及它们的影响函数及渐近方差一协方差，对结果的分析表明了该法优于补偿最小二乘法，而且具有稳定性．     

Multiple criteria linear regression

The unknown parameters in multiple linear regression models may be estimated using any one of a number of criteria such as the minimization of the sum of squared errors MSSE, the minimization of the sum of absolute errors MSAE, and the minimization of the maximum absolute error MMAE. At present, the MSSE or the least squares criterion continues to be the most popular. However, at times the choice of a criterion is not clear from statistical, practical or other considerations. Under such circumstances, it may be more appropriate to use multiple criteria rather than a single criterion to estimate the unknown parameters in a multiple linear regression model. We motivate the use of multiple criteria estimation in linear regression models with an example, propose a few models, and outline a solution procedure.     

Derivative-free optimization and neural networks for robust regression

Large outliers break down linear and nonlinear regression models. Robust regression methods allow one to filter out the outliers when building a model. By replacing the traditional least squares criterion with the least trimmed squares (LTS) criterion, in which half of data is treated as potential outliers, one can fit accurate regression models to strongly contaminated data. High-breakdown methods have become very well established in linear regression, but have started being applied for non-linear regression only recently. In this work, we examine the problem of fitting artificial neural networks (ANNs) to contaminated data using LTS criterion. We introduce a penalized LTS criterion which prevents unnecessary removal of valid data. Training of ANNs leads to a challenging non-smooth global optimization problem. We compare the efficiency of several derivative-free optimization methods in solving it, and show that our approach identifies the outliers correctly when ANNs are used for nonlinear regression.     

右删失数据下非线性回归模型的经验似然推断

考虑随机右删失数据下非线性回归模型,提出了模型中未知参数的调整的经验对数似然比统计量.在一定的条件下,证明了.所提出的的统计量具有渐近χ~2分布,由此结果构造了兴趣参数的置信域.通过模拟研究,对经典的经验似然、调整的经验似然和非线性最小二乘方法在有限样本下进行了比较,并对氯离子浓度试验数据进行了分析.     

Asymptotics of estimates in constrained nonlinear regression with long-range dependent innovations

The purpose of this paper is to investigate the asymptotic properties of the least squares estimates (L ₂-estimates) and the least absolute deviation estimates (L ₁-estimates) of the parameters of a nonlinear regression model subject to a set of equality and inequality restrictions, which has a long-range dependent stationary process as its stochastic errors. Then we will compare the asymptotic relative efficiencies of the above estimators.     

An implicit least squares algorithm for nonlinear rational model parameter estimation

In this study a new insight into least squares regression is identified and immediately applied to estimating the parameters of nonlinear rational models. From the beginning the ordinary explicit expression for linear in the parameters model is expanded into an implicit expression. Then a generic algorithm in terms of least squares error is developed for the model parameter estimation. It has been proved that a nonlinear rational model can be expressed as an implicit linear in the parameters model, therefore, the developed algorithm can be comfortably revised for estimating the parameters of the rational models. The major advancement of the generic algorithm is its conciseness and efficiency in dealing with the parameter estimation problems associated with nonlinear in the parameters models. Further, the algorithm can be used to deal with those regression terms which are subject to noise. The algorithm is reduced to an ordinary least square algorithm in the case of linear or linear in the parameters models. Three simulated examples plus a realistic case study are used to test and illustrate the performance of the algorithm.     

The rate of convergence for the least squares estimator in nonlinear regression model with dependent errors

We study the parameter estimation in a nonlinear regression model with a general error's structure,strong consistency and strong consistency rate of the least squares estimator are obtained.