分布函数的非参数最小二乘估计

By using the non-parametric least square method, the strong consistent estimations of distribution function and failure function are established, where the distribution function F(x)after logist transformation is assumed to be approximated by a polynomial. The performance of simulation shows that the estimations are highly satisfactory.     

模糊线性回归模型的约束最小二乘估计

自Tanaka等1982年提出模糊回归概念以来,该问题已得到广泛的研究。作为主要估计方法之一的模糊最小二乘估计以其与统计最小二乘估计的密切联系更受到人们的重视。本文依据适当定义的两个模糊数之间的距离,提出了模糊线性回归模型的一个约束最小二乘估计方法,该方法不仅能使估计的模糊参数的宽度具有非负性而且估计的模糊参数的中心线与传统的最小二乘估计相一致。最后,通过数值例子说明了所提方法的具体应用。     

加权广义逆、加权最小二乘和约束最小二乘问题

本文采用如下记号:记C~m×n是具有复数域的m×n长方矩阵的集合,C~m=C~m×1是m维向量的集合.对A∈C~m×n称A~H∈C~m×n是A的共轭转置矩阵,rank(A)表示A的秩,R(A)和N(A)分别为A的值域和零空间,||·||=||·||2和||·||F分别为2-范数和Frobenius范数;I表示恒等矩阵.人们在研究数学规划、数值分析、数据处理,散射理论和电磁学等领域中都将问题归纳为如下的最小二乘问题:     

回归系数最小二乘估计的Bootstrap估计

本文对线性模型的回归系数β的线性函数α＾Ｔβ的最小二乘估计α＾Ｔβ建立了一种新的ｂｏｏｔｓｔｒａｐ逼近，给出了逼近的相合性定量，得到了ｏ（ｎ＾－１／２）的逼近速度。     

广义压缩最小二乘估计

本文引进了线性模型中回归系数的一个估计类。许多常用的估计,例如岭回归估计、主成分估计、压缩最小二乘估计以及迭代估计都属于这个估计类。本文讨论该估计类中估计的容许性问题以及矩阵均方误差准则下估计的比较问题。     

岭估计优于最小二乘估计的条件

本文讨论在均方误差意义下岭估计优于最小二乘估计的问题，给出了岭估计优于小最小二乘估计的必要条件及较一般的充分条件。     

概率密度函数的广义最小二乘估计

本文提出了应用线性回归的方法改良核密度估计的一种方法,改良的估计量为GLS估计.并讨论了几个与之相关的问题.     

关于广义压缩最小二乘估计的注记

本文研究了广义压缩最小二乘估计（ＧＳＬＳＥ）的一些性质，给出了它的均方误差（ＭＳＥ）的一个无偏估计量（ＵＥ），采用极小该ＵＥ的方法确定了ＧＳＬＳＥ的参数选取公式，并把这个统一化的方法应用于广义岭估计，岭估计、Ｍａｓｓｙ主成分估计、Ｓｔｅｉｎ型压缩估计以及根方有偏估计等，从而得到了它们的一种选取参数的方法，最后，结合Ｈａｌｄ实例进行比较分析，结果表明，本文的方法是实用的，有效的。     

权回归模型中最小二乘估计的相对效率

对于线性加权回归模型，本文得到了未知参数的最小二乘估计相对于最佳线性无偏估计的四种相对效率的下界，并建立了相对效率与广义相关系数的联系。     

一般Gauss—Markov模型下最小二乘估计是最佳估计的充要条件

In this paper, we discuss the decomposition of the space μ(X : V) and the invariance with respect to the choice of a generalized inverse of matrix X in the general Gauss-Markov model. In Theorem 1, we give necessary and sufficient conditions for the least squares estimator P_xy = BLUE(Xβ) under the general Gauss-Markov model M = {y,Xβ,σ²V}. In Theorem 2, we prove that P_xy= BLUE(Xβ) under model M and invariant with respect to the choice of a generalized inverse of matrix X are equivalent.     

The consistency of a non-linear least squares estimator from diffusion processes

Consider the following Itô stochastic differential equation dX(t) = ƒ(θ⁰, X(t)) dt + dW(t), where (W(t), t 0), is a standard Wiener process in R^N. On the basis of discrete data 0 = t₀ < t₁ < …<t_n = T; X(t₁),...,X(t_n) we would like to estimate the parameter θ⁰. We shall define the least squares estimator and show that under some regularity conditions, is strongly consistent.     

Asymptotic distribution of the weighted least squares estimator

This paper derives the asymptotic distribution of the weighted least squares estimator (WLSE) in a heteroscedastic linear regression model. A consistent estimator of the asymptotic covariance matrix of the WLSE is also obtained. The results are obtained under weak conditions on the design matrix and some moment conditions on the error distributions. It is shown that most of the error distributions encountered in practice satisfy these moment conditions. Some examples of the asymptotic covariance matrices are also given.     

On the bias of the least squares estimator for the first order autoregressive process

The paper provides an exact formula for the bias of the parameter estimator of the first order autoregressive process and derives the asymptotic bias.     

泛最小二乘法的改进及其容许性

考虑线性回归模型,当设计阵呈病态或秩亏时,我们用泛最小二乘法给出参数的估计,并证明其容许性;然后针对泛最小二乘估计对最小二乘估计过度压缩的缺点加以改进,使之更合理,有效.     

The rate of convergence for the least squares estimator in nonlinear regression model with dependent errors

We study the parameter estimation in a nonlinear regression model with a general error's structure,strong consistency and strong consistency rate of the least squares estimator are obtained.     

Consistency conditions on the least squares estimator in single common factor analysis model

Summary This paper is concerned with the consistency of estimators in a single common factor analysis model when the dimension of the observed vector is not fixed. In the model several conditions on the sample sizen and the dimensionp are established for the least squares estimator (L.S.E.) to be consistent. Under some assumptions,p/n→0 is a necessary and sufficient condition that the L.S.E. converges in probability to the true value. A sufficient condition for almost sure convergence is also given.     

Second-order nonlinear least squares estimation

The ordinary least squares estimation is based on minimization of the squared distance of the response variable to its conditional mean given the predictor variable. We extend this method by including in the criterion function the distance of the squared response variable to its second conditional moment. It is shown that this “second-order” least squares estimator is asymptotically more efficient than the ordinary least squares estimator if the third moment of the random error is nonzero, and both estimators have the same asymptotic covariance matrix if the error distribution is symmetric. Simulation studies show that the variance reduction of the new estimator can be as high as 50% for sample sizes lower than 100. As a by-product, the joint asymptotic covariance matrix of the ordinary least squares estimators for the regression parameter and for the random error variance is also derived, which is only available in the literature for very special cases, e.g. that random error has a normal distribution. The results apply to both linear and nonlinear regression models, where the random error distributions are not necessarily known.     

The distribution of a generalized least squares estimator with covariance adjustment

The distribution theory is developed for a generalized least squares estimator of the growth curve model. A special case of the estimator is the maximum likelihood estimator which is weighted by the sample covariance matrix. The distribution of two conditional forms of the estimator are derived and from these its density is obtained. Two general pivots and their distributions are derived from the conditional forms and special cases of these are investigated. The results obtained are linked to carlier work.     

Asymptotic theory of least squares estimator in a nonregular nonlinear regression model

The asymptotic properties of the least squares estimator are derived for a nonregular nonlinear model via the study of weak convergence of the least squares process. This approach was adapted earlier by the author in the smooth case. The model discussed here is not amenable to analysis via the normal equations and Taylor expansions used by earlier authors.     

Asymptotic bias of the least squares estimator for multivariate autoregressive models

Summary The asymptotic bias of the least squares estimator for the multivariate autoregressive models is derived. The formulas for the low order univariate autoregressive models are given in terms of the simple functions of parameters. Our results are useful to the bias correction method of the least squares estimation. This work was supported by National Science Foundation Grant SES79-13976 at the Institute for Mathematical Studies in the Social Sciences, Stanford University. This paper is a revision of Discussion Paper No. 504, The Center for Mathematical Studies in Economics and Management Science, Northwestern University, October 1981.