Asymptotic theory of least squares estimator in a nonregular nonlinear regression model

The asymptotic properties of the least squares estimator are derived for a nonregular nonlinear model via the study of weak convergence of the least squares process. This approach was adapted earlier by the author in the smooth case. The model discussed here is not amenable to analysis via the normal equations and Taylor expansions used by earlier authors.     

Efficient robust estimation of time-series regression models

The paper studies a new class of robust regression estimators based on the two-step least weighted squares (2S-LWS) estimator which employs data-adaptive weights determined from the empirical distribution or quantile functions of regression residuals obtained from an initial robust fit. Just like many existing two-step robust methods, the proposed 2S-LWS estimator preserves robust properties of the initial robust estimate. However, contrary to the existing methods, the first-order asymptotic behavior of 2S-LWS is fully independent of the initial estimate under mild conditions. We propose data-adaptive weighting schemes that perform well both in the cross-section and time-series data and prove the asymptotic normality and efficiency of the resulting procedure. A simulation study documents these theoretical properties in finite samples.     

Inequality constrained ridge regression estimator

We carry out the idea of inequality constrained least squares (ICLS) estimation of Liew (1976) to the inequality constrained ridge regression (ICRR) estimation. We propose ICRR estimator by reducing the primal–dual relation to the fundamental problem of Dantzig and Cottle, 1967, Cottle and Dantzig, 1974 with Lemke (1962) algorithm. Furthermore, we conduct a Monte Carlo experiment.     

The rate of convergence for the least squares estimator in nonlinear regression model with dependent errors

We study the parameter estimation in a nonlinear regression model with a general error's structure,strong consistency and strong consistency rate of the least squares estimator are obtained.     

Asymptotic properties of a maximum likelihood estimator with data from a Gaussian process

We consider an estimation problem with observations from a Gaussian process. The problem arises from a stochastic process modeling of computer experiments proposed recently by Sacks, Schiller, and Welch. By establishing various representations and approximations to the corresponding log-likelihood function, we show that the maximum likelihood estimator of the identifiable parameter θσ² is strongly consistent and converges weakly (when normalized by √n) to a normal random variable, whose variance does not depend on the selection of sample points. Some extensions to regression models are also obtained.     

Asymptotic distribution of the weighted least squares estimator

This paper derives the asymptotic distribution of the weighted least squares estimator (WLSE) in a heteroscedastic linear regression model. A consistent estimator of the asymptotic covariance matrix of the WLSE is also obtained. The results are obtained under weak conditions on the design matrix and some moment conditions on the error distributions. It is shown that most of the error distributions encountered in practice satisfy these moment conditions. Some examples of the asymptotic covariance matrices are also given.     

工件具有任意尺寸的混合分批平行机排序问题的近似算法

本文考虑了工件具有任意尺寸且机器有容量限制的混合分批平行机排序问题。在该问题中, 一个待加工的工件集需在多台平行批处理机上进行加工。每个工件有它的加工时间和尺寸, 每台机器可以同时处理多个工件, 称为一个批, 只要这些工件尺寸之和不超过其容量; 一个批的加工时间等于该批中工件的最大加工时间和总加工时间的加权和; 目标函数是极小化最大完工时间。该问题包含一维装箱问题为其特殊情形, 为强NP-困难的。对此给出了一个$\left( {2 + 2\alpha+\alpha^{2}}\right)$-近似算法, 其中$\alpha$为给定的权重参数, 满足考虑了不同于Goldfarb和Iyengar （2003）的因子模型,通过横截面回归分析以及Fama-MacBeth估计构造了关于资产的平均收益向量和协方差矩阵的不确定性集合（置信区域）。基于这些不确定性集合以及Markowitz“均值-方差模型”的鲁棒投资组合问题,提出了多个鲁棒投资组合问题,并对应的推导出其等价的半正定规划形式,使得问题可以在多项式时间内求解。     

处理多元线性回归中自变量共线性的几种方法--SAS/STAT软件(6.12)中REG等过程增强功能的使用

本文通过例子介绍多元线性回归中自变量共线性的诊断以及使用 SAS/SATA( 6.12 )软件中的 REG等过程的增强功能处理回归变量共线性的一些方法。包括筛选变量法 ,岭回归分析法 ,主成分回归法和偏最小二乘回归法     

Illustration of regression towards the means

This article, presents a procedure for generating a sequence of data sets which will yield exactly the same fitted simple linear regression equation y?=?a?+?bx. Unless rescaled, the generated data sets will have progressively smaller variability for the two variables, and the associated response and covariate will ‘regress’ towards their unconditional sample means.     

Central limit theorem of linear regression model under right censorship

In this paper,the estimation of joint dlstribution F(y,z)of(Y,Z)and the estimation in thelinear regression model Y=b'Z+εfor complete data are extended to that of the right censored data.Theregression parameter estimates of b and the variance of ε are weighted least square estimates with randomweights. The central limit theorems of the estimators are obtained under very weak conditions and the derivedasymptotic variance has a very simple form.     

Asymptotic normality of wavelet estimator in heteroscedastic regression model

The following heteroscedastic regression model Y_i=g(x_i) σ_ie_i(1≤i≤n)is considered,where it is assumed thatσ_i~2=f(u_i),the design points(x_i,u_i)are known and nonrandom,g and f are unknown functions.Under the unobservable disturbance e_i form martingale differences,the asymptotic normality of wavelet estimators of g with f being known or unknown function is studied.     

Nonparametric nonlinear regression using polynomial and neural approximators: a numerical comparison

The solution of nonparametric regression problems is addressed via polynomial approximators and one-hidden-layer feedforward neural approximators. Such families of approximating functions are compared as to both complexity and experimental performances in finding a nonparametric mapping that interpolates a finite set of samples according to the empirical risk minimization approach. The theoretical background that is necessary to interpret the numerical results is presented. Two simulation case studies are analyzed to fully understand the practical issues that may arise in solving such problems. The issues depend on both the approximation capabilities of the approximating functions and the effectiveness of the methodologies that are available to select the tuning parameters, i.e., the coefficients of the polynomials and the weights of the neural networks. The simulation results show that the neural approximators perform better than the polynomial ones with the same number of parameters. However, this superiority can be jeopardized by the presence of local minima, which affects the neural networks but does not regard the polynomial approach.     

一类非参数回归模型核估计的渐近性质

研究一类新的非参数回归模型回归函数的核估计问题,其中误差项为一阶非参数自回归方程.通过重复利用Watson-Nadaraya核估计方法,构造了回归函数及误差回归函数的估计量分别为m(.)和ρ(.),在适当的条件下,证明了估计量m(.)和ρ(.)的渐近正态性.     

我国通货膨胀的非参数回归模型

本文首先讨论非参数回归模型的局部核权最小二乘估计 ,然后建立我国通货膨胀非参数回归模型 ,最后研究了反映出口与通货膨胀关系的弹性系数     

An effective selection of regression variables when the error distribution is incorrectly specified

Summary An asymptotically efficient selection of regression variables is considered in the situation where the statistician estimates regression parameters by the maximum likelihood method but fails to choose a likelihood function matching the true error distribution. The proposed procedure is useful when a robust regression technique is applied but the data in fact do not require that treatment. Examples and a Monte Carlo study are presented and relationships to other selectors such as Mallows'C _p are investigated. Research supported by Deutsche Forschungsgemeinschaft, Sonderforschungsbereich 123 “Stochastische Mathematische Modelle” and AFOSR Contract No. F49620 82 C 0009.     

对北京市年需水量预测模型的研究

水资源的供给问题是每个城市都要面临的一项必须且复杂的基础建设任务。对城市需水量的预测直接关系到一个城市供水系统的建设规模与安全运行,是实现科学调度的必要前提。本文通过对北京市2001-2014年需水量及其影响因素相关数据的分析,分别建立了普通线性回归及偏最小二乘线性回归预测模型。通过对模型的比较分析及仿真模拟预测计算,发现偏最小二乘线性回归预测模型不仅易于解释,更适合做外推预测,具有较强的应用价值。     

Monotone nonparametric regression with random design

In this paper we study the nonparametric least squares estimator of a regression function in a random design setting under the constraint that this function is monotone, say, nonincreasing. The errors are not assumed conditionally i.i.d. given the observation points. In particular, this includes the case of conditional heteroscedasticity and the case of the current status model. The -error is shown to be of order n ^−p/3 and asymptotically Gaussian with explicit asymptotic mean and variance.      

Testing for linearity

A nonparametric large sample test is proposed for testing the linearity of a regression model with independent and identically distributed errors satisfying only a very mild tail condition. The statistic is based on the functional least squares estimator of the slope vector. The test is applied to the stack loss data.     

Asymptotically optimal estimation in a linear-fractional regression problem with random errors in coefficients

Considering the linear-fractional regression problem with errors in independent variables, we construct and study asymptotically optimal estimators for unknown parameters in the case of violation of the classical regression assumptions (the variances of the observations are different and depend on the unknown parameters).