Efficient estimation of varying coefficient seemly unrelated regression model

In this paper, we propose a class of varying coefficient seemingly unrelated regression models, in which the errors are correlated across the equations. By applying the series approximation and taking the contemporaneous correlations into account, we propose an efficient generalized least squares series estimation for the unknown coefficient functions. The consistency and asymptotic normality of the resulting estimators are established. In comparison with the ordinary/east squares ones, the proposed estimators are more efficient with smaller asymptotical variances. Some simulgtlon＇studies and a real application are presented to demonstrate the finite sample performance of the proposed methods. In addition, based on a B-spline approximation, we deduce the asymptotic bias and variance of the proposed estimators.     

半相依部分线性可加回归模型的统计推断

受实际问题研究的启发, 为减少模型偏差, 提出了一类半相依部分线性可加的半参数回归模型. 这类半相依模型中, 响应变量与 一部分解释变量之间的关系是线性的, 与另一部分解释变量之间的关系未知但具有可加结构, 各方程的误差之间是相关的. 将级 数逼近法、最小二乘法和同期相关的估计结合起来, 提出了用于估计模型参数分量的加权半参数最小二乘估计量(WSLSEs), 和用于估 计模型非参数分量的加权级数逼近估计量(WSEs). 证明了这些加权的估计量比相应的不加权的估计量渐近有效, 并导出了相应的渐近正态性. 另外, 还讨论了利用这些估计量的渐近性质来对模型的参数及非参数分量作统计推断. 用大量的模拟实验考察 了所提出的方法在有限样本情况下的表现, 并对美国的一个关于妇女工资问题的全国纵向调查(NLS)数据集进行了统计分析.     

Asymptotic properties of the least squares estimators of the parameters of the chirp signals

Chirp signals are quite common in different areas of science and engineering. In this paper we consider the asymptotic properties of the least squares estimators of the parameters of the chirp signals. We obtain the consistency property of the least squares estimators and also obtain the asymptotic distribution under the assumptions that the errors are independent and identically distributed. We also consider the generalized chirp signals and obtain the asymptotic properties of the least squares estimators of the unknown parameters. Finally we perform some simulations experiments to see how the asymptotic results behave for small sample and the performances are quite satisfactory.     

Approximation to the distribution of the least squares estimators in two dimensional cosine models by randomly weighted bootstrap

Recently, Kundu and Gupta （Metrika, 48：83 C 97, 1998） established the asymptotic normality of the least squares estimators in the two dimensional cosine model. In this paper, we give the approximation to the general least squares estimators by using random weights which is called the Bayesian bootstrap or the random weighting method by Rubin （Annals of Statistics, 9：130 C 134, 1981） and Zheng （Acta Math. Appl. Sinica （in Chinese）, 10（2）： 247 C 253, 1987）. A simulation study shows that this approximation works very well.     

On spline approximation of sliced inverse regression

The dimension reduction is helpful and often necessary in exploring the nonparametric regression structure.In this area,Sliced inverse regression (SIR) is a promising tool to estimate the central dimension reduction (CDR) space.To estimate the kernel matrix of the SIR,we herein suggest the spline approximation using the least squares regression.The heteroscedasticity can be incorporated well by introducing an appropriate weight function.The root-n asymptotic normality can be achieved for a wide range choice of knots.This is essentially analogous to the kernel estimation.Moreover, we also propose a modified Bayes information criterion (BIC) based on the eigenvalues of the SIR matrix.This modified BIC can be applied to any form of the SIR and other related methods.The methodology and some of the practical issues are illustrated through the horse mussel data.Empirical studies evidence the performance of our proposed spline approximation by comparison of the existing estimators.     

Parameter Estimation of Multivariate Regression Model with Fuzzy Random Errors

In many real-world problems, observations are usually described by approximate values due to fuzzy uncertainty, unlikeprobabilistic uncertainty that has nothing to do with experimentation. The combination of statistical model and fuzzy set theory is helpful to improve the identification and analysis of complex systems. As an extension ofstatistical techniques, this study is an investigation of the relationship between fuzzy multiple explanatory variables and fuzzy response with numeric coefficients and the fuzzy random error term. In this work we describe a parameter estimation procedure carrying out the least-squares method in a complete metric space of fuzzy numbers to determine the coefficients based on the extension principle. We demonstrate how the fuzzy least squares estimators present large sample statistical properties, including asymptotic normality, strong consistency and confidence region. The estimators are also examined via asymptotic relative efficiency concerning traditional least squares estimators. Different from the construction of error term in Kim et al.\cite{21}, it is more reasonable in the proposed model since the problems of inconsistency in referring to fuzzy variable and producing the negative spreads may be avoided. The experimental study verifies that the proposed fuzzy least squares estimators achieve the meaning consistent with the theory identification for large sample data set and better generalization regarding one single variable model.     

利用加权对称估计量对季节性时间序列的单位根检验

本文提出对季节性时间序列利用加权对称估计量的单位根检验,导出相应统计量的极限分布。用MonteCarlo方法计算经验百分位数及检验势,并对最小平方估计量,简单对称估计量和加权对称估计量的经验检验势作了比较。     

Asymptotic properties of some subset vector autoregressive process estimators

We establish consistency and derive asymptotic distributions for estimators of the coefficients of a subset vector autoregressive (SVAR) process. Using a martingale central limit theorem, we first derive the asymptotic distribution of the subset least squares (LS) estimators. Exploiting the similarity of closed form expressions for the LS and Yule–Walker (YW) estimators, we extend the asymptotics to the latter. Using the fact that the subset Yule–Walker and recently proposed Burg estimators satisfy closely related recursive algorithms, we then extend the asymptotic results to the Burg estimators. All estimators are shown to have the same limiting distribution.     

Double k-Class Estimators in Regression Models with Non-spherical Disturbances

In this paper, we consider a family of feasible generalised double k-class estimators in a linear regression model with non-spherical disturbances. We derive the large sample asymptotic distribution of the proposed family of estimators and compare its performance with the feasible generalized least squares and Stein-rule estimators using the mean squared error matrix and risk under quadratic loss criteria. A Monte-Carlo experiment investigates the finite sample behaviour of the proposed family of estimators.     

Adaptive Unified Biased Estimators of Parameters in Linear Model

To tackle multi collinearity or ill-conditioned design matrices in linear models,adaptive biasedestimators such as the time-honored Stein estimator,the ridge and the principal component estimators havebeen studied intensively.To study when a biased estimator uniformly outperforms the least squares estimator,some sufficient conditions are proposed in the literature.In this paper,we propose a unified framework toformulate a class of adaptive biased estimators.This class includes all existing biased estimators and some newones.A sufficient condition for outperforming the least squares estimator is proposed.In terms of selectingparameters in the condition,we can obtain all double-type conditions in the literature.     

半参数回归模型的稳健补偿最小二乘估计

本文研究了一类半参数回归模型，利用稳健补偿最小二乘估计法，得到了稳健补偿最小二乘估计量，以及它们的影响函数及渐近方差一协方差，对结果的分析表明了该法优于补偿最小二乘法，而且具有稳定性．     

Influence asymptotique de la correction par la moyenne sur l'estimation d'un modèle AR(1) périodique

This Note studies asymptotic influence of mean-correction on the parameter least squares estimation for a periodic AR(1) model. Unlike the stationary ARMA case, we show that fitting a periodic ARMA model with intercepts to the observed series can provide substantial gains in terms of asymptotic accuracy for the parameter least squares estimators compared with fitting a periodic ARMA model without intercepts to the mean-corrected series. To cite this article: A. Gautier, C. R. Acad. Sci. Paris, Ser. I 340 (2005).     

�̶�ЧӦ������ݲ�������ģ�͵ļ�Ȩ����LSDV����

This paper concerns with the estimation of a fixed effects panel data partially linear regression model with the idiosyncratic errors being an autoregressive process. For fixed effects short time series panel data, the commonly used autoregressive error structure fitting method will not result in a consistent estimator of the autoregressive coefficients. Here we propose an alternative estimation and show that the resulting estimator of the autoregressive coefficients is consistent and this method is workable for any order autoregressive error structure. Moreover, combining the B-spline approximation, profile least squares dummy variable (PLSDV) technique and consistently estimated the autoregressive error structure, we develop a weighted PLSDV estimator for the parametric component and a weighted B-spline series (BS) estimator for the nonparametric component. The weighted PLSDV estimator is shown to be asymptotically normal and more asymptotically efficient than the one which ignores the error autoregressive structure. In addition, this paper derives the asymptotic bias of the weighted BS estimator and establish its asymptotic normality as well. Simulation studies and an example of application are conducted to illustrate the finite sample performance of the proposed procedures.     

Lower Rank Approximation of Matrices Based on Fast and Robust Alternating Regression

We introduce fast and robust algorithms for lower rank approximation to given matrices based on robust alternating regression. The alternating least squares regression, also called criss-cross regression, was used for lower rank approximation of matrices, but it lacks robustness against outliers in these matrices. We use robust regression estimators and address some of the complications arising from this approach. We find it helpful to use high breakdown estimators in the initial iterations, followed by M estimators with monotone score functions in later iterations towards convergence. In addition to robustness, the computational speed is another important consideration in the development of our proposed algorithm, because alternating robust regression can be computationally intensive for large matrices. Based on a mix of the least trimmed squares (LTS) and Huber's M estimators, we demonstrate that fast and robust lower rank approximations are possible for modestly large matrices.     

STRONG CONVERGENCE RATES OF SEVERAL ESTIMATORS IN SEMIPARAMETRIC VARYING-COEFFICIENT PARTIALLY LINEAR MODELS

This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang （2005） proposed a profile least squares estimator for the parametric component and established its asymptotic normality. We further show that the profile least squares estimator can achieve the law of iterated logarithm. Moreover, we study the estimators of the functions characterizing the non-linear part as well as the error variance. The strong convergence rate and the law of iterated logarithm are derived for them, respectively.     

Bridge estimators and the adaptive lasso under heteroscedasticity

In this paper we investigate penalized least squares methods in linear regression models with heteroscedastic error structure. It is demonstrated that the basic properties with respect to model selection and parameter estimation of bridge estimators, Lasso and adaptive Lasso do not change if the assumption of homoscedasticity is violated. However, these estimators do not have oracle properties in the sense of Fan and Li (2001) if the oracle is based on weighted least squares. In order to address this problem we introduce weighted penalized least squares methods and demonstrate their advantages by asymptotic theory and by means of a simulation study.     

Trajectory fitting estimators for SPDEs driven by additive noise

In this paper we study the problem of estimating the drift/viscosity coefficient for a large class of linear, parabolic stochastic partial differential equations (SPDEs) driven by an additive space-time noise. We propose a new class of estimators, called trajectory fitting estimators (TFEs). The estimators are constructed by fitting the observed trajectory with an artificial one, and can be viewed as an analog to the classical least squares estimators from the time-series analysis. As in the existing literature on statistical inference for SPDEs, we take a spectral approach, and assume that we observe the first N Fourier modes of the solution, and we study the consistency and the asymptotic normality of the TFE, as \(N\rightarrow \infty \).     

部分线性变系数模型改进的加权混合Profile-Liu估计

研究半参数部分线性变系数模型的有偏估计,当回归模型参数部分自变量存在多重共线性时,在随机线性约束条件下,融合Profile最小二乘估计、加权混合估计和Liu估计构造回归模型参数分量改进的加权混合Profile-Liu估计,并在一定正则条件下证明估计量的渐近性质,最后利用蒙特卡洛数值模拟验证所提出估计量的有限样本表现性.     

随机删失下半参数估计的强相合性

主要讨论了随机删失下的部分线性模型,利用基于分布函数的核估计和最小二乘法,给出了删失情况下参数和非参数部分的估计,并证明了它们的强相合性.     

Asymptotic theory of some tests for a possible change in the regression slope occurring at an unknown time point

Summary Based on least squares estimators and aligned rank order statistics, some testing procedures for a possible change in the regression slope occurring at an unknown time point are considered. The asymptotic theory of the proposed tests rests on certain invariance principles relating to least squares estimators and aligned rank order statistics, and these are developed here.Work supported by the National Heart, Lung and Blood Institute, Contract NIH-NHLBI-71-2243 from the (U.S.) National Institutes of Health