Composite quantile regression for single-index models with asymmetric errors

For the single-index model, a composite quantile regression technique is proposed in this paper to construct robust and efficient estimation. Theoretical analysis reveals that the proposed estimate of the single-index vector is highly efficient relative to its corresponding least squares estimate. For the single-index vector, the proposed method is always valid across a wide spectrum of error distributions; even in the worst case scenario, the asymptotic relative efficiency has a lower bound 86.4 %. Meanwhile, we employ weighted local composite quantile regression to obtain a consistent and robust estimate for the nonparametric component in the single-index model, which is adapted to both symmetric and asymmetric distributions. Numerical study and a real data analysis can further illustrate our theoretical findings.     

一个有效估计:半参数非时齐扩散模型的局部线性复合分位回归估计

主要研究半参数非时齐扩散模型的参数估计问题.基于非时齐扩散模型的离散观测样本,首先得到漂移参数的局部线性复合分位回归估计,并证明估计量的渐近偏差、渐近方差和渐近正态性.其次,讨论了带宽的选择和局部线性复合分位回归估计关于局部线性最小二乘估计的渐近相对效,所得到的局部估计较局部线性最小二乘估计更为有效.最后,通过模拟说明了局部线性复合分位回归估计比局部线性最小二乘估计的模拟效果更好.     

Efficient robust estimation of time-series regression models

The paper studies a new class of robust regression estimators based on the two-step least weighted squares (2S-LWS) estimator which employs data-adaptive weights determined from the empirical distribution or quantile functions of regression residuals obtained from an initial robust fit. Just like many existing two-step robust methods, the proposed 2S-LWS estimator preserves robust properties of the initial robust estimate. However, contrary to the existing methods, the first-order asymptotic behavior of 2S-LWS is fully independent of the initial estimate under mild conditions. We propose data-adaptive weighting schemes that perform well both in the cross-section and time-series data and prove the asymptotic normality and efficiency of the resulting procedure. A simulation study documents these theoretical properties in finite samples.     

Iterative weighted partial spline least squares estimation in semiparametric modeling of longitudinal data

In this paper we consider the estimating problem of a semiparametric regression modelling whenthe data are longitudinal.An iterative weighted partial spline least squares estimator(IWPSLSE)for the para-metric component is proposed which is more efficient than the weighted partial spline least squares estimator(WPSLSE)with weights constructed by using the within-group partial spline least squares residuals in the sense     

基于最小二乘近似的模型平均方法

本文提出基于最小二乘近似的模型平均方法.该方法可用于线性模型、广义线性模型和分位数回归等各种常用模型.特别地,经典的Mallows模型平均方法是该方法的特例.现存的模型平均文献中,渐近分布的证明一般需要局部误设定假设,所得的极限分布的形式也比较复杂.本文将在不使用局部误设定假设的情形下证明该方法的渐近正态性.另外,本文...     

�̶�ЧӦ������ݲ�������ģ�͵ļ�Ȩ����LSDV����

This paper concerns with the estimation of a fixed effects panel data partially linear regression model with the idiosyncratic errors being an autoregressive process. For fixed effects short time series panel data, the commonly used autoregressive error structure fitting method will not result in a consistent estimator of the autoregressive coefficients. Here we propose an alternative estimation and show that the resulting estimator of the autoregressive coefficients is consistent and this method is workable for any order autoregressive error structure. Moreover, combining the B-spline approximation, profile least squares dummy variable (PLSDV) technique and consistently estimated the autoregressive error structure, we develop a weighted PLSDV estimator for the parametric component and a weighted B-spline series (BS) estimator for the nonparametric component. The weighted PLSDV estimator is shown to be asymptotically normal and more asymptotically efficient than the one which ignores the error autoregressive structure. In addition, this paper derives the asymptotic bias of the weighted BS estimator and establish its asymptotic normality as well. Simulation studies and an example of application are conducted to illustrate the finite sample performance of the proposed procedures.     

删失数据下的变系数回归模型

研究了删失数据下的变系数回归模型．通过数据变换,利用局部多项式方法,给出了系数函数的局部加权最小二乘估计．证明了该估计的渐近偏差和渐近方差,同时获得了该估计的渐近正态性．     

Statistical inference for panel data semiparametric partially linear regression models with heteroscedastic errors

We consider a panel data semiparametric partially linear regression model with an unknown parameter vector for the linear parametric component, an unknown nonparametric function for the nonlinear component, and a one-way error component structure which allows unequal error variances (referred to as heteroscedasticity). We develop procedures to detect heteroscedasticity and one-way error component structure, and propose a weighted semiparametric least squares estimator (WSLSE) of the parametric component in the presence of heteroscedasticity and/or one-way error component structure. This WSLSE is asymptotically more efficient than the usual semiparametric least squares estimator considered in the literature. The asymptotic properties of the WSLSE are derived. The nonparametric component of the model is estimated by the local polynomial method. Some simulations are conducted to demonstrate the finite sample performances of the proposed testing and estimation procedures. An example of application on a set of panel data of medical expenditures in Australia is also illustrated.     

Weighted Profile Least Squares Estimation for a Panel Data Varying-Coefficient Partially Linear Model

This paper is concerned with inference of panel data varying-coefficient partially linear models with a one-way error structure. The model is a natural extension of the well-known panel data linear model （due to Baltagi 1995） to the setting of semiparametric regressions. The authors propose a weighted profile least squares estimator （WPLSE） and a weighted local polynomial estimator （WLPE） for the parametric and nonparametric components, respectively. It is shown that the WPLSE is asymptotically more efficient than the usual profile least squares estimator （PLSE）, and that the WLPE is also asymptotically more efficient than the usual local polynomial estimator （LPE）. The latter is an interesting result. According to Ruckstuhl, Welsh and Carroll （2000） and Lin and Carroll （2000）, ignoring the correlation structure entirely and ＂pretending＂ that the data are really independent will result in more efficient estimators when estimating nonparametric regression with longitudinal or panel data. The result in this paper shows that this is not true when the design points of the nonparametric component have a closeness property within groups. The asymptotic properties of the proposed weighted estimators are derived. In addition, a block bootstrap test is proposed for the goodness of fit of models, which can accommodate the correlations within groups illustrate the finite sample performances of the Some simulation studies are conducted to proposed procedures.     

Second-order nonlinear least squares estimation

The ordinary least squares estimation is based on minimization of the squared distance of the response variable to its conditional mean given the predictor variable. We extend this method by including in the criterion function the distance of the squared response variable to its second conditional moment. It is shown that this “second-order” least squares estimator is asymptotically more efficient than the ordinary least squares estimator if the third moment of the random error is nonzero, and both estimators have the same asymptotic covariance matrix if the error distribution is symmetric. Simulation studies show that the variance reduction of the new estimator can be as high as 50% for sample sizes lower than 100. As a by-product, the joint asymptotic covariance matrix of the ordinary least squares estimators for the regression parameter and for the random error variance is also derived, which is only available in the literature for very special cases, e.g. that random error has a normal distribution. The results apply to both linear and nonlinear regression models, where the random error distributions are not necessarily known.     

Nonparametric estimation in generalized varying-coefficient models based on iterative weighted quasi-likelihood method

This paper focuses on the estimation of the coefficient functions, which is of primary interest, in generalized varying-coefficient models with non-exponential family error. The local weighted quasi-likelihood method which results from local polynomial regression techniques is presented. The nonparametric estimator based on iterative weighted quasi-likelihood method is obtained to estimate coefficient functions. The asymptotic efficiency of the proposed estimator is given. Furthermore, some simulations are carried out to evaluate the finite sample performance of the proposed method, which show that it possesses some advantages to the previous methods. Finally, a real data example is used to illustrate the proposed methodology.     

STRONG CONVERGENCE RATES OF SEVERAL ESTIMATORS IN SEMIPARAMETRIC VARYING-COEFFICIENT PARTIALLY LINEAR MODELS

This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang （2005） proposed a profile least squares estimator for the parametric component and established its asymptotic normality. We further show that the profile least squares estimator can achieve the law of iterated logarithm. Moreover, we study the estimators of the functions characterizing the non-linear part as well as the error variance. The strong convergence rate and the law of iterated logarithm are derived for them, respectively.     

Asymptotics for a weighted least squares estimator of the disease onset distribution function for a survival-sacrifice model

In carcinogenicity experiments with animals where the tumor is not palpable it is common to observe only the time of death of the animal, the cause of death (the tumor or another independent cause, as sacrifice) and whether the tumor was present at the time of death. These last two indicator variables are evaluated after an autopsy. A weighted least squares estimator for the distribution function of the disease onset was proposed. Asymptotic properties of that estimator are established here. We demonstrate its strong uniform consistency. A minimax lower bound for the estimation of the disease onset distribution is obtained, as well as the local asymptotic distribution for their estimator.     

左截断相依数据下条件分位数的双核局部线性估计

本文在左截断相依数据下,利用局部线性估计的方法,先提出了条件分布函数的双核估计;然后利用该估计导出了条件分位数的双核局部线性估计,并建立了这些估计的渐近正态性结果;最后,通过模拟显示该估计在偏移和边界点调节上要比一般的核估计更好.     

左截断右删失数据分位差估计及其渐近性质

我们研究了左截断右删失数据分位差,基于左截断右删失数据乘积限构造了分位差的经验估计,同时克服经验估计的非光滑性,提出了分位数差的核光滑估计.利用经验过程理论推导出这两个估计的渐近偏差和渐近方差,并且在左截断右删失数据下研究了这两个分位差的大样本性质,获得分位差估计的相合性和渐近正态性.同时给出计算模拟以验证光滑分位差估计的表现,在均方损失的意义下模拟结果表明光滑估计比经验估计具有更好的性质.     

Asymptotic expansions in sequential estimation for the first-order random coefficient autoregressive model: Regenerative approach

Edgeworth expansions for the distribution of a sequential least squares estimator in the random coefficient autoregressive (RCA) model are derived. The regenerative approach to second-order asymptotic analysis of Markov-type statistical models is developed.     

Recursive Least Squares Estimator with Multiple Exponential Windows in Vector Autoregression

Abstract In the parameter tracking of time-varying systems, the ordinary method is weighted least squareswith the rectangular window or the exponential window. In this paper we propose a new kind of sliding windowcalled the multiple exponential window, and then use it to fit time-varying Gaussian vector autoregressivemodels. The asymptotic bias and covariance of the estimator of the parameter for time-invariant models arealso derived. Simulation results show that the multiple exponential windows have better parameter trackingeffect than rectangular windows and exponential ones.     

Variable selection via quantile regression with the process of Ornstein-Uhlenbeck type

Based on the data-cutoff method,we study quantile regression in linear models,where the noise process is of Ornstein-Uhlenbeck type with possible jumps.In single-level quantile regression,we allow the noise process to be heteroscedastic,while in composite quantile regression,we require that the noise process be homoscedastic so that the slopes are invariant across quantiles.Similar to the independent noise case,the proposed quantile estimators are root-n consistent and asymptotic normal.Furthermore,the adaptive least absolute shrinkage and selection operator(LASSO)is applied for the purpose of variable selection.As a result,the quantile estimators are consistent in variable selection,and the nonzero coefficient estimators enjoy the same asymptotic distribution as their counterparts under the true model.Extensive numerical simulations are conducted to evaluate the performance of the proposed approaches and foreign exchange rate data are analyzed for the illustration purpose.     

Estimation and test of restricted linear EV model with nonignorable missing covariates

This paper deals with estimation and test procedures for restricted linear errors-invariables (EV) models with nonignorable missing covariates. We develop a restricted weighted corrected least squares (WCLS) estimator based on the propensity score, which is fitted by an exponentially tilted likelihood method. The limiting distributions of the proposed estimators are discussed when tilted parameter is known or unknown. To test the validity of the constraints, we construct two test procedures based on corrected residual sum of squares and empirical likelihood method and derive their asymptotic properties. Numerical studies are conducted to examine the finite sample performance of our proposed methods.     

A new extreme quantile estimator for heavy-tailed distributions

The classical estimation method for extreme quantiles of heavy-tailed distributions was presented by Weissman (J. Amer. Statist. Assoc. 73 (1978) 812–815) and makes use of the Hill estimator (Ann. Statist. 3 (1975) 1163–1174) for the positive extreme value index. This index estimator can be interpreted as an estimator of the slope in the Pareto quantile plot in case one considers regression lines passing through a fixed anchor point. In this Note we propose a new extreme quantile estimator based on an unconstrained least squares estimator of the index, introduced by Kratz and Resnick (Comm. Statist. Stochastic Models 12 (1996) 699–724) and Schultze and Steinebach (Statist. Decisions 14 (1996) 353–372) and we study its asymptotic behavior. To cite this article: A. Fils, A. Guillou, C. R. Acad. Sci. Paris, Ser. I 338 (2004).