Variable selection via quantile regression with the process of Ornstein-Uhlenbeck type

Based on the data-cutoff method,we study quantile regression in linear models,where the noise process is of Ornstein-Uhlenbeck type with possible jumps.In single-level quantile regression,we allow the noise process to be heteroscedastic,while in composite quantile regression,we require that the noise process be homoscedastic so that the slopes are invariant across quantiles.Similar to the independent noise case,the proposed quantile estimators are root-n consistent and asymptotic normal.Furthermore,the adaptive least absolute shrinkage and selection operator(LASSO)is applied for the purpose of variable selection.As a result,the quantile estimators are consistent in variable selection,and the nonzero coefficient estimators enjoy the same asymptotic distribution as their counterparts under the true model.Extensive numerical simulations are conducted to evaluate the performance of the proposed approaches and foreign exchange rate data are analyzed for the illustration purpose.     

Asymptotics of estimates in constrained nonlinear regression with long-range dependent innovations

The purpose of this paper is to investigate the asymptotic properties of the least squares estimates (L ₂-estimates) and the least absolute deviation estimates (L ₁-estimates) of the parameters of a nonlinear regression model subject to a set of equality and inequality restrictions, which has a long-range dependent stationary process as its stochastic errors. Then we will compare the asymptotic relative efficiencies of the above estimators.     

Error Process Indexed by Bandwidth Matrices in Multivariate Local Linear Smoothing

We focus on nonparametric multivariate regression function estimation by locally weighted least squares. The asymptotic behavior for a sequence of error processes indexed by bandwidth matrices is derived. We discuss feasible data-driven consistent estimators minimizing asymptotic mean squared error or efficient estimators reducing asymptotic bias at points where opposite sign curvatures of the regression function are present in different directions.     

Stochastic integrals of empirical-type processes with applications to censored regression

Motivated by the analysis of linear rank estimators and the Buckley-James nonparametric EM estimator in censored regression models, we study herein the asymptotic properties of stochastic integrals of certain two-parameter empirical processes. Applications of these results on empirical processes and their stochastic integrals to the asymptotic analysis of censored regression estimators are also given.     

Asymptotics of R-, MD- and LAD-estimators in linear regression models with long range dependent errors

Summary This paper establishes the uniform closeness of a weighted residual empirical process to its natural estimate in the linear regression setting when the errors are Gaussian, or a function of Gaussian random variables, that are strictly stationary and long range dependent. This result is used to yield the asymptotic uniform linearity of a class of rank statistics in linear regression models with long range dependent errors. The latter result, in turn, yields the asymptotic distribution of the Jaeckel (1972) rank estimators. The paper also studies the least absolute deviation and a class of certain minimum distance estimators of regression parameters and the kernel type density estimators of the marginal error density when the errors are long range dependent.Research of this author was partly supported by the NSF grant: DMS-9102041     

Efficient Quantile Estimation for Functional-Coefficient Partially Linear Regression Models

The quantile estimation methods are proposed for functional-coefficient partially linear regression (FCPLR) model by combining nonparametric and functional-coefficient regression (FCR) model. The local linear scheme and the integrated method are used to obtain local quantile estimators of all unknown functions in the FCPLR model. These resulting estimators are asymptotically normal, but each of them has big variance. To reduce variances of these quantile estimators, the one-step backfitting technique is used to obtain the efficient quantile estimators of all unknown functions, and their asymptotic normalities are derived. Two simulated examples are carried out to illustrate the proposed estimation methodology.     

删失分位数回归模型基于扩展兴趣信息准则的平均估计

本文结合分位数回归技术,基于删失回归模型,把Claeskens和Hjort的传统兴趣信息准侧(focused information criterion,FIC)扩展到兴趣向量的情形,提出扩展的兴趣信息准则(extended focused information criterion,E-FIC),有效解决了同时针对多个兴趣参数的平均估计问题,并且对删失响应变量的不同水平分位数进行建模,以全面反映响应变量分布特征,有效克服异常值和厚尾模型误差的影响.基于扩展的兴趣信息准则给出参数的平均估计方法,证明估计的渐近性质.通过Monte Carlo随机模拟试验比较所提估计方法和最小二乘方法在有限样本量下的表现,用所提方法对原发性胆汁性肝硬化数据集进行数据分析.     

Asymptotic properties of a particular nonlinear regression quantile estimation

In this paper we shall be concerned with the asymptotic properties of the regression quantile estimation in the nonlinear regression time series models. For these, first we prove the strong consistency and derive the asymptotic normality of the regression quantile estimators for a particular sinusoidal regression model with a simple harmonic component. Next, we extend the results to more complicated sinusoidal models of several harmonic components.     

The limiting behavior of least absolute deviation estimators for threshold autoregressive models

The asymptotic behavior of the least squares (LS) estimators of the parameters in threshold autoregressive models has been completely studied in the literature. It is well known that in some cases the least absolute deviation (LAD) estimators are superior to the LS-estimators. This paper is devoted to studying the strong consistency and the asymptotic normality of the LAD-estimators in two cases where the threshold is known and/or unknown.     

Quasi-likelihood analysis and its applications

The Ibragimov–Khasminskii theory established a scheme that gives asymptotic properties of the likelihood estimators through the convergence of the likelihood ratio random field. This scheme is extending to various nonlinear stochastic processes, combined with a polynomial type large deviation inequality proved for a general locally asymptotically quadratic quasi-likelihood random field. We give an overview of the quasi-likelihood analysis and its applications to ergodic/non-ergodic statistics for stochastic processes.

     

Variable selection and coefficient estimation via composite quantile regression with randomly censored data

Composite quantile regression with randomly censored data is studied. Moreover, adaptive LASSO methods for composite quantile regression with randomly censored data are proposed. The consistency, asymptotic normality and oracle property of the proposed estimators are established. The proposals are illustrated via simulation studies and the Australian AIDS dataset.     

Self-consistent estimation of censored quantile regression

The principle of self-consistency has been employed to estimate regression quantile with randomly censored response. The asymptotic studies for this type of approach was established only recently, partly due to the complex forms of the current self-consistent estimators of censored regression quantiles. Of interest, how the self-consistent estimation of censored regression quantiles is connected to the alternative martingale-based approach still remains uncovered. In this paper, we propose a new formulation of self-consistent censored regression quantiles based on stochastic integral equations. The proposed representation of censored regression quantiles entails a clearly defined estimation procedure. More importantly, it greatly simplifies the theoretical investigations. We establish the large sample equivalence between the proposed self-consistent estimators and the existing estimator derived from martingale-based estimating equations. The connection between the new self-consistent estimation approach and the available self-consistent algorithms is also elaborated.     

LAD estimation for nonlinear regression models with randomly censored data

The least absolute deviations (LAD) estimation for nonlinear regression models with randomly censored data is studied and the asymptotic properties of LAD estimators such as consistency, boundedness in probability and asymptotic normality are established. Simulation results show that for the problems with censored data, LAD estimation performs much more robustly than the least squares estimation.     

Instrumental Variable Estimation for Linear Stochastic Differential Equations Driven by Fractional Brownian Motion

Abstract

We investigate the asymptotic properties of instrumental variable estimators of the drift parameter for stochastic processes satisfying linear stochastic differential equations driven by fractional Brownian motion.     

Least Absolute Deviation Estimation for Regression with ARMA Errors

The asymptotic normality for least absolute deviation estimates of the parameters in a linear regression model with autoregressive moving average errors is established under very general conditions. The method of proof is based on a functional limit theorem for the LAD objective function.     

Positive shrinkage, improved pretest and absolute penalty estimators in partially linear models

Shrinkage estimators of a partially linear regression parameter vector are constructed by shrinking estimators in the direction of the estimate which is appropriate when the regression parameters are restricted to a linear subspace. We investigate the asymptotic properties of positive Stein-type and improved pretest semiparametric estimators under quadratic loss. Under an asymptotic distributional quadratic risk criterion, their relative dominance picture is explored analytically. It is shown that positive Stein-type semiparametric estimators perform better than the usual Stein-type and least square semiparametric estimators and that an improved pretest semiparametric estimator is superior to the usual pretest semiparametric estimator. We also consider an absolute penalty type estimator for partially linear models and give a Monte Carlo simulation comparisons of positive shrinkage, improved pretest and the absolute penalty type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty type estimation method when the dimension of the parameter space is much larger than that of the linear subspace.     

Estimation of the slope in a linear functional relationship

Summary Two nonparametric estimators of the slope of a regression line with error on both variables are considered, each of them being defined as the zero-crossing of a stochastic process whose sample paths are monotone. Their asymptotic behaviour is derived from the local asymptotic behaviour of the underlying processes. One of the estimators is a nonparametric version of Wald's (1940) estimator.This research was supported by the Swiss National Science Foundation     

PARMA模型参数最小绝对偏差(LAD)估计量的极限分布

在最优化理论基础上,采用相对较稳健的最小绝对偏差（LAD）估计方法,首先研究了周期自回归滑动平均（PARMA）模型参数估计问题,得到了PARMA模型LAD估计量的渐近分布.其次对该模型的LAD估计作了进一步的讨论,给出更一般假设条件下模型参数LAD估计量的渐近性质。     

动态变系数回归模型的识别与非参数GMM估计

主要研究关于面板数据的有限阶固定效应的动态变系数回归模型(简称FDVCM)的统计推断问题.基于B-样条函数和广义矩估计(简称GMM)方法,首先建立了未知系数函数的非参数GMM估计,并证明大样本情形下该估计达到最优非参数收敛速度且具有渐近正态性质.然而实际问题中模型的动态阶数完全未知,也可能存在其它冗余的回归变量,文中借助文[Fan J,Li R.Variable selection via penalized likelihood and its oracle properties.Journal of the American Statistical Association,2001,96(456):1348-1360]中的smoothly clipped absolute deviation(简称SCAD)惩罚函数同时识别真实的动态阶数和显著的外生回归变量.同时建立了压缩估计的Oracle性质,即所识别的模型与真实模型中的参数估计具有相同的渐近分布.最后,无论是数值试验还是实例数据分析都验证了本文方法的合理性和可行性.     

Statistical inference for multivariate longitudinal data with irregular auto-correlated error process

Multivariate longitudinal data arise frequently in a variety of applications, where multiple outcomes are measured repeatedly from the same subject. In this paper, we first propose a two-stage weighted least square estimation procedure for the regression coefficients when the random error follows an irregular autoregressive(AR) process, and establish asymptotic normality properties for the resulting estimators. We then apply the smoothly clipped absolute deviation(SCAD) variable selection approach to determine the order of the AR error process. We further propose a test statistic to check whether multiple responses are correlated at the same observation time, and derive the asymptotic distribution of the proposed test statistic. Several simulated examples and real data analysis are presented to illustrate the finite-sample performance of the proposed method.