Variable selection via quantile regression with the process of Ornstein-Uhlenbeck type

Based on the data-cutoff method,we study quantile regression in linear models,where the noise process is of Ornstein-Uhlenbeck type with possible jumps.In single-level quantile regression,we allow the noise process to be heteroscedastic,while in composite quantile regression,we require that the noise process be homoscedastic so that the slopes are invariant across quantiles.Similar to the independent noise case,the proposed quantile estimators are root-n consistent and asymptotic normal.Furthermore,the adaptive least absolute shrinkage and selection operator(LASSO)is applied for the purpose of variable selection.As a result,the quantile estimators are consistent in variable selection,and the nonzero coefficient estimators enjoy the same asymptotic distribution as their counterparts under the true model.Extensive numerical simulations are conducted to evaluate the performance of the proposed approaches and foreign exchange rate data are analyzed for the illustration purpose.     

Variable selection and coefficient estimation via composite quantile regression with randomly censored data

Composite quantile regression with randomly censored data is studied. Moreover, adaptive LASSO methods for composite quantile regression with randomly censored data are proposed. The consistency, asymptotic normality and oracle property of the proposed estimators are established. The proposals are illustrated via simulation studies and the Australian AIDS dataset.     

Variable Selection for Partially Linear Models via Adaptive LASSO

Partially linear model is a class of commonly used semiparametric models, this paper focus on variable selection and parameter estimation for partially linear models via adaptive LASSO method. Firstly, based on profile least squares and adaptive LASSO method, the adaptive LASSO estimator for partially linear models are constructed, and the selections of penalty parameter and bandwidth are discussed. Under some regular conditions, the consistency and asymptotic normality for the estimator are investigated, and it is proved that the adaptive LASSO estimator has the oracle properties. The proposed method can be easily implemented. Finally a Monte Carlo simulation study is conducted to assess the finite sample performance of the proposed variable selection procedure, results show the adaptive LASSO estimator behaves well.     

部分线性单指标模型的复合分位数回归及变量选择

本文提出复合最小化平均分位数损失估计方法 (composite minimizing average check loss estimation,CMACLE)用于实现部分线性单指标模型(partial linear single-index models,PLSIM)的复合分位数回归(composite quantile regression,CQR).首先基于高维核函数构造参数部分的复合分位数回归意义下的相合估计,在此相合估计的基础上,通过采用指标核函数进一步得到参数和非参数函数的可达最优收敛速度的估计,并建立所得估计的渐近正态性,比较PLSIM的CQR估计和最小平均方差估计(MAVE)的相对渐近效率.进一步地,本文提出CQR框架下PLSIM的变量选择方法,证明所提变量选择方法的oracle性质.随机模拟和实例分析验证了所提方法在有限样本时的表现,证实了所提方法的优良性.     

测量误差模型的自适应LASSO变量选择方法研究

本文研究测量误差模型的自适应LASSO(least absolute shrinkage and selection operator)变量选择和系数估计问题.首先分别给出协变量有测量误差时的线性模型和部分线性模型自适应LASSO参数估计量,在一些正则条件下研究估计量的渐近性质,并且证明选择合适的调整参数,自适应LASSO参数估计量具有oracle性质.其次讨论估计的实现算法及惩罚参数和光滑参数的选择问题.最后通过模拟和一个实际数据分析研究了自适应LASSO变量选择方法的表现,结果表明,变量选择和参数估计效果良好.     

Local Weighted Composite Quantile Estimating for Varying Coefficient Models

A generalization of classical linear models is varying coefficient models, which offer a flexible approach to modeling nonlinearity between covariates. A method of local weighted composite quantile regression is suggested to estimate the coefficient functions. The local Bahadur representation of the local estimator is derived and the asymptotic normality of the resulting estimator is established. Comparing to the local least squares estimator, the asymptotic relative efficiency is examined for the local weighted composite quantile estimator. Both theoretical analysis and numerical simulations reveal that the local weighted composite quantile estimator can obtain more efficient than the local least squares estimator for various non-normal errors. In the normal error case, the local weighted composite quantile estimator is almost as efficient as the local least squares estimator. Monte Carlo results are consistent with our theoretical findings. An empirical application demonstrates the potential of the proposed method.     

失混合效应模型的分位回归及变量选择

纵向数据常常用正态混合效应模型进行分析.然而,违背正态性的假定往往会导致无效的推断.与传统的均值回归相比较,分位回归可以给出响应变量条件分布的完整刻画,对于非正态误差分布也可以给稳健的估计结果．本文主要考虑右删失响应下纵向混合效应模型的分位回归估计和变量选择问题．首先,逆删失概率加权方法被用来得到模型的参数估计．其次,结合逆删失概率加权和LASSO惩罚变量选择方法考虑了模型的变量选择问题.蒙特卡洛模拟显示所提方法要比直接删除删失数据的估计方法更具优势．最后,分析了一组艾滋病数据集来展示所提方法的实际应用效果．     

Weighted composite quantile estimation and variable selection method for censored regression model

This paper considers the weighted composite quantile (WCQ) regression for linear model with random censoring. The adaptive penalized procedure for variable selection in this model is proposed, and the consistency, asymptotic normality and oracle property of the resulting estimators are also derived. The simulation studies and the analysis of an acute myocardial infarction data set are conducted to illustrate the finite sample performance of the proposed method.     

Composite quantile regression estimation for P-GARCH processes

We consider the periodic generalized autoregressive conditional heteroskedasticity(P-GARCH) process and propose a robust estimator by composite quantile regression. We study some useful properties about the P-GARCH model. Under some mild conditions, we establish the asymptotic results of proposed estimator.The Monte Carlo simulation is presented to assess the performance of proposed estimator. Numerical study results show that our proposed estimation outperforms other existing methods for heavy tailed distributions.The proposed methodology is also illustrated by Va R on stock price data.     

Simultaneous estimation and variable selection in median regression using Lasso-type penalty

We consider the median regression with a LASSO-type penalty term for variable selection. With the fixed number of variables in regression model, a two-stage method is proposed for simultaneous estimation and variable selection where the degree of penalty is adaptively chosen. A Bayesian information criterion type approach is proposed and used to obtain a data-driven procedure which is proved to automatically select asymptotically optimal tuning parameters. It is shown that the resultant estimator achieves the so-called oracle property. The combination of the median regression and LASSO penalty is computationally easy to implement via the standard linear programming. A random perturbation scheme can be made use of to get simple estimator of the standard error. Simulation studies are conducted to assess the finite-sample performance of the proposed method. We illustrate the methodology with a real example.     

Composite Quantile Regression for Functional Linear Models with Dependent Errors

n this paper, we propose composite quantile regression for functional linear model with dependent data, in which the errors are from a short-range dependent and strictly stationary linear process. The functional principal component analysis is employed to approximate the slope function and the functional predictive variable respectively to construct an estimator of the slope function, and the convergence rate of the estimator is obtained under some regularity conditions. Simulation studies and a real data analysis are presented for illustration of the performance of the proposed estimator.     

�����������ĺ���������ģ�͵ĸ��Ϸ�λ������

??n this paper, we propose composite quantile regression for functional linear model with dependent data, in which the errors are from a short-range dependent and strictly stationary linear process. The functional principal component analysis is employed to approximate the slope function and the functional predictive variable respectively to construct an estimator of the slope function, and the convergence rate of the estimator is obtained under some regularity conditions. Simulation studies and a real data analysis are presented for illustration of the performance of the proposed estimator.     

On the LASSO and its Dual

Abstract

Proposed by Tibshirani, the least absolute shrinkage and selection operator (LASSO) estimates a vector of regression coefficients by minimizing the residual sum of squares subject to a constraint on the l ¹-norm of the coefficient vector. The LASSO estimator typically has one or more zero elements and thus shares characteristics of both shrinkage estimation and variable selection. In this article we treat the LASSO as a convex programming problem and derive its dual. Consideration of the primal and dual problems together leads to important new insights into the characteristics of the LASSO estimator and to an improved method for estimating its covariance matrix. Using these results we also develop an efficient algorithm for computing LASSO estimates which is usable even in cases where the number of regressors exceeds the number of observations. An S-Plus library based on this algorithm is available from StatLib.     

Inference for Spatial Autoregressive Models with Infinite Variance Noises

A self-weighted quantile procedure is proposed to study the inference for a spatial unilateral autoregressive model with independent and identically distributed innovations belonging to the domain of attraction of a stable law with index of stability α, α ∈ (0, 2]. It is shown that when the model is stationary, the self-weighted quantile estimate of the parameter has a closed form and converges to a normal limiting distribution, which avoids the difficulty of Roknossadati and Zarepour (2010) in deriving their limiting distribution for an M-estimate. On the contrary, we show that when the model is not stationary, the proposed estimates have the same limiting distributions as those of Roknossadati and Zarepour. Furthermore, a Wald test statistic is proposed to consider the test for a linear restriction on the parameter, and it is shown that under a local alternative, the Wald statistic has a non-central chisquared distribution. Simulations and a real data example are also reported to assess the performance of the proposed method.     

An effective method to reduce the computational complexity of composite quantile regression

In this article, we aim to reduce the computational complexity of the recently proposed composite quantile regression (CQR). We propose a new regression method called infinitely composite quantile regression (ICQR) to avoid the determination of the number of uniform quantile positions. Unlike the composite quantile regression, our proposed ICQR method allows combining continuous and infinite quantile positions. We show that the proposed ICQR criterion can be readily transformed into a linear programming problem. Furthermore, the computing time of the ICQR estimate is far less than that of the CQR, though it is slightly larger than that of the quantile regression. The oracle properties of the penalized ICQR are also provided. The simulations are conducted to compare different estimators. A real data analysis is used to illustrate the performance.     

大规模数据的L1惩罚分位数回归方法研究--基于特征筛选和随机抽样方法

为解决大规模数据在进行回归分析时存在的计算内存不足和运行时间较长的问题,提出两个新的回归分析方法:先筛选后抽样的大规模数据L₁惩罚分位数回归方法(FSSLQR)和先抽样后筛选的大规模数据L₁惩罚分位数回归方法(SFSLQR),其数值模拟和实际应用结果表明:FSSLQR和SFSLQR方法不仅能够显著降低计算内存和运行时间,而且其估计预测和变量选择的结果与全量L₁惩罚分位数回归基本一致。此外,与Xu等(2018)提出的大规模数据的L1惩罚分位数回归方法(SLQR)相比,FSSLQR和SFSLQR方法在估计预测、变量选择和运行时间等方面都更具优势。     

Composite Quantile Regression Estimation for Left Censored Response Longitudinal Data

For left censored response longitudinal data, we propose a composite quantile regression estimator (CQR) of regression parameter. Statistical properties such as consistency and asymptotic normality of CQR are studied under relaxable assumptions of correlation structure of error terms. The performance of CQR is investigated via simulation studies and a real dataset analysis.     

Adaptive quantile regression with precise risk bounds

An adaptive local smoothing method for nonparametric conditional quantile regression models is considered in this paper. Theoretical properties of the procedure are examined. The proposed method is fully adaptive in the sense that no prior information about the structure of the model is assumed. The fully adaptive feature not only allows varying bandwidths to accommodate jumps or instantaneous slope changes, but also allows the algorithm to be spatially adaptive. Under general conditions, precise risk bounds for homogeneous and heterogeneous cases of the underlying conditional quantile curves are established. An automatic selection algorithm for locally adaptive bandwidths is also given, which is applicable to higher dimensional cases. Simulation studies and data analysis confirm that the proposed methodology works well.     

面板数据分位数回归模型的参数估计与变量选择

本文研究了基于面板数据的分位数回归模型的变量选择问题.通过增加改进的自适应Lasso惩罚项,同时实现了固定效应面板数据的分位数回归和变量选择,得到了模型中参数的选择相合性和渐近正态性.随机模拟验证了该方法的有效性.推广了文献[14]的结论.     

SIMEX Estimation for Composite Quantile Regression Model with Measurement Error

Composite quantile regression model with measurement error is considered. The SIMEX estimators of the unknown regression coefficients are proposed based on the composite quantile regression. The proposed estimators not only eliminate the bias caused by measurement error, but also retain the advantages of the composite quantile regression estimation. The asymptotic properties of the SIMEX estimation are proved under some regular conditions. The finite sample properties of the proposed method are studied by a simulation study, and a real example is analyzed.