Variable selection via quantile regression with the process of Ornstein-Uhlenbeck type

Based on the data-cutoff method,we study quantile regression in linear models,where the noise process is of Ornstein-Uhlenbeck type with possible jumps.In single-level quantile regression,we allow the noise process to be heteroscedastic,while in composite quantile regression,we require that the noise process be homoscedastic so that the slopes are invariant across quantiles.Similar to the independent noise case,the proposed quantile estimators are root-n consistent and asymptotic normal.Furthermore,the adaptive least absolute shrinkage and selection operator(LASSO)is applied for the purpose of variable selection.As a result,the quantile estimators are consistent in variable selection,and the nonzero coefficient estimators enjoy the same asymptotic distribution as their counterparts under the true model.Extensive numerical simulations are conducted to evaluate the performance of the proposed approaches and foreign exchange rate data are analyzed for the illustration purpose.     

The quantile process under random censoring

In this paper we discuss the asymptotic properties of quantile processes under random censoring. In contrast to most work in this area we prove weak convergence of an appropriately standardized quantile process under the assumption that the quantile regression model is only linear in the region, where the process is investigated. Additionally, we also discuss properties of the quantile process in sparse regression models including quantile processes obtained from the Lasso and adaptive Lasso. The results are derived by a combination of modern empirical process theory, classical martingale methods and a recent result of Kato (2009).     

Asymptotics for estimation of quantile regressions with truncated infinite-dimensional processes

Many processes can be represented in a simple form as infinite-order linear series. In such cases, an approximate model is often derived as a truncation of the infinite-order process, for estimation on the finite sample. The literature contains a number of asymptotic distributional results for least squares estimation of such finite truncations, but for quantile estimation, results are not available at a level of generality that accommodates time series models used as finite approximations to processes of potentially unbounded order. Here we establish consistency and asymptotic normality for conditional quantile estimation of truncations of such infinite-order linear models, with the truncation order increasing in sample size. We focus on estimation of the model at a given quantile. The proofs use the generalized functions approach and allow for a wide range of time series models as well as other forms of regression model. The results are illustrated with both analytical and simulation examples.     

����ʼ�Ȩ���������ģ������Ӧ������λ������ľ�����Ȼͳ���ƶ�

本文对两个样本数据不完全的线性模型展开讨论, 其中线性模型协变量的观测值不缺失, 响应变量的观测值随机缺失(MAR). 我们采用逆概率加权填补方法对响应变量的缺失值进行补足, 得到两个线性回归模型``完全'样本数据, 在``完全'样本数据的基础上构造了响应变量分位数差异的对数经验似然比统计量. 与以往研究结果不同的是本文在一定条件下证明了该统计量的极限分布为标准, 降低了由于权系数估计带来的误差, 进一步构造出了精度更高的分位数差异的经验似然置信区间.     

Local Weighted Composite Quantile Estimating for Varying Coefficient Models

A generalization of classical linear models is varying coefficient models, which offer a flexible approach to modeling nonlinearity between covariates. A method of local weighted composite quantile regression is suggested to estimate the coefficient functions. The local Bahadur representation of the local estimator is derived and the asymptotic normality of the resulting estimator is established. Comparing to the local least squares estimator, the asymptotic relative efficiency is examined for the local weighted composite quantile estimator. Both theoretical analysis and numerical simulations reveal that the local weighted composite quantile estimator can obtain more efficient than the local least squares estimator for various non-normal errors. In the normal error case, the local weighted composite quantile estimator is almost as efficient as the local least squares estimator. Monte Carlo results are consistent with our theoretical findings. An empirical application demonstrates the potential of the proposed method.     

Asymptotic normality of Powell’s kernel estimator

We establish asymptotic normality of Powell’s kernel estimator for the asymptotic covariance matrix of the quantile regression estimator for both i.i.d. and weakly dependent data. As an application, we derive the optimal bandwidth that minimizes the approximate mean squared error of the kernel estimator. We also derive the corresponding results to censored quantile regression.     

Hierarchical linear regression models for conditional quantiles

The quantile regression has several useful features and therefore is gradually developing into a comprehensive approach to the statistical analysis of linear and nonlinear response models, but it cannot deal effectively with the data with a hierarchical structure. In practice, the existence of such data hierarchies is neither accidental nor ignorable, it is a common phenomenon. To ignore this hierarchical data structure risks overlooking the importance of group effects, and may also render many of the traditional statistical analysis techniques used for studying data relationships invalid. On the other hand, the hierarchical models take a hierarchical data structure into account and have also many applications in statistics, ranging from overdispersion to constructing min-max estimators. However, the hierarchical models are virtually the mean regression, therefore, they cannot be used to characterize the entire conditional distribution of a dependent variable given high-dimensional covariates. Furthermore, the estimated coefficient vector (marginal effects) is sensitive to an outlier observation on the dependent variable. In this article, a new approach, which is based on the Gauss-Seidel iteration and taking a full advantage of the quantile regression and hierarchical models, is developed. On the theoretical front, we also consider the asymptotic properties of the new method, obtaining the simple conditions for an n1/2-convergence and an asymptotic normality. We also illustrate the use of the technique with the real educational data which is hierarchical and how the results can be explained.     

Risk analysis with categorical explanatory variables

To better forecast the Value-at-Risk of the aggregate insurance losses, Heras et al. (2018) propose a two-step inference of using logistic regression and quantile regression without providing detailed model assumptions, deriving the related asymptotic properties, and quantifying the inference uncertainty. This paper argues that the application of quantile regression at the second step is not necessary when explanatory variables are categorical. After describing the explicit model assumptions, we propose another two-step inference of using logistic regression and the sample quantile. Also, we provide an efficient empirical likelihood method to quantify the uncertainty. A simulation study confirms the good finite sample performance of the proposed method.     

随机插补下两线性模型中响应变量分位数差异的经验似然置信区间

设两个样本数据不完全的线性模型,其中协变量的观测值不缺失,响应变量的观测值随机缺失。采用随机回归插补法对响应变量的缺失值进行补足,得到两个线性回归模型的"完全"样本数据,在一定条件下得到两响应变量分位数差异的对数经验似然比统计量的极限分布为加权x_1~2,并利用此结果构造分位数差异的经验似然置信区间。模拟结果表明在随机插补下得到的置信区间具有较高的覆盖精度。     

Bayesian quantile regression model for claim count data

Quantile regression model estimates the relationship between the quantile of a response distribution and the regression parameters, and has been developed for linear models with continuous responses. In this paper, we apply Bayesian quantile regression model for the Malaysian motor insurance claim count data to study the effects of change in the estimates of regression parameters (or the rating factors) on the magnitude of the response variable (or the claim count). We also compare the results of quantile regression models from the Bayesian and frequentist approaches and the results of mean regression models from the Poisson and negative binomial. Comparison from Poisson and Bayesian quantile regression models shows that the effects of vehicle year decrease as the quantile increases, suggesting that the rating factor has lower risk for higher claim counts. On the other hand, the effects of vehicle type increase as the quantile increases, indicating that the rating factor has higher risk for higher claim counts.     

一个有效估计:半参数非时齐扩散模型的局部线性复合分位回归估计

主要研究半参数非时齐扩散模型的参数估计问题.基于非时齐扩散模型的离散观测样本,首先得到漂移参数的局部线性复合分位回归估计,并证明估计量的渐近偏差、渐近方差和渐近正态性.其次,讨论了带宽的选择和局部线性复合分位回归估计关于局部线性最小二乘估计的渐近相对效,所得到的局部估计较局部线性最小二乘估计更为有效.最后,通过模拟说明了局部线性复合分位回归估计比局部线性最小二乘估计的模拟效果更好.     

Quantile estimations via modified Cholesky decomposition for longitudinal single-index models

Quantile regression is a powerful complement to the usual mean regression and becomes increasingly popular due to its desirable properties. In longitudinal studies, it is necessary to consider the intra-subject correlation among repeated measures over time to improve the estimation efficiency. In this paper, we focus on longitudinal single-index models. Firstly, we apply the modified Cholesky decomposition to parameterize the intra-subject covariance matrix and develop a regression approach to estimate the parameters of the covariance matrix. Secondly, we propose efficient quantile estimating equations for the index coefficients and the link function based on the estimated covariance matrix. Since the proposed estimating equations include a discrete indicator function, we propose smoothed estimating equations for fast and accurate computation of the index coefficients, as well as their asymptotic covariances. Thirdly, we establish the asymptotic properties of the proposed estimators. Finally, simulation studies and a real data analysis have illustrated the efficiency of the proposed approach.

     

基于最小二乘近似的模型平均方法

本文提出基于最小二乘近似的模型平均方法.该方法可用于线性模型、广义线性模型和分位数回归等各种常用模型.特别地,经典的Mallows模型平均方法是该方法的特例.现存的模型平均文献中,渐近分布的证明一般需要局部误设定假设,所得的极限分布的形式也比较复杂.本文将在不使用局部误设定假设的情形下证明该方法的渐近正态性.另外,本文将该方法发展到维数发散的情形.数值结果显示了该方法的优势.     

SIMEX Estimation for Composite Quantile Regression Model with Measurement Error

Composite quantile regression model with measurement error is considered. The SIMEX estimators of the unknown regression coefficients are proposed based on the composite quantile regression. The proposed estimators not only eliminate the bias caused by measurement error, but also retain the advantages of the composite quantile regression estimation. The asymptotic properties of the SIMEX estimation are proved under some regular conditions. The finite sample properties of the proposed method are studied by a simulation study, and a real example is analyzed.     

���������ĸ��Ϸ�λ���ع��SIMEX����

??Composite quantile regression model with measurement error is considered. The SIMEX estimators of the unknown regression coefficients are proposed based on the composite quantile regression. The proposed estimators not only eliminate the bias caused by measurement error, but also retain the advantages of the composite quantile regression estimation. The asymptotic properties of the SIMEX estimation are proved under some regular conditions. The finite sample properties of the proposed method are studied by a simulation study, and a real example is analyzed.     

Variable selection and coefficient estimation via composite quantile regression with randomly censored data

Composite quantile regression with randomly censored data is studied. Moreover, adaptive LASSO methods for composite quantile regression with randomly censored data are proposed. The consistency, asymptotic normality and oracle property of the proposed estimators are established. The proposals are illustrated via simulation studies and the Australian AIDS dataset.     

Two-step generalised empirical likelihood inference for semiparametric models

This paper shows how the generalised empirical likelihood method can be used to obtain valid asymptotic inference for the finite dimensional component of semiparametric models defined by a set of moment conditions. The results of the paper are illustrated using three well-known semiparametric regression models: partially linear single index, linear transformation with random censoring, and quantile regression with random censoring. Monte Carlo simulations suggest that some of the proposed test statistics have competitive finite sample properties. The results of the paper are applied to test for functional misspecification in a hedonic price model of a housing market.     

Joint modeling for mixed-effects quantile regression of longitudinal data with detection limits and covariates measured with error,with application to AIDS studies

It is very common in AIDS studies that response variable (e.g., HIV viral load) may be subject to censoring due to detection limits while covariates (e.g., CD4 cell count) may be measured with error. Failure to take censoring in response variable and measurement errors in covariates into account may introduce substantial bias in estimation and thus lead to unreliable inference. Moreover, with non-normal and/or heteroskedastic data, traditional mean regression models are not robust to tail reactions. In this case, one may find it attractive to estimate extreme causal relationship of covariates to a dependent variable, which can be suitably studied in quantile regression framework. In this paper, we consider joint inference of mixed-effects quantile regression model with right-censored responses and errors in covariates. The inverse censoring probability weighted method and the orthogonal regression method are combined to reduce the biases of estimation caused by censored data and measurement errors. Under some regularity conditions, the consistence and asymptotic normality of estimators are derived. Finally, some simulation studies are implemented and a HIV/AIDS clinical data set is analyzed to to illustrate the proposed procedure.     

Composite Quantile Regression Estimation for Left Censored Response Longitudinal Data

For left censored response longitudinal data, we propose a composite quantile regression estimator (CQR) of regression parameter. Statistical properties such as consistency and asymptotic normality of CQR are studied under relaxable assumptions of correlation structure of error terms. The performance of CQR is investigated via simulation studies and a real dataset analysis.