SIMEX Estimation for Composite Quantile Regression Model with Measurement Error

Composite quantile regression model with measurement error is considered. The SIMEX estimators of the unknown regression coefficients are proposed based on the composite quantile regression. The proposed estimators not only eliminate the bias caused by measurement error, but also retain the advantages of the composite quantile regression estimation. The asymptotic properties of the SIMEX estimation are proved under some regular conditions. The finite sample properties of the proposed method are studied by a simulation study, and a real example is analyzed.     

���������ĸ��Ϸ�λ���ع��SIMEX����

??Composite quantile regression model with measurement error is considered. The SIMEX estimators of the unknown regression coefficients are proposed based on the composite quantile regression. The proposed estimators not only eliminate the bias caused by measurement error, but also retain the advantages of the composite quantile regression estimation. The asymptotic properties of the SIMEX estimation are proved under some regular conditions. The finite sample properties of the proposed method are studied by a simulation study, and a real example is analyzed.     

Classroom note: A model for considering multicollinearity

In this work a simple and convenient model is proposed for studying features of the multicollinearity effect in regression analysis. Using some reasonable approximations a multivariate regression is reduced to a kind of bivariate regression by each predictor. This approach yields some criteria for identifying the cases of evident multicollinearity, and leads to a better understanding of properties of multiple regression.     

Linear Least Squares Estimation of Regression Models for Two-Dimensional Random Fields

We consider the problem of estimating regression models of two-dimensional random fields. Asymptotic properties of the least squares estimator of the linear regression coefficients are studied for the case where the disturbance is a homogeneous random field with an absolutely continuous spectral distribution and a positive and piecewise continuous spectral density. We obtain necessary and sufficient conditions on the regression sequences such that a linear estimator of the regression coefficients is asymptotically unbiased and mean square consistent. For such regression sequences the asymptotic covariance matrix of the linear least squares estimator of the regression coefficients is derived.     

Efficient estimation for semiparametric varying- coefficient partially linear regression models with current status data

This article considers a semiparametric varying-coefficient partially linear regression model with current status data. The semiparametric varying-coefficient partially linear regression model which is a generalization of the partially linear regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are conducted to examine the small-sample properties of the proposed estimates and a real dataset is used to illustrate our approach.     

有结构变化的半参数回归模型

结合半参数回归模型和含未知变点的结构变化模型提出 一个新的模型\,---\,有结构变化的半参数回归模型, 给出了新模型的有关参数$\beta,\beta^\ast,\gamma,k$的加权最小二乘估计和$f(t)$的核估计, 证明了参数\, $\beta,\beta^\ast,\gamma$的估计的$\sqrt{n}$\,-相合性, 强相合性, 讨论了模型的检验等问题, 并进一步通过随机模拟验证了新模型的优越性.     

Box-Cox变换用于分位数回归曲线相交问题的研究

将Box-Cox变换与分位数回归模型相结合(两阶段法),是分位数回归研究领域的一大进步。该法虽然两步都与分位数回归的检验函数紧密结合,但是由于没有利用分位数回归的优良性质,而是引入了中间参变量,因此增加了模型的累进误差,降低了模型精度。更重要的是,两阶段法没有对于分位数回归领域中普遍出现的分位数回归曲线的相交问题给出解决方法。针对这些问题,经研究应该首先确定Box-Cox变换的参数,避免模型中不确定因素的引入,然后对数据进行整体变换并结合分位数检验函数,直接利用分位数回归的优良性质,最终确定分位数回归模型的参数。实例证明,该方法提高了模型的精度,可以有效地解决分位数回归曲线的相交问题。     

PLSR模型的回归效果分析

本文简单地介绍了多元线性回归、主元回归、部分最小二乘回归模型 ,用实例对三种方法的回归性能进行比较 ,并指出在消除多重共线性、回归系数估计精度及预测精度等方面 ,部分最小二乘回归模型优于其它两种模型     

缺失数据下半参数单调回归模型的估计

研究了响应变量缺失情况下半参数单调回归模型的估计问题。利用嵌入核估计的方法得到了参数部分的估计,在此基础上构造了非参数部分的单调约束最小二乘估计。证明了参数估计的渐近分布为正态分布,得到了非参数部分估计的收敛速度。通过随机模拟研究了有限样本量下估计的表现。     

Support vector machines regression with unbounded sampling

Uniform boundedness of output variables is a standard assumption in most theoretical analysis of regression algorithms. This standard assumption has recently been weaken to a moment hypothesis in least square regression (LSR) setting. Although there has been a large literature on error analysis for LSR under the moment hypothesis, very little is known about the statistical properties of support vector machines regression with unbounded sampling. In this paper, we fill the gap in the literature. Without any restriction on the boundedness of the output sampling, we establish an ad hoc convergence analysis for support vector machines regression under very mild conditions.     

��ָ���λ���ع�ı���ѡ��

多元非参数分位数回归常常是难于估计的, 为了降低维数同时保持非参数估计的灵活性, 人们常常用单指标的方法模拟响应变量的条件分位数. 本文主要研究单指标分位数回归的变量选择. 以最小化平均损失估计为基础, 我们通过最小化具有SCAD惩罚项的平均损失进行变量选择和参数估计. 在正则条件下, 得到了单指标分位数回归SCAD变量选择的Oracle性质, 给出了SCAD变量选择的计算方法, 并通过模拟研究说明了本文所提方法变量选择的样本性质.     

The quantile process under random censoring

In this paper we discuss the asymptotic properties of quantile processes under random censoring. In contrast to most work in this area we prove weak convergence of an appropriately standardized quantile process under the assumption that the quantile regression model is only linear in the region, where the process is investigated. Additionally, we also discuss properties of the quantile process in sparse regression models including quantile processes obtained from the Lasso and adaptive Lasso. The results are derived by a combination of modern empirical process theory, classical martingale methods and a recent result of Kato (2009).     

��Ⱦ�������Իع�ģ�͵���Сһ�˹���

In this paper, linear regression models with contaminated data are considered. Estimation methods for the regression parameters based on least absolute deviations (LAD) are proposed, and properties of consistency and asymptotic normality of the proposed method are proved under some regular conditions. Simulations are done to assess the properties of the method when sample size is small, and simulation results show that the methods works well.     

Linear fuzzy regression

This paper presents an approach which is useful for regression analysis in the case of heterogeneity of a set of observations, for which regression is evaluated. The proposed procedure consists of two stages. First, for a set of observations, fuzzy classification is determined. Due to this, homogenous classes of observations which are of hyperellipsoidal shape, are obtained. Then for each fuzzy class, the so called linear fuzzy regression is evaluated.

In the paper the method of calculating linear fuzzy regression coefficients is given. It is a generalized version of the least squares method. The formula for the values of coefficients is given. Some properties of linear fuzzy regression are analyzed. It is proved that in one- and two-dimensional cases, the formulae are analogous to those for usual regression. A measure of goodness-of-fit and the method of determination of the number of fuzzy classes are also given.

Presented examples indicate the superiority of fuzzy regression in comparison to usual regression in the case of heterogenous observations.     

Composite Quantile Regression Estimation for Left Censored Response Longitudinal Data

For left censored response longitudinal data, we propose a composite quantile regression estimator (CQR) of regression parameter. Statistical properties such as consistency and asymptotic normality of CQR are studied under relaxable assumptions of correlation structure of error terms. The performance of CQR is investigated via simulation studies and a real dataset analysis.     

Estimation of additive quantile regression

We consider the nonparametric estimation problem of conditional regression quantiles with high-dimensional covariates. For the additive quantile regression model, we propose a new procedure such that the estimated marginal effects of additive conditional quantile curves do not cross. The method is based on a combination of the marginal integration technique and non-increasing rearrangements, which were recently introduced in the context of estimating a monotone regression function. Asymptotic normality of the estimates is established with a one-dimensional rate of convergence and the finite sample properties are studied by means of a simulation study and a data example.     

Depth notions for orthogonal regression

Global depth, tangent depth and simplicial depths for classical and orthogonal regression are compared in examples, and properties that are useful for calculations are derived. The robustness of the maximum simplicial depth estimates is shown in examples. Algorithms for the calculation of depths for orthogonal regression are proposed, and tests for multiple regression are transferred to orthogonal regression. These tests are distribution free in the case of bivariate observations. For a particular test problem, the powers of tests that are based on simplicial depth and tangent depth are compared by simulations.     

Penalized maximum likelihood estimation of a stochastic multivariate regression model

We study the large-sample properties of the penalized maximum likelihood estimator of a multivariate stochastic regression model with contemporaneously correlated data. The penalty is in terms of the square norm of some (vector) linear function of the regression coefficients. The model subsumes the so-called common transfer function model useful for extracting common signals in a panel of short time series. We show that, under mild regularity conditions, the penalized maximum likelihood estimator is consistent and asymptotically normal. The asymptotic bias of the regression coefficient estimator is also derived.     

Asymptotic properties of a particular nonlinear regression quantile estimation

In this paper we shall be concerned with the asymptotic properties of the regression quantile estimation in the nonlinear regression time series models. For these, first we prove the strong consistency and derive the asymptotic normality of the regression quantile estimators for a particular sinusoidal regression model with a simple harmonic component. Next, we extend the results to more complicated sinusoidal models of several harmonic components.     

Efficient estimation and variable selection for infinite variance autoregressive models

In this paper, a self-weighted composite quantile regression estimation procedure is developed to estimate unknown parameter in an infinite variance autoregressive (IVAR) model. The proposed estimator is asymptotically normal and more efficient than a single quantile regression estimator. At the same time, the adaptive least absolute shrinkage and selection operator (LASSO) for variable selection are also suggested. We show that the adaptive LASSO based on the self-weighted composite quantile regression enjoys the oracle properties. Simulation studies and a real data example are conducted to examine the performance of the proposed approaches.