删失分位数回归模型基于扩展兴趣信息准则的平均估计

本文结合分位数回归技术,基于删失回归模型,把Claeskens和Hjort的传统兴趣信息准侧(focused information criterion,FIC)扩展到兴趣向量的情形,提出扩展的兴趣信息准则(extended focused information criterion,E-FIC),有效解决了同时针对多个兴趣参数的平均估计问题,并且对删失响应变量的不同水平分位数进行建模,以全面反映响应变量分布特征,有效克服异常值和厚尾模型误差的影响.基于扩展的兴趣信息准则给出参数的平均估计方法,证明估计的渐近性质.通过Monte Carlo随机模拟试验比较所提估计方法和最小二乘方法在有限样本量下的表现,用所提方法对原发性胆汁性肝硬化数据集进行数据分析.     

考虑决策目标的FIC模型选择

收益管理优化是提高零售商经济收益的有效途径之一.定价是收益管理的引擎和核心技术,对于提高零售商的收益具有重要作用.考虑到在收益管理的实际应用中,预测和优化问题的复杂性,通常采用先对产品需求进行预测,然后对收益进行优化的步骤.在对产品需求进行预测时,通常会面临多个候选模型,即面临模型的不确定性,这时一般会采用模型选择方法确定最终的模型.但传统的模型选择准则包括赤池信息准则(Akaike information criterion,AIC),贝叶斯信息准则(Bayesian information criterion,BIC)等通常只考虑了模型选择对预测精度的影响,而不考虑该预测模型会如何影响接下来的优化决策目标.本文首次在商品的收益管理优化中提出最小化聚焦信息准则(focused information criterion,FIC)这种模型选择准则,运用FIC模型选择准则选择产品需求预测模型,考虑了优化模型的结构,以最小化决策误差,而不是预测误差为目标,来选择预测模型.数值模拟结果表明,在大部分情况下,相比于AIC和BIC两种模型选择准则,考虑决策目标的FIC模型选择准则表现最佳.同时,...     

广义矩估计模型平均

模型平均方法以其稳健性好,遗失有用信息少等诸多优点而成为目前统计学和计量经济学界研究的热门问题,在经济,金融,生物,医学等领域有着广泛的应用前景.在模型平均的理论研究过程中如何选取权重是最重要的问题.现存的模型平均方法大都是在最小二乘估计的基础上研究的,并且大多数通过光滑AIC,光滑BIC和最小化Mallow准则得到组合的权重.但是在广义矩估计的基础上模型平均的研究还很不完善,文章在广义矩估计条件下提出了通过最小化目标参数平均估计量的渐近方差来获取权重.这种方法使得所得到的平均估计更加的稳健.蒙特卡洛模拟实验显示文章获得的模型平均估计量的风险与光滑AIC,光滑BIC和MMA相比相对较低.     

异方差线性测量误差模型的平均估计

频率模型平均估计近年来受到较多关注,但目前文献对有测量误差数据的模型平均估计方法研究较少.文章考虑异方差线性测量误差模型平均估计方法,基于Mallows权重选择准则提出了新的模型平均估计,并在理论上证明了其渐近最优性.模拟结果表明,新方法相较于一些常用的模型平均(如SAIC,SBIC)与模型选择方法(如AIC,BIC)具有较大优势.     

网络结构数据空间回归模型的平均估计

采用空间误差模型对数据的网络结构关系进行刻画,考虑了空间误差模型的S-AIC和S-BIC模型平均估计方法,证明了S-AIC和S-BIC估计的相合性和渐近正态性.通过蒙特卡洛模拟试验,研究了所提估计的有限样本性质,模拟结果显示,S-AIC和S-BIC模型平均估计表现优于AIC和BIC模型选择估计.利用文章所提方法,对QQ用户数据进行实证分析,说明了所提方法在实际问题中的应用价值.     

基于GMVAR模型的货币供应量的预测分析

为分析和预测货币供应量的变化趋势,建立了M0供应量的同比增长率RM0与M2供应量的同比增长率RM2的GMVAR(2,2)模型和VAR(2,2)模型.通过对比AIC和BIC发现GMVAR(2,2)模型明显优于一般VAR(2,2)模型.对未知参数进行最大似然估计,发现GMVAR(2,2)模型参数估计的效果较好.通过使用GM...     

分位数变系数模型基于核光滑的变量选择

分位数变系数模型是一种稳健的非参数建模方法.使用变系数模型分析数据时,一个自然的问题是如何同时选择重要变量和从重要变量中识别常数效应变量.本文基于分位数方法研究具有稳健和有效性的估计和变量选择程序.利用局部光滑和自适应组变量选择方法,并对分位数损失函数施加双惩罚,我们获得了惩罚估计.通过BIC准则合适地选择调节参数,提出的变量选择方法具有oracle理论性质,并通过模拟研究和脂肪实例数据分析来说明新方法的有用性.数值结果表明,在不需要知道关于变量和误差分布的任何信息前提下,本文提出的方法能够识别不重要变量同时能区分出常数效应变量.     

协变量缺失下部分线性模型的模型选择和模型平均

本文研究了协变量随机缺失下部分线性模型的模型选择和模型平均问题.首先利用逆概率加权方法得出了线性回归系数和非参数函数的估计,并在局部误设定框架下证明了线性回归系数估计量的渐近正态性.然后构造了兴趣参数的兴趣信息准则和频数模型平均估计量,并根据该模型平均估计量构造了一个覆盖真实参数的概率趋于预定水平的置信区间.模拟研究和实例分析分别说明了本方法的优越性和实用性.     

半参数广义线性混合效应模型的估计及其渐近性质

半参数广义线性混合效应模型在心理学、生物育种、医学等领域有广泛的应用. Zhang(1998)用最大惩罚似然函数的方法(MPLE)对模型的参数和非参数部分进行了估计, 而Zhang (1998) MPLE方法只适用于正态数据模型. 对于泊松等常用的模型, 常的方法是将随机效应看作缺失数据, 再引入EM算法. 本文基于McCulloch 1997)提出的MCNR算法, 此算法推广到半参数广义线性混合效应模型中并得到相应的估计算法. 于非参数部分, 本文采用P样条拟合并利用GCV方法选取光滑参数, 时证明了所得估计的相合性和渐近正态性. 最后, 过模拟和实例与其它算法作比较验证本文估计方法的有效性.     

测量误差模型的自适应LASSO变量选择方法研究

本文研究测量误差模型的自适应LASSO(least absolute shrinkage and selection operator)变量选择和系数估计问题.首先分别给出协变量有测量误差时的线性模型和部分线性模型自适应LASSO参数估计量,在一些正则条件下研究估计量的渐近性质,并且证明选择合适的调整参数,自适应LASSO参数估计量具有oracle性质.其次讨论估计的实现算法及惩罚参数和光滑参数的选择问题.最后通过模拟和一个实际数据分析研究了自适应LASSO变量选择方法的表现,结果表明,变量选择和参数估计效果良好.     

A general framework for frequentist model averaging In Celebration of Professor Lincheng Zhao's 75th Birthday

Model selection strategies have been routinely employed to determine a model for data analysis in statistics, and further study and inference then often proceed as though the selected model were the true model that were known a priori. Model averaging approaches, on the other hand, try to combine estimators for a set of candidate models. Specifically, instead of deciding which model is the 'right' one, a model averaging approach suggests to fit a set of candidate models and average over the estimators using data adaptive weights.In this paper we establish a general frequentist model averaging framework that does not set any restrictions on the set of candidate models. It broaden, the scope of the existing methodologies under the frequentist model averaging development. Assuming the data is from an unknown model, we derive the model averaging estimator and study its limiting distributions and related predictions while taking possible modeling biases into account.We propose a set of optimal weights to combine the individual estimators so that the expected mean squared error of the average estimator is minimized. Simulation studies are conducted to compare the performance of the estimator with that of the existing methods. The results show the benefits of the proposed approach over traditional model selection approaches as well as existing model averaging methods.     

Robust Model Averaging Method Based on LOF Algorithm

Model averaging is a good alternative to model selection, which can deal with the uncertainty from model selection process and make full use of the information from various candidate models. However, most of the existing model averaging criteria do not consider the influence of outliers on the estimation procedures. The purpose of this paper is to develop a robust model averaging approach based on the local outlier factor (LOF) algorithm which can downweight the outliers in the covariates. Asymptotic optimality of the proposed robust model averaging estimator is derived under some regularity conditions. Further, we prove the consistency of the LOF-based weight estimator tending to the theoretically optimal weight vector. Numerical studies including Monte Carlo simulations and a real data example are provided to illustrate our proposed methodology.     

Variable selection for single-index varying-coefficient model

We consider the problem of variable selection for single-index varying-coefficient model, and present a regularized variable selection procedure by combining basis function approximations with SCAD penalty. The proposed procedure simultaneously selects significant covariates with functional coefficients and local significant variables with parametric coefficients. With appropriate selection of the tuning parameters, the consistency of the variable selection procedure and the oracle property of the estimators are established. The proposed method can naturally be applied to deal with pure single-index model and varying-coefficient model. Finite sample performances of the proposed method are illustrated by a simulation study and the real data analysis.     

An improved model averaging scheme for logistic regression

Recently, penalized regression methods have attracted much attention in the statistical literature. In this article, we argue that such methods can be improved for the purposes of prediction by utilizing model averaging ideas. We propose a new algorithm that combines penalized regression with model averaging for improved prediction. We also discuss the issue of model selection versus model averaging and propose a diagnostic based on the notion of generalized degrees of freedom. The proposed methods are studied using both simulated and real data.     

Frequentist model averaging for linear mixed-effects models

Linear mixed-effects models are a powerful tool for the analysis of longitudinal data. The aim of this paper is to study model averaging for linear mixed-effects models. The asymptotic distribution of the frequentist model average estimator is derived, and a confidence interval procedure with an actual coverage probability that tends to the nominal level in large samples is developed. The two confidence intervals based on the model averaging and based on the full model are shown to be asymptotically equivalent. A simulation study shows good finite sample performance of the model average estimators.     

基于最小二乘近似的模型平均方法

本文提出基于最小二乘近似的模型平均方法.该方法可用于线性模型、广义线性模型和分位数回归等各种常用模型.特别地,经典的Mallows模型平均方法是该方法的特例.现存的模型平均文献中,渐近分布的证明一般需要局部误设定假设,所得的极限分布的形式也比较复杂.本文将在不使用局部误设定假设的情形下证明该方法的渐近正态性.另外,本文...     

On estimation of survival function under random censoring model

We study an estimator of the survival function under the random censoring model. Bahadur-type representation of the estimator is obtained and asymptotic expression for its mean squared errors is given, which leads to the consistency and asymptotic normality of the estimator. A data-driven local bandwidth selection rule for the estimator is proposed. It is worth noting that the estimator is consistent at left boundary points, which contrasts with the cases of density and hazard rate estimation. A Monte Carlo comparison of different estimators is made and it appears that the proposed data-driven estimators have certain advantages over the common Kaplan-Meier estmator.     

Frequentist model averaging for threshold models

Annals of the Institute of Statistical Mathematics - This paper develops a frequentist model averaging approach for threshold model specifications. The resulting estimator is proved to be...     

Model selection bias and Freedman’s paradox

In situations where limited knowledge of a system exists and the ratio of data points to variables is small, variable selection methods can often be misleading. Freedman (Am Stat 37:152–155, 1983) demonstrated how common it is to select completely unrelated variables as highly “significant” when the number of data points is similar in magnitude to the number of variables. A new type of model averaging estimator based on model selection with Akaike’s AIC is used with linear regression to investigate the problems of likely inclusion of spurious effects and model selection bias, the bias introduced while using the data to select a single seemingly “best” model from a (often large) set of models employing many predictor variables. The new model averaging estimator helps reduce these problems and provides confidence interval coverage at the nominal level while traditional stepwise selection has poor inferential properties.