基于局部多项式展开的多元非参数模型贝叶斯带宽选择

在多元非参数模型中带宽和阶的选择对局部多项式估计量的表现十分重要。本文基于交叉验证准则提出一个自适应贝叶斯带宽选择方法。在给定的误差密度函数下,该方法可推导出对应的似然函数,并构造带宽参数的后验密度函数。随后,通过带宽的后验期望可同时获得阶和带宽的估计。数值模拟的结果表明,该方法不仅比大拇指准则方法精确,且比交叉验证方法耗时更少。与此同时,与Nadaraya-Watson估计相比,所提带宽选择方法对多元非参数模型的适应性要更好。最后,本文通过一组实际数据说明有限样本下所提贝叶斯带宽选择的表现很好。     

Local Polynomial Fitting with Long-Memory, Short-Memory and Antipersistent Errors

Local polynomial smoothing for the trend function and its derivatives in nonparametric regression with long-memory, short-memory and antipersistent errors is considered. We show that in the case of antipersistence, the convergence rate of a nonparametric regression estimator is faster than for uncorrelated or short-range dependent errors. Moreover, it is shown that unified asymptotic formulas for the optimal bandwidth and the MSE hold for all of the three dependence structures. Also, results on estimation at the boundary are included. A bandwidth selector for nonparametric regression with different types of dependent errors is proposed. Its asymptotic property is investigated. The practical performance of the proposal is illustrated by simulated and real data examples.     

The Fast RODEO for Local Polynomial Regression

An open challenge in nonparametric regression is finding fast, computationally efficient approaches to estimating local bandwidths for large datasets, in particular in two or more dimensions. In the work presented here, we introduce a novel local bandwidth estimation procedure for local polynomial regression, which combines the greedy search of the regularization of the derivative expectation operator (RODEO) algorithm with linear binning. The result is a fast, computationally efficient algorithm, which we refer to as the fast RODEO. We motivate the development of our algorithm by using a novel scale-space approach to derive the RODEO. We conclude with a toy example and a real-world example using data from the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) satellite validation study, where we show the fast RODEO’s improvement in accuracy and computational speed over two other standard approaches.     

Recursive Estimation of Regression Functions by Local Polynomial Fitting

The recursive estimation of the regression function m(x) = E(Y/X = x) and its derivatives is studied under dependence conditions. The examined method of nonparametric estimation is a recursive version of the estimator based on locally weighted polynomial fitting, that in recent articles has proved to be an attractive technique and has advantages over other popular estimation techniques. For strongly mixing processes, expressions for the bias and variance of these estimators are given and asymptotic normality is established. Finally, a simulation study illustrates the proposed estimation method.     

基于局部多项式回归的模型校准抽样估计研究

在抽样估计中,当研究变量与辅助变量之间呈非线性关系时,传统的校准估计方法效果较差,基于非参数回归方法的模型校准估计量则可以很好地解决这一问题。首先,建立描述研究变量和辅助变量之间关系的超总体回归模型,使用非参数中的局部多项式方法得出模型参数的拟合值,并结合校准估计得出局部多项式模型校准估计量,同时给出其方差和方差估计量公式,证明了该估计量具有渐近无偏性、一致性和渐近正态性等优良的统计性质。然后,使用仿真模拟的方法证明在研究变量与研究变量之间呈非线性关系时,该估计量有良好的估计效果。最后,对该估计量在我国政府统计中的应用进行简单的介绍。     

Data Adaptive Ridging in Local Polynomial Regression

Abstract

When estimating a regression function or its derivatives, local polynomials are an attractive choice due to their flexibility and asymptotic performance. Seifert and Gasser proposed ridging of local polynomials to overcome problems with variance for random design while retaining their advantages. In this article we present a data-independent rule of thumb and a data-adaptive spatial choice of the ridge parameter in local linear regression. In a framework of penalized local least squares regression, the methods are generalized to higher order polynomials, to estimation of derivatives, and to multivariate designs. The main message is that ridging is a powerful tool for improving the performance of local polynomials. A rule of thumb offers drastic improvements; data-adaptive ridging brings further but modest gains in mean square error.     

非参数局部多项式回归估计的最优子抽样算法

随着科学技术的发展,虽然人们提高了收集和处理数据的能力,但仍存在一些大数据集超出了现有计算机的计算能力.目前,抽取一部分样本来替代全样本进行建模计算是减轻计算负担的一种方法.大数据背景下线性模型的子抽样方法已经得到了相对成熟的研究,在减轻计算量方面获得了很大的优势.文章将线性模型下的子抽样方法推广到非参数回归模型,并推...     

Universal Consistency of Local Polynomial Kernel Regression Estimates

Regression function estimation from independent and identically distributed data is considered. The L ₂ error with integration with respect to the design measure is used as an error criterion. It is shown that suitably defined local polynomial kernel estimates are weakly and strongly universally consistent, i.e., it is shown that the L ₂ errors of these estimates converge to zero almost surely and in L ₁ for all distributions.     

Logistic回归模型选择的渐近概率

在许多情况下，我们需要对logistic回归模型中的重要变量进行选择，在本文中，我们对从信息论准则AIC选择出的模型给出了渐近分布和渐近概率。     

Detecting Change Points in Polynomial Regression Models with an Application to Cable Data Sets

In this paper, the Schwarz Information Criterion (SIC) is used to detect the change points in polynomial regression models. Switching quadratic regression models with same amount of model deviation and switching polynomial regression models with different amount of model deviation for different segments of regression are considered. The number of separate regimes and their corresponding regression orders are assume to be known. The method is then applied to cable data sets and the change points are successfully detected.     

基于协整分析和局部多项式回归的兵团经济增长实证分析

采用协整分析,实证分析了兵团的投资、消费与经济增长之间的关系,研究发现三者之间存在长期稳定的关系,但是由格兰杰因果检验发现投资和消费均不是兵团GDP增长的因。为进一步明确投资和消费对兵团经济的影响,采用岭回归的思想改进局部多项式方法,用当期投资,前一期投资和当期消费拟合兵团GDP,得到GDP对前述变量的偏导数值,进而利用这些偏导数来评价投资、消费对经济增长的影响。研究发现投资、消费对经济增长的作用呈现明显的非线性关系,有很强的时期性。     

Improved Model Selection Method for a Regression Function with Dependent Noise

This paper is devoted to nonparametric estimation, through the -risk, of a regression function based on observations with spherically symmetric errors, which are dependent random variables (except in the normal case). We apply a model selection approach using improved estimates. In a nonasymptotic setting, an upper bound for the risk is obtained (oracle inequality). Moreover asymptotic properties are given, such as upper and lower bounds for the risk, which provide optimal rate of convergence for penalized estimators.     

纵向数据半参数回归模型的最小二乘局部线性估计

本文考虑纵向数据半参数回归模型:Yij=XiTjβ+g(Tij)+iεj,基于最小二乘法和局部线性拟合的方法建立了模型中参数分量β,回归函数g(.)和误差方差σ2的估计,在适当条件下给出了估计量的相合性,通过模拟研究说明了该方法在有限样本情况下具有良好的性质。     

空间自相关地理加权回归模型的估计

地理加权回归作为一类能有效处理回归分析中空间非平稳性现象的建模技术,在多类问题的研究得到了广泛的应用.主要讨论这类空间计量经济学模型在空间自相关情形下的估计问题.首先,对于因变量含有空间滞后项的地理加权回归模型,分别给出了局部似然估计和两步估计两种方法.其次,考虑了误差空间自相关下地理加权回归模型的估计问题.     

Asymptotic Behavior of Bandwidth Selected by the Cross-Validation Method for Local Polynomial Fitting

In this paper, the asymptotic optimality of the cross validation bandwidth selector for the local polynomial fitting under strongly mixing dependence is obtained. The asymptotic normality of the bandwidth selected by the cross-validation method is derived, which is an extension of W. Härdle, P. Hall, and J. S. Marron (1988, J. Am. Statist. Assoc.83, 86–101).     

Interaction Model and Model Selection for Function-on-Function Regression

Regression models with interaction effects have been widely used in multivariate analysis to improve model flexibility and prediction accuracy. In functional data analysis, however, due to the challenges of estimating three-dimensional coefficient functions, interaction effects have not been considered for function-on-function linear regression. In this article, we propose function-on-function regression models with interaction and quadratic effects. For a model with specified main and interaction effects, we propose an efficient estimation method that enjoys a minimum prediction error property and has good predictive performance in practice. Moreover, converting the estimation of three-dimensional coefficient functions of the interaction effects to the estimation of two- and one-dimensional functions separately, our method is computationally efficient. We also propose adaptive penalties to account for varying magnitudes and roughness levels of coefficient functions. In practice, the forms of the models are usually unspecified. We propose a stepwise procedure for model selection based on a predictive criterion. This method is implemented in our R package FRegSigComp. Supplemental materials are available online.     

ɾʧ�ع�ģ����һ��LASSO�ͱ���ѡ��͹��Ʒ���

删失回归模型是一种很重要的模型,它在计量经济学中有着广泛的应用. 然而,它的变量选择问题在现今的参考文献中研究的比较少.本文提出了一个LASSO型变量选择和估计方法,称之为多样化惩罚$L_1$限制方法, 简称为DPLC. 另外,我们给出了非0回归系数估计的大样本渐近性质. 最后,大量的模拟研究表明了DPLC方法和一般的最优子集选择方法在变量选择和估计方面有着相同的能力.     

面板数据分位回归中适应性LASSO调节参数的选择

在带有罚函数的变量选择中,调节参数的选择是一个关键性问题,但遗憾的是,在大多数文献中,调节参数选择的方法较为模糊,多凭经验,缺乏系统的理论方法.本文基于含随机效应的面板数据模型,提出分位回归中适应性LASSO调节参数的选择标准惩罚交叉验证准则(PCV),并讨论比较了该准则与其他选择调节参数的准则的效果.通过对不同分位点进行模拟,我们发现当残差E来自尖峰分布和厚尾分布时,该准则能更好地估计模型参数,尤其对于高分位点和低分位点而言.选取其他分位点时,PCV的效果虽稍逊色于Schwarz信息准则,但明显优于A1kaike 信息准则和交叉验证准则.且在选择变量的准确性方面,该准则比Schwarz信息准则、Akaike信息准则等更加有效.文章最后对我国各地区多个宏观经济指标的面板数据进行建模分析,展示了惩罚交叉验证准则的性能,得到了在不同分位点处宏观经济指标之间的回归关系.     

删失数据下的变系数回归模型

研究了删失数据下的变系数回归模型．通过数据变换,利用局部多项式方法,给出了系数函数的局部加权最小二乘估计．证明了该估计的渐近偏差和渐近方差,同时获得了该估计的渐近正态性．     

基于Monte Carlo模拟比较K近邻和局部线性分位数回归

局部线性分位数回归是目前比较流行的非参数分位数回归,其潜在假定待估函数线性光滑.K近邻分位数回归也是非参数分位数回归的重要组成部分,其具有不需待估函数光滑和不同分位点的回归曲线不相交等优点.通过Monte Carlo模拟,比较了两者的估计,得到当待估函数的跳跃点或突变点比较多时,K近邻分位数回归的拟合效果优于局部线性回归.其中模拟的函数是Blocks、Bumps和HeaviSine的函数,它们分别代表跳跃性、波动性、斜率突变性的函数.