固定设计与随机设计下模型选择的简单方法及其相合性研究

本文研究了固定设计和随机设计下线性回归模型的选择问题,建立了两种模型通用的选择准则,该准则计算简单,并且在一定的条件下具有强相合性.     

面板数据分位回归中适应性LASSO调节参数的选择

在带有罚函数的变量选择中,调节参数的选择是一个关键性问题,但遗憾的是,在大多数文献中,调节参数选择的方法较为模糊,多凭经验,缺乏系统的理论方法.本文基于含随机效应的面板数据模型,提出分位回归中适应性LASSO调节参数的选择标准惩罚交叉验证准则(PCV),并讨论比较了该准则与其他选择调节参数的准则的效果.通过对不同分位点进行模拟,我们发现当残差E来自尖峰分布和厚尾分布时,该准则能更好地估计模型参数,尤其对于高分位点和低分位点而言.选取其他分位点时,PCV的效果虽稍逊色于Schwarz信息准则,但明显优于A1kaike 信息准则和交叉验证准则.且在选择变量的准确性方面,该准则比Schwarz信息准则、Akaike信息准则等更加有效.文章最后对我国各地区多个宏观经济指标的面板数据进行建模分析,展示了惩罚交叉验证准则的性能,得到了在不同分位点处宏观经济指标之间的回归关系.     

基于残差平方和的线性模型选择简单方法及其相合性研究

本文研究了回归分析理论中的自变量选择的重要问题,利用线性回归模型自变量增减的残差平方和理论,获得了一种选择自变量的准则,该准则的分析表明,它计算简单,而且在一定的条件下具有强相合性.     

删失回归模型中的变量选择

在一个删失回归模型("Tobit"模型)中,我们常常要研究如何选择重要的预报变量.本文提出了基于信息理论准则的两种变量选择程序,并建立了它们的相合性.     

发散维数SICA惩罚Cox回归模型的一种修正BIC调节参数选择器

本文研究了发散维数SICA惩罚Cox回归模型的调节参数选择问题,提出了一种修正的BIC调节参数选择器.在一定的正则条件下,证明了方法的模型选择相合性.数值结果表明提出的方法表现要优于GCV准则.     

发散维数SICA惩罚Cox回归模型的一种修正BIC调节参数选择器（英文）

本文研究了发散维数SICA惩罚Cox回归模型的调节参数选择问题,提出了一种修正的BIC调节参数选择器.在一定的正则条件下,证明了方法的模型选择相合性.数值结果表明提出的方法表现要优于GCV准则.     

基于Spatial AIC准则的空间自回归模型变量选择研究

变量选择直接决定着空间计量经济模型的有效程度与实证研究结果。为有效解决空间自回归模型(即SAR模型)的变量选择问题,本文利用Kullback-Laible信息量最大化,把AIC准则运用到SAR模型构建,推导出Spatial AIC统计量,提出Spatial AIC准则。然后利用统计理论证明Spatial AIC准则选择SAR模型变量的渐近最优性;利用蒙特卡洛模拟方法,比较Spatial AIC准则、经典AIC准则和Lasso方法用于SAR模型变量选择的有限大样本性质;利用空间相关的沪深300成分股股票收益率数据,采用Spatial AIC准则和Lasso方法,分别构建股票收益率财务因素的空间自相关模型,实证比较其相对有效性。三种结果均表明Spatial AIC准则能够更好地解决SAR模型变量选择问题。     

基于参数估计线性回归模型选择的研究

关于线性回归模型选择 ,[1 ]中介绍了许多方法 ,他们均基于残差平方和下建立的选择准则 .本文试基于参数估计的理论给出一种方法 ,从参数估计的优良性质上来说 ,我们认为是合理的 .同时给出了计算方法及应用实例 .     

回归模型的最佳变量子集合选择

本文在信息量准则的基础上着重从两个方面来阐述回归模型的最佳变量子集合选择方法:1.主成分分析方法选取主因子,以降低维数;2.主成分分析倒筛法和信息量准则相结合.文中以实例着重阐述如何运用第二种方法,得到了满意的选择效果.本方法在理论上是严谨的,实际上是可行的.     

面板数据分位数回归模型的参数估计与变量选择

本文研究了基于面板数据的分位数回归模型的变量选择问题.通过增加改进的自适应Lasso惩罚项,同时实现了固定效应面板数据的分位数回归和变量选择,得到了模型中参数的选择相合性和渐近正态性.随机模拟验证了该方法的有效性.推广了文献[14]的结论.     

Multivariate Stochastic Orders Induced by Case-Control Sampling

It is shown that retrospective sampling induces stochastic order relations in case-control studies. More specifically if the regression function is increasing and the covariates are positively dependent, then the covariates for cases are larger, with respect to some multivariate stochastic order, than the covariates of the controls. Strong dependence concepts yield strong multivariate stochastic orders. Conversely, different multivariate stochastic orders imply different monotonicity properties on the regression function. The results carry over to marginal models, transformed models and to problems involving confounders. The results set forth a new theoretical foundation for the analysis of case-control studies.     

随机适应误差下线性模型参数M估计的渐近性质

在一些较弱的充分条件下,本文研究了误差为随机适应序列下,线性模型回归参数M估计的强相合性.与文献中已有结果比较,扩大了应用范围,且对矩条件也有较大改进.同时我们给出了随机适应误差下线性模型参数M估计的渐近正态性.     

Bayesian prediction of crack growth based on a hierarchical diffusion model

A general Bayesian approach for stochastic versions of deterministic growth models is presented to provide predictions for crack propagation in an early stage of the growth process. To improve the prediction, the information of other crack growth processes is used in a hierarchical (mixed‐effects) model. Two stochastic versions of a deterministic growth model are compared. One is a nonlinear regression setup where the trajectory is assumed to be the solution of an ordinary differential equation with additive errors. The other is a diffusion model defined by a stochastic differential equation where increments have additive errors. While Bayesian prediction is known for hierarchical models based on nonlinear regression, we propose a new Bayesian prediction method for hierarchical diffusion models. Six growth models for each of the two approaches are compared with respect to their ability to predict the crack propagation in a large data example. Surprisingly, the stochastic differential equation approach has no advantage concerning the prediction compared with the nonlinear regression setup, although the diffusion model seems more appropriate for crack growth. Copyright © 2016 John Wiley & Sons, Ltd.     

Stochastic integrals of empirical-type processes with applications to censored regression

Motivated by the analysis of linear rank estimators and the Buckley-James nonparametric EM estimator in censored regression models, we study herein the asymptotic properties of stochastic integrals of certain two-parameter empirical processes. Applications of these results on empirical processes and their stochastic integrals to the asymptotic analysis of censored regression estimators are also given.     

Stochastic response restrictions

This paper considers the implementation of prior stochastic information on unknown outcomes of the response variables into estimation and forecasting of systems of linear regression equations in the context of time series, cross sections, pooled and longitudinal data models. The established approach proves particularly useful when only aggregated information on the response variables is available, as is frequently the case in applied statistics. We address the combination of prior stochastic and sample information as an extension of standard Gauss-Markov theory. Prior stochastic information could be given in the form of experts' expectations, or from estimations and/or projections of other models. A classical (i.e. non-Bayesian) regression framework for the incorporation of prior knowledge in generalized least-squares estimation and prediction is developed.     

On restricted linear estimation for regression in stochastic processes

In this paper the problem of restricted linear estimation for regression in stochastic processes is analyzed from different viewpoints, using RKHS methods. Of special interest is a relationship with an extended regression problem. Applications of the results to finite dimensional situations are also given.     

Application in stochastic volatility models of nonlinear regression with stochastic design

In regression model with stochastic design, the observations have been primarily treated as a simple random sample from a bivariate distribution. It is of enormous practical significance to generalize the situation to stochastic processes. In this paper, estimation and hypothesis testing problems in stochastic volatility model are considered, when the volatility depends on a nonlinear function of the state variable of other stochastic process, but the correlation coefficient |ρ|≠±1. The methods are applied to estimate the volatility of stock returns from Shanghai stock exchange. Copyright © 2009 John Wiley & Sons, Ltd.     

A stochastic restricted ridge regression estimator

Groß [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64] proposed a restricted ridge regression estimator when exact restrictions are assumed to hold. When there are stochastic linear restrictions on the parameter vector, we introduce a new estimator by combining ideas underlying the mixed and the ridge regression estimators under the assumption that the errors are not independent and identically distributed. Apart from [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64], we call this new estimator as the stochastic restricted ridge regression (SRRR) estimator. The performance of the SRRR estimator over the mixed estimator in respect of the variance and the mean square error matrices is examined. We also illustrate our findings with a numerical example. The shrinkage generalized least squares (GLS) and the stochastic restricted shrinkage GLS estimators are proposed.     

A stochastic extra-step quasi-Newton method for nonsmooth nonconvex optimization

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be approximated by stochastic oracles. The proposed method combines general stochastic higher order steps derived from an underlying proximal type fixed-point equation with additional stochastic proximal gradient steps to guarantee convergence. Based on suitable bounds on the step sizes, we establish global convergence to stationary points in expectation and an extension of the approach using variance reduction techniques is discussed. Motivated by large-scale and big data applications, we investigate a stochastic coordinate-type quasi-Newton scheme that allows to generate cheap and tractable stochastic higher order directions. Finally, numerical results on large-scale logistic regression and deep learning problems show that our proposed algorithm compares favorably with other state-of-the-art methods.

     

Strong Consistency of Bayes Estimates in Stochastic Regression Models

Under minimum assumptions on the stochastic regressors, strong consistency of Bayes estimates is established in stochastic regression models in two cases: (1) When the prior distribution is discrete, the p.d.f.fof i.i.d. random errors is assumed to have finite Fisher informationI=∫^∞_−∞(f′)²/f dx<∞; (2) for general priors, we assumefis strongly unimodal. The result can be considered as an application of a theorem of Doob to stochastic regression models.