最大似然方法和Bayes方法在结构方程模型分析中的讨论(英文)

本文通过模拟研究,讨论了最大似然方法和Bayes方法在分析结构方程模型中的相似点和不同之处。     

Objective Bayesian Model Selection in Generalized Additive Models With Penalized Splines

We propose an objective Bayesian approach to the selection of covariates and their penalized splines transformations in generalized additive models. The methodology is based on a combination of continuous mixtures of g-priors for model parameters and a multiplicity-correction prior for the models themselves. We introduce our approach in the normal model and extend it to nonnormal exponential families. A simulation study and an application with binary outcome is provided. An efficient implementation is available in the R package hypergsplines. Supplementary materials for this article are available online.     

Bayesian variable selection in generalized linear models using a combination of stochastic optimization methods

In this paper the usage of a stochastic optimization algorithm as a model search tool is proposed for the Bayesian variable selection problem in generalized linear models. Combining aspects of three well known stochastic optimization algorithms, namely, simulated annealing, genetic algorithm and tabu search, a powerful model search algorithm is produced. After choosing suitable priors, the posterior model probability is used as a criterion function for the algorithm; in cases when it is not analytically tractable Laplace approximation is used. The proposed algorithm is illustrated on normal linear and logistic regression models, for simulated and real-life examples, and it is shown that, with a very low computational cost, it achieves improved performance when compared with popular MCMC algorithms, such as the MCMC model composition, as well as with “vanilla” versions of simulated annealing, genetic algorithm and tabu search.     

Weibull分布恒定应力加速寿命试验的Bayes估计

对定时和定数截尾样本情形CE模型下Weibull分布场合恒定应力加速寿命试验进行了Bayes统计分析,利用Laplace方法给出了该模型的近似Bayes估计.最后通过模拟实例表明该Bayes估计是有效的.     

A linear Bayesian stochastic approximation to update project duration estimates

By relaxing the unrealistic assumption of probabilistic independence on activity durations in a project, this paper develops a hierarchical linear Bayesian estimation model. Statistical dependence is established between activity duration and the amount of resource, as well as between the amount of resource and the risk factor. Upon observation or assessment of the amount of resource required for an activity in near completion, the posterior expectation and variance of the risk factor can be directly obtained in the Bayesian scheme. Then, the expected amount of resources required for and the expected duration of upcoming activities can be predicted. We simulate an application project in which the proposed model tracks the varying critical path activities on a real time basis, and updates the expected project duration throughout the entire project. In the analysis, the proposed model improves the prediction accuracy by 38.36% compared to the basic PERT approach.     

基于分层贝叶斯时空模型的雾霾天气过程计数分析

本文以北京市8个行政区(东城区、西城区、石景山区、海淀区、朝阳区、昌平区、顺义区、怀柔区)的PM2.5指数计算各区逐月雾霞天气过程计数频数为研究对象,选择考虑包括地表温度、相对湿度、平均风速、SO_2质量浓度和NO_2质量浓度在内的5个影响因素。本文定义雾霾天气过程,构建分层贝叶斯时空模型,在一个统计模型中对诸多影响因素进行分析,并从计数分析的角度对北京市雾霾天气现象的时空分布、影响因素进行深入讨论。通过分析得出,温度、湿度、污染物浓度对于雾霾天气过程发生具有促进作用,平均风速对于雾霾天气过程发生具有抑制作用。从时空角度分析,从时间维度上看雾霾天气过程的发生具有明显的季节性特征,冬季(1月、2月)以及3月雾霾天气过程发生次数最高,春季(4月、5月)发生次数最低,秋季发生次数略高于夏季。从空间维度上来看,中心城区(东城区、西城区、石景山、海淀区、朝阳区)雾霾天气过程发生次数明显高于郊区(顺义、昌平、怀柔),以东城区、西城区和朝阳区最为严重。     

�̶�ЧӦ�������Ե�ָ�����ģ�͵ijͷ�������Ȼ����

??This paper constructs a penalized empirical likelihood estimation method via quadratic inference function method, filter method and empirical likelihood estimation method. Under some regular conditions, we derived the large sample properties of estimators and show that the proposed empirical likelihood ratio is asymptotically to chi-square distribution. Furthermore, the infinite sample performance of the proposed method is evaluated by Monte Carlo simulation and real data analysis.     

Penalized Empirical Likelihood Estimation for Partially Linear Single Index Panel Model with Fixed Effects

This paper constructs a penalized empirical likelihood estimation method via quadratic inference function method, filter method and empirical likelihood estimation method. Under some regular conditions, we derived the large sample properties of estimators and show that the proposed empirical likelihood ratio is asymptotically to chi-square distribution. Furthermore, the infinite sample performance of the proposed method is evaluated by Monte Carlo simulation and real data analysis.     

三参数Weibull分布参数的Bayes估计

给出了三参数Weibull分布参数Bayes估计的两种方法,其一基于Laplace数值积分法,其二基于Gibbs抽样方法.模拟例子说明了估计方法的有效性.     

Regression Density Estimation With Variational Methods and Stochastic Approximation

Regression density estimation is the problem of flexibly estimating a response distribution as a function of covariates. An important approach to regression density estimation uses finite mixture models and our article considers flexible mixtures of heteroscedastic regression (MHR) models where the response distribution is a normal mixture, with the component means, variances, and mixture weights all varying as a function of covariates. Our article develops fast variational approximation (VA) methods for inference. Our motivation is that alternative computationally intensive Markov chain Monte Carlo (MCMC) methods for fitting mixture models are difficult to apply when it is desired to fit models repeatedly in exploratory analysis and model choice. Our article makes three contributions. First, a VA for MHR models is described where the variational lower bound is in closed form. Second, the basic approximation can be improved by using stochastic approximation (SA) methods to perturb the initial solution to attain higher accuracy. Third, the advantages of our approach for model choice and evaluation compared with MCMC-based approaches are illustrated. These advantages are particularly compelling for time series data where repeated refitting for one-step-ahead prediction in model choice and diagnostics and in rolling-window computations is very common. Supplementary materials for the article are available online.     

Bayesian Growth Curves Using Normal Mixtures With Nonparametric Weights

Reference growth curves estimate the distribution of a measurement as it changes according to some covariate, often age. We present a new methodology to estimate growth curves based on mixture models and splines. We model the distribution of the measurement with a mixture of normal distributions with an unknown number of components, and model dependence on the covariate through the weights, using smooth functions based on B-splines. In this way the growth curves respect the continuity of the covariate and there is no need for arbitrary grouping of the observations. The method is illustrated with data on triceps skinfold in Gambian girls and women.     

Penalized Orthogonal Iteration for Sparse Estimation of Generalized Eigenvalue Problem

We propose a new algorithm for sparse estimation of eigenvectors in generalized eigenvalue problems (GEPs). The GEP arises in a number of modern data-analytic situations and statistical methods, including principal component analysis (PCA), multiclass linear discriminant analysis (LDA), canonical correlation analysis (CCA), sufficient dimension reduction (SDR), and invariant co-ordinate selection. We propose to modify the standard generalized orthogonal iteration with a sparsity-inducing penalty for the eigenvectors. To achieve this goal, we generalize the equation-solving step of orthogonal iteration to a penalized convex optimization problem. The resulting algorithm, called penalized orthogonal iteration, provides accurate estimation of the true eigenspace, when it is sparse. Also proposed is a computationally more efficient alternative, which works well for PCA and LDA problems. Numerical studies reveal that the proposed algorithms are competitive, and that our tuning procedure works well. We demonstrate applications of the proposed algorithm to obtain sparse estimates for PCA, multiclass LDA, CCA, and SDR. Supplementary materials for this article are available online.     

基于局部多项式展开的多元非参数模型贝叶斯带宽选择

在多元非参数模型中带宽和阶的选择对局部多项式估计量的表现十分重要。本文基于交叉验证准则提出一个自适应贝叶斯带宽选择方法。在给定的误差密度函数下,该方法可推导出对应的似然函数,并构造带宽参数的后验密度函数。随后,通过带宽的后验期望可同时获得阶和带宽的估计。数值模拟的结果表明,该方法不仅比大拇指准则方法精确,且比交叉验证方法耗时更少。与此同时,与Nadaraya-Watson估计相比,所提带宽选择方法对多元非参数模型的适应性要更好。最后,本文通过一组实际数据说明有限样本下所提贝叶斯带宽选择的表现很好。     

Bayesian Inference via Filtering for a Class of Counting Processes: Application to the Micromovement of Asset Price

This paper highlights recent developments in a rich class of counting process models for the micromovement of asset price and in the Bayesian inference (estimation and model selection) via filtering for the class of models. A specific micromovement model built upon linear Brownian motion with jumping stochastic volatility is used to demonstrate the procedure to develop a micromovement model with specific tick-level sample characteristics. The model is further used to demonstrate the procedure to implement Bayes estimation via filtering, namely, to construct a recursive algorithm for computing the trade-by-trade Bayes parameter estimates, especially for the stochastic volatility. The consistency of the recursive algorithm model is proven. Simulation and real-data examples are provided as well as a brief example of Bayesian model selection via filtering.     

Bayesian estimation of finite time ruin probabilities

In this paper, we consider Bayesian inference and estimation of finite time ruin probabilities for the Sparre Andersen risk model. The dense family of Coxian distributions is considered for the approximation of both the inter‐claim time and claim size distributions. We illustrate that the Coxian model can be well fitted to real, long‐tailed claims data and that this compares well with the generalized Pareto model. The main advantage of using the Coxian model for inter‐claim times and claim sizes is that it is possible to compute finite time ruin probabilities making use of recent results from queueing theory. In practice, finite time ruin probabilities are much more useful than infinite time ruin probabilities as insurance companies are usually interested in predictions for short periods of future time and not just in the limit. We show how to obtain predictive distributions of these finite time ruin probabilities, which are more informative than simple point estimations and take account of model and parameter uncertainty. We illustrate the procedure with simulated data and the well‐known Danish fire loss data set. Copyright © 2009 John Wiley & Sons, Ltd.     

Small Noise Asymptotics of the Bayesian Estimator in Nonidentifiable Models

We study the asymptotic behavior of the Bayesian estimator for a deterministic signal in additive Gaussian white noise, in the case where the set of minima of the Kullback–Leibler information is a submanifold of the parameter space. This problem includes as a special case the study of the asymptotic behavior of the nonlinear filter, when the state equation is noise-free, and when the limiting deterministic system is nonobservable. As the noise intensity goes to zero, the posterior probability distribution of the parameter asymptotically concentrates on the submanifold of minima of the Kullback–Leibler information. We give an explicit expression of the limit, and we study the rate of convergence. We apply these results to a practical example where nonidentifiability occurs.     

Bayesian model averaging and model selection: two sides of the same coin when identifying the determinants of trade union density?

One of the main problems in empirical sciences is the uncertainty about the relevance of variables. In the debate on the variables that provide a systematic and robust explanation of the share of employees that are members of trade unions, i.e. of trade union density, the problem of variable uncertainty is striking. In regression analyses there is the problem of having to select variables. One problem in the union density discussion is that depending on the chosen combination of regressors different results in the identification of relevant variables are achieved. To systematically analyze which variables are relevant the literature suggests model averaging and selection strategies. While the two strategies have advantages and disadvantages, the aim of this paper is to apply both. Based on a characteristic cross-country panel data set we find differences and similarities based on our evaluation and ask whether a methodological triangulation is possible.     

Bayesian Estimation of Large Precision Matrix Based on Cholesky Decomposition

In this paper, we consider the estimation of a high dimensional precision matrix of Gaussian graphical model. Based on the re-parameterized likelihood, we obtain the full conditional distribution of all parameters in Cholesky factor. Furthermore, by imposing the prior information, we obtain the shrinkage Bayesian estimator of large precision matrix, and establish the asymptotic distribution of all parameters in the Cholesky factor. At last, we demonstrate our method through the simulation study and an application to telephone call center data.     

��������ѡ���Isingģ�͵ķǰ��ͷ�����

In this paper, we put non-concave penalty on the local conditional likelihood. We obtain the oracle property and asymptotic normal distribution property of the parameters in Ising model. With a union band, we obtain the sign consistence for the estimator of parameter matrix, and the convergence speed under the matrix $L_1$ norm. The results of the simulation studies and a real data analysis show that the non-concave penalized estimator has larger sensitivity.