Heteroscedastic normal-exponential mixture models: Bayesian and classical approaches

In this paper, we introduce a Bayesian analysis for mixture of distributions belonging to the exponential family. As a special case we consider a mixture of normal exponential distributions including joint modeling of the mean and variance. We also consider joint modeling of the mean and variance heterogeneity. Markov Chain Monte Carlo (MCMC) methods are used to obtain the posterior summaries of interest. We also introduce and apply an EM algorithm, where the maximization is obtained applying the Fisher scoring algorithm. Finally, we also include analysis of real data sets to illustrate the proposed methodology.     

潜伏期变化的随机流行病模型及其贝叶斯推断

本文讨论了潜伏期和传染期均服从威布尔分布、易感性随机变化的一类随机流行病模型,并利用M CM C算法对潜伏期、传染期的参数和易感性的超参数作了贝叶期推断.这种分析方法比以往各种方法更适用于各类疾病.     

Fully Bayesian Analysis of Switching Gaussian State Space Models

In the present paper we study switching state space models from a Bayesian point of view. We discuss various MCMC methods for Bayesian estimation, among them unconstrained Gibbs sampling, constrained sampling and permutation sampling. We address in detail the problem of unidentifiability, and discuss potential information available from an unidentified model. Furthermore the paper discusses issues in model selection such as selecting the number of states or testing for the presence of Markov switching heterogeneity. The model likelihoods of all possible hypotheses are estimated by using the method of bridge sampling. We conclude the paper with applications to simulated data as well as to modelling the U.S./U.K. real exchange rate.     

Risk averse decision making under catastrophic risk

A nonstandard probabilistic setting for modeling of the risk of catastrophic events is presented. It allows random variables to take on infinitely large negative values with non-zero probability, which correspond to catastrophic consequences unmeasurable in monetary terms, e.g. loss of human lives. Thanks to this extension, the safety-first principle is proved to be consistent with traditional axioms on a preference relation, such as monotonicity, continuity, and risk aversion. Also, a robust preference relation is introduced, and an example of a monotone robust preference relation, sensitive to catastrophic events in the sense of Chichilnisky (2002), is provided. The suggested setting is demonstrated in evaluating nuclear power plant projects when the probability of a catastrophe is itself a random variable.     

Bayesian analysis of mixture of autoregressive components with an application to financial market volatility

In this paper, we present a fully Bayesian analysis of a finite mixture of autoregressive components. Neither the number of mixture components nor the autoregressive order of each component have to be fixed, since we treat them as stochastic variables. Parameter estimation and model selection are performed using Markov chain Monte Carlo methods. This analysis allows us to take into account the stationarity conditions on the model parameters, which are often ignored by Bayesian approaches. Finally, the application to return volatility of financial markets will be illustrated. Our model seems to be consistent with some empirical facts concerning volatility such as persistence, clustering effects, nonsymmetrical dependencies. Copyright © 2006 John Wiley & Sons, Ltd.     

A Gaussian Mixed Model for Learning Discrete Bayesian Networks

In this paper, we address the problem of learning discrete Bayesian networks from noisy data. A graphical model based on a mixture of Gaussian distributions with categorical mixing structure coming from a discrete Bayesian network is considered. The network learning is formulated as a maximum likelihood estimation problem and performed by employing an EM algorithm. The proposed approach is relevant to a variety of statistical problems for which Bayesian network models are suitable—from simple regression analysis to learning gene/protein regulatory networks from microarray data.     

The speed of adjustment of financial ratios: A hierarchical Bayesian approach using mixtures

This paper presents a hierarchical Bayesian analysis of the partial adjustment model of financial ratios using mixture models, an approach that allows us to estimate the distribution of the adjustment coefficients. More particularly, it enables us to analyse speed of reaction in the presence of shocks affecting financial ratios objectives as a basis to establish homogenous groups of firms. The proposed methodology is illustrated by examining a set of ratios for a sample of firms operating in the U.S. manufacturing sector. Copyright © 2007 John Wiley & Sons, Ltd.     

Bayesian graduation of mortality rates: An application to reserve evaluation

This paper presents Bayesian graduation models of mortality rates, using Markov chain Monte Carlo (MCMC) techniques. Graduated annual death probabilities are estimated through the predictive distribution of the number of deaths, which is assumed to follow a Poisson process, considering that all individuals in the same age class die independently and with the same probability. The resulting mortality tables are formulated through dynamic Bayesian models. Calculation of adequate reserve levels is exemplified, via MCMC, making use of the value at risk concept, demonstrating the importance of using “true” observed mortality figures for the population exposed to risk in determining the survival coverage rate.     

An integrated model for earthquake risk and damage assessment

The primary objective of this paper was to develop an integrated model for earthquake risk and damage assessment. This model consists of three major submodules - the physical damage functions, the economic damage functions, and the institutional aspects related to risk mitigation policies and community preparedness. While the physical damage functions are related to earthquake risk prediction utilizing both probabilistic and deterministic approaches, the economic damage functions refer to the potential vulnerability of various populations at earthquake risk.The feasibility of this model was tested with historical and projected data on earthquake risk and impacted populations for the New Madrid Fault region which includes St. Louis and Memphis Standard Metropolitan Statistical Areas. If the 1811–1812 New Madrid earthquakes would recur between 1980 and 2030, the damage results from the simulations of this model based on the status quo scenario, indicate that the region would experience structural losses in billions of dollars and a death toll of hundreds of persons.     

Bayesian Prediction via Partitioning

This article proposes a new Bayesian approach to prediction on continuous covariates. The Bayesian partition model constructs arbitrarily complex regression and classification surfaces by splitting the covariate space into an unknown number of disjoint regions. Within each region the data are assumed to be exchangeable and come from some simple distribution. Using conjugate priors, the marginal likelihoods of the models can be obtained analytically for any proposed partitioning of the space where the number and location of the regions is assumed unknown a priori. Markov chain Monte Carlo simulation techniques are used to obtain predictive distributions at the design points by averaging across posterior samples of partitions.     

Bayesian Nonparametric Inference for the Power Likelihood

The aim in this article is to provide a means to undertake Bayesian inference for mixture models when the likelihood function is raised to a power between 0 and 1. The main purpose for doing this is to guarantee a strongly consistent model and hence, make it possible to compare the consistent posterior with the correct posterior, looking for signs of discrepancy. This will be explained in detail in the article. Another purpose would be for simulated annealing algorithms. In particular, for the widely used mixture of Dirichlet process model, it is far from obvious how to undertake inference via Markov chain Monte Carlo methods when the likelihood is raised to a power other than 1. In this article, we demonstrate how posterior sampling can be carried out when using a power likelihood. Matlab code to implement the algorithm is available as supplementary material.     

Bayesian Monte Carlo estimation for profile hidden Markov models

Hidden Markov models are used as tools for pattern recognition in a number of areas, ranging from speech processing to biological sequence analysis. Profile hidden Markov models represent a class of so-called “left–right” models that have an architecture that is specifically relevant to classification of proteins into structural families based on their amino acid sequences. Standard learning methods for such models employ a variety of heuristics applied to the expectation-maximization implementation of the maximum likelihood estimation procedure in order to find the global maximum of the likelihood function. Here, we compare maximum likelihood estimation to fully Bayesian estimation of parameters for profile hidden Markov models with a small number of parameters. We find that, relative to maximum likelihood methods, Bayesian methods assign higher scores to data sequences that are distantly related to the pattern consensus, show better performance in classifying these sequences correctly, and continue to perform robustly with regard to misspecification of the number of model parameters. Though our study is limited in scope, we expect our results to remain relevant for models with a large number of parameters and other types of left–right hidden Markov models.     

Bayesian inference for clustered extremes

We consider Bayesian inference for the extremes of dependent stationary series. We discuss the virtues of the Bayesian approach to inference for the extremal index, and for related characteristics of clustering behaviour. We develop an inference procedure based on an automatic declustering scheme, and using simulated data we implement and assess this procedure, making inferences for the extremal index, and for two cluster functionals. We then apply our procedure to a set of real data, specifically a time series of wind-speed measurements, where the clusters correspond to storms. Here the two cluster functionals selected previously correspond to the mean storm length and the mean inter-storm interval. We also consider inference for long-period return levels, advocating the posterior predictive distribution as being most representative of the information required by engineers interested in design level specifications.      

Learning Bayesian network classifiers by risk minimization

Bayesian networks (BNs) provide a powerful graphical model for encoding the probabilistic relationships among a set of variables, and hence can naturally be used for classification. However, Bayesian network classifiers (BNCs) learned in the common way using likelihood scores usually tend to achieve only mediocre classification accuracy because these scores are less specific to classification, but rather suit a general inference problem. We propose risk minimization by cross validation (RMCV) using the 0/1 loss function, which is a classification-oriented score for unrestricted BNCs. RMCV is an extension of classification-oriented scores commonly used in learning restricted BNCs and non-BN classifiers. Using small real and synthetic problems, allowing for learning all possible graphs, we empirically demonstrate RMCV superiority to marginal and class-conditional likelihood-based scores with respect to classification accuracy. Experiments using twenty-two real-world datasets show that BNCs learned using an RMCV-based algorithm significantly outperform the naive Bayesian classifier (NBC), tree augmented NBC (TAN), and other BNCs learned using marginal or conditional likelihood scores and are on par with non-BN state of the art classifiers, such as support vector machine, neural network, and classification tree. These experiments also show that an optimized version of RMCV is faster than all unrestricted BNCs and comparable with the neural network with respect to run-time. The main conclusion from our experiments is that unrestricted BNCs, when learned properly, can be a good alternative to restricted BNCs and traditional machine-learning classifiers with respect to both accuracy and efficiency.     

贝叶斯方法在信用风险度量中的应用研究综述

贝叶斯方法可以有效的处理信用风险度量中常见的数据缺失问题,而且为科学使用专家意见等主观经验提供了有效途径,已被广泛应用于信用风险度量领域。本文从模型构建、估计方法及模型比较三个方面对应用贝叶斯方法度量信用风险的重要文献进行综述,重点关注信用风险的违约相关性和风险蔓延性等最新研究热点,为深入研究信用风险度量问题提供参考,并引起国内风险分析人员对贝叶斯方法的兴趣。     

Dynamically Rescaled Hamiltonian Monte Carlo for Bayesian Hierarchical Models

Dynamically rescaled Hamiltonian Monte Carlo is introduced as a computationally fast and easily implemented method for performing full Bayesian analysis in hierarchical statistical models. The method relies on introducing a modified parameterization so that the reparameterized target distribution has close to constant scaling properties, and thus is easily sampled using standard (Euclidian metric) Hamiltonian Monte Carlo. Provided that the parameterizations of the conditional distributions specifying the hierarchical model are “constant information parameterizations” (CIPs), the relation between the modified- and original parameterization is bijective, explicitly computed, and admit exploitation of sparsity in the numerical linear algebra involved. CIPs for a large catalogue of statistical models are presented, and from the catalogue, it is clear that many CIPs are currently routinely used in statistical computing. A relation between the proposed methodology and a class of explicitly integrated Riemann manifold Hamiltonian Monte Carlo methods is discussed. The methodology is illustrated on several example models, including a model for inflation rates with multiple levels of nonlinearly dependent latent variables. Supplementary materials for this article are available online.     

Bayesian Semiparametric Regression Analysis of Multicategorical Time-Space Data

We present a unified semiparametric Bayesian approach based on Markov random field priors for analyzing the dependence of multicategorical response variables on time, space and further covariates. The general model extends dynamic, or state space, models for categorical time series and longitudinal data by including spatial effects as well as nonlinear effects of metrical covariates in flexible semiparametric form. Trend and seasonal components, different types of covariates and spatial effects are all treated within the same general framework by assigning appropriate priors with different forms and degrees of smoothness. Inference is fully Bayesian and uses MCMC techniques for posterior analysis. The approach in this paper is based on latent semiparametric utility models and is particularly useful for probit models. The methods are illustrated by applications to unemployment data and a forest damage survey.     

Bayesian Inference for the RC(m) Association Model

Describing the structure in a two-way contingency table in terms of an RC(m) association model, we are concerned with the computation of posterior distributions of the model parameters using prior distributions which take into account the nonlinear restrictions of the model. We are further involved with the determination of the order of association m, based on Bayesian arguments. Using projection methods, a prior distribution over the parameters of the simpler RC(m) model is induced from a prior of the parameters of the saturated model. The fit of the assumed RC(m) model is evaluated using the posterior distribution of its distance from the full model. Our methods are illustrated with a popular dataset.     

广义非参数回归的B样本贝叶斯估计

本文主要研究广义非参数模型B样条Bayes估计 .将回归函数按照B样条基展开 ,我们不具体选择节点的个数 ,而是节点个数取均匀的无信息先验 ,样条函数系数取正态先验 ,用B样条函数的后验均值估计回归函数 .并给出了回归函数B样条Bayes估计的MCMC的模拟计算方法 .通过对Logistic非参数回归的模拟研究 ,表明B样条Bayes估计得到了很好的估计效果     

线性模型参数向量的近似贝叶斯估计

用线性贝叶斯方法去同时估计线性模型中回归系数和误差方差,并在不知道先验分布具体形式的情况下,得到了线性贝叶斯估计的表达式.在均方误差矩阵准则下,证明了其优于最小二乘估计和极大似然估计.与利用MCMC算法得到的贝叶斯估计相比,线性贝叶斯估计具有显式表达式并且更方便使用.对于几种不同的先验分布,数值模拟结果表明线性贝叶斯估...