Predictive accuracy determination applied to a linear model phosphorus loading resulting from urban runoff

A case study of the application of an iterative technique for determination of predictive accuracy is presented. The method uses Monte Carlo simulations and split sampling techniques to verify model accuracy. Examination of the ability of a linear parametric runoff loading model's ability to project total phosphorus loadings reveals the sensitivity of the model to calibration procedures. Predictive reliability was found to vary widely as the number of rainfall events considered in the calibration process changed. Predictive reliability was substantially increased by imposing calibration constraints which ensured that a wide distribution of values of the independent variable were presented in the calibration pool.Although the linear model is theoretically weak in its representation of the runoff loading phenomenon, it displays relatively stable predictive capabilities which warrant its consideration for use in management studies. The predictive errors associated with loading projections limit the linear model's value to applications insensitive to errors in the loading projections for individual storm events. This study provides further evidence of the need to consider uncertainties associated with the modelling of water quality phenomena.     

Parameter uncertainty, sensitivity analysis and prediction error in a water-balance hydrological model

Analysis of uncertainty is often neglected in the evaluation of complex systems models, such as computational models used in hydrology or ecology. Prediction uncertainty arises from a variety of sources, such as input error, calibration accuracy, parameter sensitivity and parameter uncertainty. In this study, various computational approaches were investigated for analysing the impact of parameter uncertainty on predictions of streamflow for a water-balance hydrological model used in eastern Australia. The parameters and associated equations which had greatest impact on model output were determined by combining differential error analysis and Monte Carlo simulation with stochastic and deterministic sensitivity analysis. This integrated approach aids in the identification of insignificant or redundant parameters and provides support for further simplifications in the mathematical structure underlying the model. Parameter uncertainty was represented by a probability distribution and simulation experiments revealed that the shape (skewness) of the distribution had a significant effect on model output uncertainty. More specifically, increasing negative skewness of the parameter distribution correlated with decreasing width of the model output confidence interval (i.e. resulting in less uncertainty). For skewed distributions, characterisation of uncertainty is more accurate using the confidence interval from the cumulative distribution rather than using variance. The analytic approach also identified the key parameters and the non-linear flux equation most influential in affecting model output uncertainty.     

Monte Carlo and quasi-Monte Carlo sampling methods for a class of stochastic mathematical programs with equilibrium constraints

In this paper, we consider a class of stochastic mathematical programs with equilibrium constraints introduced by Birbil et al. (Math Oper Res 31:739–760, 2006). Firstly, by means of a Monte Carlo method, we obtain a nonsmooth discrete approximation of the original problem. Then, we propose a smoothing method together with a penalty technique to get a standard nonlinear programming problem. Some convergence results are established. Moreover, since quasi-Monte Carlo methods are generally faster than Monte Carlo methods, we discuss a quasi-Monte Carlo sampling approach as well. Furthermore, we give an example in economics to illustrate the model and show some numerical results with this example. The first author’s work was supported in part by the Scientific Research Grant-in-Aid from Japan Society for the Promotion of Science and SRF for ROCS, SEM. The second author’s work was supported in part by the United Kingdom Engineering and Physical Sciences Research Council grant. The third author’s work was supported in part by the Scientific Research Grant-in-Aid from Japan Society for the Promotion of Science.     

Simulated annealing: Use of a new tool in bin packing

Simulated annealing (statistical cooling) is applied to bin packing problems. Different cooling strategies are compared empirically and for a particular 100 item problem a solution is given which is most likely the best known so far.The work was partially done during the author's visit to the University of California, Berkeley, sponsored by the Humboldt-Foundation.     

New Monte Carlo scheme for simulating Lagranian particle diffusion with wind shear effects

Problems related to the application of Lagrangian particle methods to air quality diffusion simulations are reviewed. Advantages and shortcomings of these techniques are discussed, and a new Monte Carlo method is proposed for the treatment of cross correlation between wind fluctuation components. Also discussed is how data collected from advanced meteorlogical instrumentation can be manipulated in order to provide the proper input to the proposed numerical modelling techniques.     

多层线性模型参数估计的MCEM算法

应用Monte Carlo EM(MCEM)算法给出了多层线性模型参数估计的新方法,解决了EM算法用于模型时积分计算困难的问题,并通过数值模拟将方法的估计结果与EM算法的进行比较,验证了方法的有效性和可行性.     

The long term impact of a coherence based model for mathematics intervention

This article presents a large-scale longitudinal study of hundreds of students across the state of Kentucky that participated in a dual-focus mathematics intervention initiative when they were in the third grade. Rather than an exclusive focus on intervention, this initiative focused on both (i) high quality pull-out intervention and (ii) coherence between pull-out intervention and classroom instruction. The study found that over half of the third grade intervention students that participated in this initiative were classified as “novice” (the lowest possible performance category) on state standardized mathematics assessments at the end of the third grade. However, over the course of the following four years, the novice reduction rate of these students was significantly (p < .01) greater than other novices in Kentucky that did not participate in the initiative. These findings indicate that when implementing intervention initiatives to help students that are struggling with mathematics, it may be important to establish coherence between pull-out intervention and classroom instruction. The long term impact of this approach among traditionally underrepresented minorities suggest that this publication may provide insight into important equity issues where long-term analyses may sometimes be needed to capture the full impact of intervention initiatives.     

Comparison of the Bayesian and Randomised Decision Tree Ensembles within an Uncertainty Envelope Technique

Multiple Classifier Systems (MCSs) allow evaluation of the uncertainty of classification outcomes that is of crucial importance for safety critical applications. The uncertainty of classification is determined by a trade-off between the amount of data available for training, the classifier diversity and the required performance. The interpretability of MCSs can also give useful information for experts responsible for making reliable classifications. For this reason Decision Trees (DTs) seem to be attractive classification models for experts. The required diversity of MCSs exploiting such classification models can be achieved by using two techniques, the Bayesian model averaging and the randomised DT ensemble. Both techniques have revealed promising results when applied to real-world problems. In this paper we experimentally compare the classification uncertainty of the Bayesian model averaging with a restarting strategy and the randomised DT ensemble on a synthetic dataset and some domain problems commonly used in the machine learning community. To make the Bayesian DT averaging feasible, we use a Markov Chain Monte Carlo technique. The classification uncertainty is evaluated within an Uncertainty Envelope technique dealing with the class posterior distribution and a given confidence probability. Exploring a full posterior distribution, this technique produces realistic estimates which can be easily interpreted in statistical terms. In our experiments we found out that the Bayesian DTs are superior to the randomised DT ensembles within the Uncertainty Envelope technique.     

Geometric ergodicity of the Gibbs sampler for the Poisson change-point model

Poisson change-point models have been widely used for modelling inhomogeneous time-series of count data. There are a number of methods available for estimating the parameters in these models using iterative techniques such as MCMC. Many of these techniques share the common problem that there does not seem to be a definitive way of knowing the number of iterations required to obtain sufficient convergence. In this paper, we show that the Gibbs sampler of the Poisson change-point model is geometrically ergodic. Establishing geometric ergodicity is crucial from a practical point of view as it implies the existence of a Markov chain central limit theorem, which can be used to obtain standard error estimates. We prove that the transition kernel is a trace-class operator, which implies geometric ergodicity of the sampler. We then provide a useful application of the sampler to a model for the quarterly driver fatality counts for the state of Victoria, Australia.     

A Graphical Approach to Diagnosing the Validity of the Conditional Independence Assumptions of a Bayesian Network Given Data

Bayesian networks (BNs) have attained widespread use in data analysis and decision making. Well-studied topics include efficient inference, evidence propagation, parameter learning from data for complete and incomplete data scenarios, expert elicitation for calibrating BN probabilities, and structure learning. It is common for the researcher to assume the structure of the BN or to glean the structure from expert elicitation or domain knowledge. In this scenario, the model may be calibrated through learning the parameters from relevant data. There is a lack of work on model diagnostics for fitted BNs; this is the contribution of this article. We key on the definition of (conditional) independence to develop a graphical diagnostic that indicates whether the conditional independence assumptions imposed, when one assumes the structure of the BN, are supported by the data. We develop the approach theoretically and describe a Monte Carlo method to generate uncertainty measures for the consistency of the data with conditional independence assumptions under the model structure. We describe how this theoretical information and the data are presented in a graphical diagnostic tool. We demonstrate the approach through data simulated from BNs under different conditional independence assumptions. We also apply the diagnostic to a real-world dataset. The results presented in this article show that this approach is most feasible for smaller BNs—this is not peculiar to the proposed diagnostic graphic, but rather is related to the general difficulty of combining large BNs with data in any manner (such as through parameter estimation). It is the authors’ hope that this article helps highlight the need for more research into BN model diagnostics. This article has supplementary materials online.     

Bayesian total loss estimation using shared random effects

The pricing of insurance policies requires estimates of the total loss. The traditional compound model imposes an independence assumption on the number of claims and their individual sizes. Bivariate models, which model both variables jointly, eliminate this assumption. A regression approach allows policy holder characteristics and product features to be included in the model. This article presents a bivariate model that uses joint random effects across both response variables to induce dependence effects. Bayesian posterior estimation is done using Markov Chain Monte Carlo (MCMC) methods. A real data example demonstrates that our proposed model exhibits better fitting and forecasting capabilities than existing models.     

Modeling dependencies between rating categories and their effects on prediction in a credit risk portfolio

The internal‐rating‐based Basel II approach increases the need for the development of more realistic default probability models. In this paper, we follow the approach taken in McNeil A and Wendin J 7 (J. Empirical Finance 2007) by constructing generalized linear mixed models for estimating default probabilities from annual data on companies with different credit ratings. The models considered, in contrast to McNeil A and Wendin J 7 (J. Empirical Finance 2007), allow parsimonious parametric models to capture simultaneously dependencies of the default probabilities on time and credit ratings. Macro‐economic variables can also be included. Estimation of all model parameters are facilitated with a Bayesian approach using Markov chain Monte Carlo methods. Special emphasis is given to the investigation of predictive capabilities of the models considered. In particular, predictable model specifications are used. The empirical study using default data from Standard and Poor's gives evidence that the correlation between credit ratings further apart decreases and is higher than the one induced by the autoregressive time dynamics. Copyright © 2008 John Wiley & Sons, Ltd.     

Weighted Monte Carlo Methods for Approximate Solution of a Nonlinear Boltzmann Equation

We construct weighted modifications of statistical modeling of an ensemble of interacting particles which is connected with approximate solution of a nonlinear Boltzmann equation.     

Bayesian source detection and parameter estimation of a plume model based on sensor network measurements

We consider a network of sensors that measure the intensities of a complex plume composed of multiple absorption–diffusion source components. We address the problem of estimating the plume parameters, including the spatial and temporal source origins and the parameters of the diffusion model for each source, based on a sequence of sensor measurements. The approach not only leads to multiple‐source detection, but also the characterization and prediction of the combined plume in space and time. The parameter estimation is formulated as a Bayesian inference problem, and the solution is obtained using a Markov chain Monte Carlo algorithm. The approach is applied to a simulation study, which shows that an accurate parameter estimation is achievable. Copyright © 2010 John Wiley & Sons, Ltd.     

Comparison of certain value-at-risk estimation methods for the two-parameter Weibull loss distribution

The Weibull distribution is one of the most important distributions that is utilized as a probability model for loss amounts in connection with actuarial and financial risk management problems. This paper considers the Weibull distribution and its quantiles in the context of estimation of a risk measure called Value-at-Risk (VaR). VaR is simply the maximum loss in a specified period with a pre-assigned probability level. We attempt to present certain estimation methods for VaR as a quantile of a distribution and compare these methods with respect to their deficiency (Def) values. Along this line, the results of some Monte Carlo simulations, that we have conducted for detailed investigations on the efficiency of the estimators as compared to MLE, are provided.     

A new boundary element technique for solving plane problems of linear elasticity: 1. Theory

A new boundary elements technique for solving plane problems of linear elasticity theory is described. The method is based upon the Muskhelishvili complex variable representation of the displacement and stress fields involving two independent complex functions. These functions are represented by complex Cauchy integrals where the path of integration is taken around the external boundary of the solid. Two complex density functions appearing in the integrands of the Cauchy integrals are represented by spline functions and these are determined by the application of appropriate boundary conditions. The theory presented is suitable only for bounded simply-connected regions.     

A generalized linear model with smoothing effects for claims reserving

In this paper, we continue the development of the ideas introduced in England and Verrall (2001) by suggesting the use of a reparameterized version of the generalized linear model (GLM) which is frequently used in stochastic claims reserving. This model enables us to smooth the origin, development and calendar year parameters in a similar way as is often done in practice, but still keep the GLM structure. Specifically, we use this model structure in order to obtain reserve estimates and to systemize the model selection procedure that arises in the smoothing process. Moreover, we provide a bootstrap procedure to achieve a full predictive distribution.     

Weak Approximation of Stochastic Differential Equations and Application to Derivative Pricing

A new, simple algorithm of order 2 is presented to approximate weakly stochastic differential equations. It is then applied to the problem of pricing Asian options under the Heston stochastic volatility model.

2000 Mathematics Subject Classification, 65C30, 65C05.     

Corrections to the Article “Weighted Monte Carlo Methods for Approximate Solution of a Nonlinear Boltzmann Equation”

Corrections are given to the above-mentioned article.