Simulation input data modeling

Input data modeling is a critical component of a successful simulation application. A perspective of the area is given with an emphasis on available probability distributions as models, estimation methods, model selection and discrimination, and goodness of fit. Three specific distribution classes (lambda,S _B , TES processes) are discussed in some detail to illustrate characteristics that favor input models. Regarding estimation, we argue for maximum likelihood estimation over method of moments and other matching schemes due to intrinsic superior properties (presuming a specific model) and the capability of accommodating messy data types. We conclude with a list of specific research problems and areas warranting additional attention.     

A projection method of estimation for a subfamily of exponential families

Summary This paper is concerned with estimation for a subfamily of exponential-type, which is a parametric model with sufficient statistics. The family is associated with a surface in the domain of a sufficient statistic. A new estimator, termed a projection estimator, is introduced. The key idea of its derivation is to look for a one-to-one transformation of the sufficient statistic so that the subfamily can be associated with a flat subset in the transformed domain. The estimator is defined by the orthogonal projection of the transformed statistic onto the flat surface. Here the orthogonality is introduced by the inverse of the estimated variance matrix of the statistic on the analogy of Mahalanobis's notion (1936,Proc. Nat. Inst. Sci. Ind.,2, 49–55). Thus the projection estimator has an explicit representation with no iterations. On the other hand, the MLE and classical estimators have to be sought as numerical solutions by some algorithm with a choice of an initial value and a stopping rule. It is shown that the projection estimator is first-order efficient. The second-order property is also discussed. Some examples are presented to show the utility of the estimator.     

序约束下AR(p)-ARCH(q)模型参数的估计与检验

In this paper, we study a stationary AR(p)-ARCH(q) model with parameter vectors a and β. We propose a method for computing the maximum likelihood estimator (MLE) of parameters under the nonnegative restriction. A similar method is also proposed for the case that the parameters are restricted by a simple order: α1≥α2≥…≥αq, andβ1≥β2≥…βp. The strong consistency of the above two estimators is discussed. Furthermore, we consider the problem of testing homogeneity of parameters against the simple order restriction. We give the likelihood ratio (LR) test statistic for the testing problem and derive its asymptotic null distribution.     

未熔透尺寸对十字焊接接头疲劳性能影响规律试验研究

针对某厂一压力机架的焊接结构，采用极大似然方法，进行了部分熔透焊接十字接头的拉—拉疲劳试验，得到了该类结构的Ｐ－Ｓ－Ｎ对数曲线。研究了未熔透尺寸对接头的应力集中系数、疲劳强度和试件疲劳破坏形式的影响规律，结果表明，在焊缝与母材等强的情况下，当未熔透尺寸２ａ／Ｔ＜０．５时，其疲劳性能无明显减弱；而当未熔透尺寸２ａ／Ｔ＞０．５时，则接头的抗疲劳性能有显著的改变。     

Variational Bayes With Intractable Likelihood

Variational Bayes (VB) is rapidly becoming a popular tool for Bayesian inference in statistical modeling. However, the existing VB algorithms are restricted to cases where the likelihood is tractable, which precludes their use in many interesting situations such as in state--space models and in approximate Bayesian computation (ABC), where application of VB methods was previously impossible. This article extends the scope of application of VB to cases where the likelihood is intractable, but can be estimated unbiasedly. The proposed VB method therefore makes it possible to carry out Bayesian inference in many statistical applications, including state--space models and ABC. The method is generic in the sense that it can be applied to almost all statistical models without requiring too much model-based derivation, which is a drawback of many existing VB algorithms. We also show how the proposed method can be used to obtain highly accurate VB approximations of marginal posterior distributions. Supplementary material for this article is available online.     

Precision Matrix Estimation With ROPE

It is known that the accuracy of the maximum likelihood-based covariance and precision matrix estimates can be improved by penalized log-likelihood estimation. In this article, we propose a ridge-type operator for the precision matrix estimation, ROPE for short, to maximize a penalized likelihood function where the Frobenius norm is used as the penalty function. We show that there is an explicit closed form representation of a shrinkage estimator for the precision matrix when using a penalized log-likelihood, which is analogous to ridge regression in a regression context. The performance of the proposed method is illustrated by a simulation study and real data applications. Computer code used in the example analyses as well as other supplementary materials for this article are available online.     

A Cross-Entropy Approach to the Estimation of Generalized Linear Multilevel Models

In this article, we use the cross-entropy method for noisy optimization for fitting generalized linear multilevel models through maximum likelihood. We propose specifications of the instrumental distributions for positive and bounded parameters that improve the computational performance. We also introduce a new stopping criterion, which has the advantage of being problem-independent. In a second step we find, by means of extensive Monte Carlo experiments, the most suitable values of the input parameters of the algorithm. Finally, we compare the method to the benchmark estimation technique based on numerical integration. The cross-entropy approach turns out to be preferable from both the statistical and the computational point of view. In the last part of the article, the method is used to model the probability of firm exits in the healthcare industry in Italy. Supplemental materials are available online.     

Semiparametric Bayesian inference for mean-covariance regression models

In this paper, we propose a Bayesian semiparametric mean-covariance regression model with known covariance structures. A mixture model is used to describe the potential non-normal distribution of the regression errors. Moreover, an empirical likelihood adjusted mixture of Dirichlet process model is constructed to produce distributions with given mean and variance constraints. We illustrate through simulation studies that the proposed method provides better estimations in some non-normal cases. We also demonstrate the implementation of our method by analyzing the data set from a sleep deprivation study.     

Some closed form robust moment‐based estimators for the MEM(1,1)

In this paper, we extend the closed form moment estimator (ordinary MCFE) for the autoregressive conditional duration model given by Lu et al (2016) and propose some closed form robust moment‐based estimators for the multiplicative error model to deal with the additive and innovational outliers. The robustification of the closed form estimator is done by replacing the sample mean and sample autocorrelation with some robust estimators. These estimators are more robust than the quasi‐maximum likelihood estimator (QMLE) often used to estimate this model, and they are easy to implement and do not require the use of any numerical optimization procedure and the choice of initial value. The performance of our proposal in estimating the parameters and forecasting conditional mean μ_t of the MEM(1,1) process is compared with the proposals existing in the literature via Monte Carlo experiments, and the results of these experiments show that our proposal outperforms the ordinary MCFE, QMLE, and least absolute deviation estimator in the presence of outliers in general. Finally, we fit the price durations of IBM stock with the robust closed form estimators and the benchmarks and analyze their performances in estimating model parameters and forecasting the irregularly spaced intraday Value at Risk.     

Log-likelihood maximization and response surface in reliability assessment

Nonlinear dynamics problems can generally be solved only in a numerical way. This prevents from a direct application of standard reliability methods. A technique which makes use of iterated response-surface analytical approximations of the system performance function was therefore proposed in view of reliability assessment. The limitation of this technique was of working in a standard normalized space, so that appropriate space transformations are preliminarly required.This paper shows how this response-surface iterative scheme can also be used in the original space of the random variables, provided a maximum log-likelihood constrained optimization problem is solved. Moreover, asymptotic theory also provides a better estimate of the probability of failure of the dynamical system against any assigned limit state.