Maximum likelihood estimation in the multi-path change-point problem

Maximum likelihood estimators of the parameters of the distributions before and after the change and the distribution of the time to change in the multi-path change-point problem are derived and shown to be consistent. The maximization of the likelihood can be carried out by using either the EM algorithm or results from mixture distributions. In fact, these two approaches give equivalent algorithms. Simulations to evaluate the performance of the maximum likelihood estimators under practical conditions, and two examples using data on highway fatalities in the United States, and on the health effects of urea formaldehyde foam insulation, are also provided.This work was supported in part by the Natural Science and Engineering Council of Canada, and the Fonds pour la Formation de chercheurs et l'aide à la Recherche Gouvernment du Québec.Lawrence Joseph is also a member of the Department of Epidemiology and Biostatistics of McGill University.     

删失截断情形下失效率变点模型的Bayes参数估计

通过添加部分缺失寿命变量数据,得到了删失截断情形下失效率变点模型相对简单的似然函数.讨论了所添加缺失数据变量的概率分布和随机抽样方法.利用Monte Carlo EM算法对未知参数进行了迭代.结合Metropolis-Hastings算法对参数的满条件分布进行了Gibbs抽样,基于Gibbs样本对参数进行估计,详细介绍了MCMC方法的实施步骤.随机模拟试验的结果表明各参数Bayes估计的精度较高.     

The distribution of the likelihood ratio for mixtures of densities from the one-parameter exponential family

We here consider testing the hypothesis ofhomogeneity against the alternative of a two-component mixture of densities. The paper focuses on the asymptotic null distribution of 2 log _n , where _n is the likelihood ratio statistic. The main result, obtained by simulation, is that its limiting distribution appears pivotal (in the sense of constant percentiles over the unknown parameter), but model specific (differs if the model is changed from Poisson to normal, say), and is not at all well approximated by the conventional ₍₂₎ ² -distribution obtained by counting parameters. In Section 3, the binomial with sample size parameter 2 is considered. Via a simple geometric characterization the case for which the likelihood ratio is 1 can easily be identified and the corresponding probability is found. Closed form expressions for the likelihood ratio _n are possible and the asymptotic distribution of 2 log _n is shown to be the mixture giving equal weights to the one point distribution with all its mass equal to zero and the ²-distribution with 1 degree of freedom. A similar result is reached in Section 4 for the Poisson with a small parameter value (0.1), although the geometric characterization is different. In Section 5 we consider the Poisson case in full generality. There is still a positive asymptotic probability that the likelihood ratio is 1. The upper precentiles of the null distribution of 2 log _n are found by simulation for various populations and shown to be nearly independent of the population parameter, and approximately equal to the (1–2)100 percentiles of ₍₁₎ ² . In Sections 6 and 7, we close with a study of two continuous densities, theexponential and thenormal with known variance. In these models the asymptotic distribution of 2 log _n is pivotal. Selected (1–) 100 percentiles are presented and shown to differ between the two models.     

Estimating retail demand with Poisson mixtures and out‐of‐sample likelihood

Estimation of retail demand is critical to decisions about procuring, shipping, and shelving. The idea of Poisson demand process is central to retail inventory management and numerous studies suggest that negative binomial (NB) distribution characterize retail demand well. In this study, we reassess the adequacy of estimating retail demand with the NB distribution. We propose two Poisson mixtures—the Poisson–Tweedie family (PTF) and the Conway–Maxwell–Poisson distribution—as generic alternatives to the NB distribution. On the basis of the principle of likelihood and information theory, we adopt out‐of‐sample likelihood as a metric for model selection. We test the procedure on consumer demand for 580 stock‐keeping unit store sales datasets. Overall the PTF and the Conway–Maxwell–Poisson distribution outperform the NB distribution for 70% of the tested samples. As a general case of the NB model, the PTF has particularly strong performance for datasets with relatively small means and high dispersion. Our finding carries useful implications for researchers and practitioners who seek for flexible alternatives to the oft‐used NB distribution in characterizing retail demand. Copyright © 2013 John Wiley & Sons, Ltd.     

Maximum likelihood inference for the Cox regression model with applications to missing covariates

In this paper, we carry out an in-depth theoretical investigation for existence of maximum likelihood estimates for the Cox model [D.R. Cox, Regression models and life tables (with discussion), Journal of the Royal Statistical Society, Series B 34 (1972) 187–220; D.R. Cox, Partial likelihood, Biometrika 62 (1975) 269–276] both in the full data setting as well as in the presence of missing covariate data. The main motivation for this work arises from missing data problems, where models can easily become difficult to estimate with certain missing data configurations or large missing data fractions. We establish necessary and sufficient conditions for existence of the maximum partial likelihood estimate (MPLE) for completely observed data (i.e., no missing data) settings as well as sufficient conditions for existence of the maximum likelihood estimate (MLE) for survival data with missing covariates via a profile likelihood method. Several theorems are given to establish these conditions. A real dataset from a cancer clinical trial is presented to further illustrate the proposed methodology.     

带有不完全信息随机截尾试验下混合泊松分布参数的点估计

首先,通过添加数据,得到了带有不完全信息随机截尾试验下混合泊松分布的完全数据似然函数,然后分别利用EM算法和MCMC方法,对参数进行了估计,最后进行了随机模拟试验.结果表明参数点估计的精度比较高,     

基于Gibbs抽样算法的贝叶斯动态面板数据模型分析

针对现有动态面板数据分析中存在偶发参数和没有考虑模型参数的不确定性风险问题,提出了基于Gibbs抽样算法的贝叶斯随机系数动态面板数据模型.假设初始值服从平稳分布,自回归系数服从Logit正态分布的条件下,设计了Markov链Monte Carlo数值计算程序,得到了模型参数的贝叶斯估计值.实证研究结果表明:基于Gibb...     

���ɾʧ�����»��ָ���ֲ��Ĺ���

The hybrid censoring scheme is a mixture of type-I and type-II censoring schemes. It is a popular censoring scheme in the literature of life data analysis. Mixed exponential distribution (MED) models is a class of favorable models in reliability statistics. Nevertheless, there is no much discussion to focus on parameters estimation for MED models with hybrid censored samples. We will address this problem in this paper. The EM (Expectation-Maximization) algorithm is employed to derive the closed form of the maximum likelihood estimators (MLEs). Finally, Monte Carlo simulations and a real-world data analysis are conducted to illustrate the proposed method.     

IIRCT下泊松分布参数多变点模型的贝叶斯估计

通过添加缺损的寿命变量数据得到了带有不完全信息随机截尾试验下泊松分布参数多变点模型的完全数据似然函数,研究了变点位置参数和其它参数的满条件分布.利用Gibbs抽样与Metropolis-Hastings算法相结合的MCMC方法对各参数的满条件分布分别进行了抽样,把Gibbs样本的均值作为各参数的贝叶斯估计,并且详细介绍了MCMC方法的实施步骤.最后进行了随机模拟试验,试验结果表明各参数贝叶斯估计的精度都较高.     

非线性均值方差模型的贝叶斯数据删除统计诊断

文章在非线性均值方差模型框架下基于K-L距离研究贝叶斯数据删除影响的统计诊断问题,通过应用Gibbs抽样和MH算法估计贝叶斯数据删除影响诊断统计量.随机模拟研究和红鳟鲑鱼数据的数值例子说明该诊断方法的可行性.     

离子通道的混合密度参数估计与状态判别

本文针对多电导水平离子通道的由多个正态分布加权组成的混合分布特点,用EM迭代算法对混合分布中的参数进行极大似然估计,并在此基础上,利用混合分布中最可能的成分判断通道状态,从而还原通道潜在信号,克服了离子通道分析软件PCLAMP中参数估计与状态还原的缺陷。     

Use of Markov Chain Monte Carlo Methods in a Bayesian Analysis of the Block and Basu Bivariate Exponential Distribution

Metropolis algorithms along with Gibbs steps are proposed to perform a Bayesian analysis for the Block and Basu (ACBVE) bivariate exponential distribution. We also consider the use of Gibbs sampling to develop Bayesian inference for accelerated life tests assuming a power rule model and the ACBVE distribution. The methodology developed in this paper is exemplified with two examples.     

删失截断情形下Weibull分布多变点模型的参数估计

通过添加缺失的寿命变量数据,得到了删失截断情形下Weibull分布多变点模型的完全数据似然函数,研究了变点位置参数和形状参数以及尺度参数的满条件分布.利用Gibbs抽样与Metropolis-Hastings算法相结合的MCMC方法得到了参数的Gibbs样本,把Gibbs样本的均值作为各参数的Bayes估计.详细介绍了MCMC方法的实施步骤.随机模拟试验的结果表明各参数Bayes估计的精度都较高.     

偏t正态数据下混合线性联合位置与尺度模型的参数估计

偏t正态分布是分析尖峰,厚尾数据的重要统计工具之一.研究提出了偏t正态数据下混合线性联合位置与尺度模型,通过EM算法和Newton-Raphson方法研究了该模型参数的极大似然估计.并通过随机模拟试验验证了所提出方法的有效性.最后,结合实际数据验证了该模型和方法具有实用性和可行性.     

Statistical inference for coherent systems with Weibull distributed component lifetimes under complete and incomplete information

Point estimators for the parameters of the component lifetime distribution in coherent systems are evolved assuming to be independently and identically Weibull distributed component lifetimes. We study both complete and incomplete information under continuous monitoring of the essential component lifetimes. First, we prove that the maximum likelihood estimator (MLE) under complete information based on progressively Type‐II censored system lifetimes uniquely exists and we present two approaches to compute the estimates. Furthermore, we consider an ad hoc estimator, a max‐probability plan estimator and the MLE for the parameters under incomplete information. In order to compute the MLEs, we consider a direct maximization of the likelihood and an EM‐algorithm–type approach, respectively. In all cases, we illustrate the results by simulations of the five‐component bridge system and the 10‐component parallel system, respectively.     

A Monte Carlo method for an objective Bayesian procedure

This paper describes a method for an objective selection of the optimal prior distribution, or for adjusting its hyper-parameter, among the competing priors for a variety of Bayesian models. In order to implement this method, the integration of very high dimensional functions is required to get the normalizing constants of the posterior and even of the prior distribution. The logarithm of the high dimensional integral is reduced to the one-dimensional integration of a cerain function with respect to the scalar parameter over the range of the unit interval. Having decided the prior, the Bayes estimate or the posterior mean is used mainly here in addition to the posterior mode. All of these are based on the simulation of Gibbs distributions such as Metropolis' Monte Carlo algorithm. The improvement of the integration's accuracy is substantial in comparison with the conventional crude Monte Carlo integration. In the present method, we have essentially no practical restrictions in modeling the prior and the likelihood. Illustrative artificial data of the lattice system are given to show the practicability of the present procedure.     

Computation of M. L. estimates for the parameters of a negative binomial distribution from grouped data. A comparison of the scoring,Newton—Raphson and E-M algorithms

Computation of M. L. estimates for the parameters of a negative binomial distribution from grouped data is considered. For this problem the Scoring, Newton—Raphson and E-M algorithm is derived. Using simulated data the performance of the algorithms is compared with respect to convergence, number of iterations and computing time. Finally an empirical example drawn from actuarial science is given.     

Start‐up demonstration tests: models,methods and applications,with some unifications

Start‐up demonstration tests were first discussed in the quality/reliability literature about three decades ago. Since then, many variations of these tests have been introduced, and the corresponding distributional characteristics and inferential methods have also been studied. All these developments, based on independent and identically distributed binary trials, have been further generalized to some other forms of trials such as Markov‐dependent trials, exchangeable trials and multistate trials. In this paper, we provide a comprehensive review of all these results and highlight some unifications of the results. We also describe a general estimation method and then present several numerical examples to illustrate some of the models and methods described here. Finally, a number of open issues in this area of research are pointed out. Copyright © 2014 John Wiley & Sons, Ltd.