缺失数据下半参数空间自回归模型的估计

本文研究了响应变量随机缺失时部分线性空间自回归模型的估计问题.结合B样条方法,我们给出了该模型参数部分和非数部分的极大似然估计的EM算法、伪限制极大似然估计的EM算法、以及边际极大似然估计算法,并通过数值模拟比较了三种估计和相应算法在不同的样本容量、缺失比例及空间权重矩阵下数值表现.最后,通过一个实际例子进一步验证三种方法的优良性.     

有限混合Laplace分布回归模型局部估计的EM算法

本文研究了一类有限混合Laplace分布回归模型的局部极大似然估计问题. 利用核回归方法和最大化局部加权似然函数的EM算法, 获得了参数函数的局部极大似然估计量, 并讨论了它们的渐近偏差, 渐近方差和渐近正态性. 推广了有限混合回归模型下局部非参数估计的结果.     

完全数据下Weibull分布参数的极大似然估计

在完全数据条件下对Weibull分布,分别使用Newton-Raphson算法、CM算法及修正的CM算法进行完全数据Weibull分布参数的极大似然估计计算,并且在得到相应的迭代公式后,进行随机模拟.从模拟结果来分析这三种算法在处理Weibull分布参数的极大似然估计的优良性.     

EM算法在假设检验中的应用

给出了EM算法在统计中一个新的应用领域——假设检验. EM算法通常是用来求解模型参数极大似然估计的一种有效的迭代算法. 这种算法利用数据扩张, 将比较复杂的似然函数的最优化问题化成一系列比较简单的函数的优化问题. 而对于一个模型来说, 假设检验往往比极大似然估计更为复杂. 所以有必要找到简单的方法解决假设检验中的较为复杂的优化问题. 所给出的方法不是建立在大样本理论基础上, 因此特别适合于中小样本情形.     

删失截断情形下失效率变点模型的Bayes参数估计

通过添加部分缺失寿命变量数据,得到了删失截断情形下失效率变点模型相对简单的似然函数.讨论了所添加缺失数据变量的概率分布和随机抽样方法.利用Monte Carlo EM算法对未知参数进行了迭代.结合Metropolis-Hastings算法对参数的满条件分布进行了Gibbs抽样,基于Gibbs样本对参数进行估计,详细介绍了MCMC方法的实施步骤.随机模拟试验的结果表明各参数Bayes估计的精度较高.     

ABC-EM算法对微商信息传播模型的参数估计

在基于不完备的实验数据条件下,利用近似贝叶斯计算-期望最大化(ABC-EM)算法估计复杂网络中离散时间的随机微商信息传播模型中的参数。首先通过分析微商网络的特点和微商信息传播机制,建立了适合微商信息传播模型的模型,即无知-传播-免疫(ISR)模型。此外,在尝试通过极大似然法(ML)和期望最大化算法(EM)来估计模型的参数失败之后,使用近似贝叶斯连续蒙特卡罗(ABC-SMC)来代替EM算法的E步,并且用ABC-EM算法成功地估计了模型中的参数。最后,仿真结果表明ABC-EM算法比极大似然法估计参数的准确性要高。     

混合Weibull分布参数估计的ECM算法

混合威布尔分布是寿命数据分析中一个重要的统计模型.但是利用传统的统计方法,如矩估计、极大似然估计等估计模型的参数比较困难.应用ECM算法详细研究了混合威布尔分布在正常工作条件下,完全数据场合、Ⅰ-型截尾和Ⅱ-截尾场合的参数估计问题.数据模拟表明利用ECM算法来估计混合威布尔分布是一种有效的方法.     

有限混合Laplace分布回归模型局部估计的EM算法（英文）

本文研究了一类有限混合Laplace分布回归模型的局部极大似然估计问题.利用核回归方法和最大化局部加权似然函数的EM算法,获得了参数函数的局部极大似然估计量,并讨论了它们的渐近偏差,渐近方差和渐近正态性.推广了有限混合回归模型下局部非参数估计的结果.     

二项线性随机效应模型的拟蒙特卡罗估计

讨论了如何运用拟蒙特卡罗方法对二项线性随机效应模型进行参数估计.首先写出观测数据的边缘对数似然函数,然后用拟蒙特卡罗方法将函数中的积分写成求和的形式,接着利用Newton-Raphson算法计算参数的极大似然估计.以一组种子数据为例,说明该方法是简单可行的.     

基于数据分组与右删失情形下对数正态分布的参数估计

本文研究了对数正态分布数据在分组与删失情形下参数的估计问题. 一是给出未知参数的极大似然估计存在且唯一的充要条件. 二是利用EM算法对参数值进行了估计.     

随机缺失数据下的时间序列分析建模

在时间序列建模过程中,数据的缺失会极大地影响模型的准确性,因此对缺失数据的填补尤为重要.选取北京市空气质量指数(AQI)数据。将其随机缺失10%.分别利用EM算法和polyfit直线拟合的方法对缺失值插补,补全数据后建立ARMA模型并作预测分析.结果表明,利用polyfit函数插补法具有较好的结果.     

Computationally efficient learning of multivariate <Emphasis Type="Italic">t</Emphasis> mixture models with missing information

A finite mixture model using the multivariate t distribution has been well recognized as a robust extension of Gaussian mixtures. This paper presents an efficient PX-EM algorithm for supervised learning of multivariate t mixture models in the presence of missing values. To simplify the development of new theoretic results and facilitate the implementation of the PX-EM algorithm, two auxiliary indicator matrices are incorporated into the model and shown to be effective. The proposed methodology is a flexible mixture analyzer that allows practitioners to handle real-world multivariate data sets with complex missing patterns in a more efficient manner. The performance of computational aspects is investigated through a simulation study and the procedure is also applied to the analysis of real data with varying proportions of synthetic missing values.     

Joint Bayesian Analysis of Factor Scores and Structural Parameters in the Factor Analysis Model

A Bayesian approach is developed to assess the factor analysis model. Joint Bayesian estimates of the factor scores and the structural parameters in the covariance structure are obtained simultaneously. The basic idea is to treat the latent factor scores as missing data and augment them with the observed data in generating a sequence of random observations from the posterior distributions by the Gibbs sampler. Then, the Bayesian estimates are taken as the sample means of these random observations. Expressions for implementing the algorithm are derived and some statistical properties of the estimates are presented. Some aspects of the algorithm are illustrated by a real example and the performance of the Bayesian procedure is studied using simulation.     

Analysis of multivariate skew normal models with incomplete data

We establish computationally flexible methods and algorithms for the analysis of multivariate skew normal models when missing values occur in the data. To facilitate the computation and simplify the theoretic derivation, two auxiliary permutation matrices are incorporated into the model for the determination of observed and missing components of each observation. Under missing at random mechanisms, we formulate an analytically simple ECM algorithm for calculating parameter estimation and retrieving each missing value with a single-valued imputation. Gibbs sampling is used to perform a Bayesian inference on model parameters and to create multiple imputations for missing values. The proposed methodologies are illustrated through a real data set and comparisons are made with those obtained from fitting the normal counterparts.     

Computational Strategies for Multivariate Linear Mixed-Effects Models With Missing Values

This article presents new computational techniques for multivariate longitudinal or clustered data with missing values. Current methodology for linear mixed-effects models can accommodate imbalance or missing data in a single response variable, but it cannot handle missing values in multiple responses or additional covariates. Applying a multivariate extension of a popular linear mixed-effects model, we create multiple imputations of missing values for subsequent analyses by a straightforward and effective Markov chain Monte Carlo procedure. We also derive and implement a new EM algorithm for parameter estimation which converges more rapidly than traditional EM algorithms because it does not treat the random effects as “missing data,” but integrates them out of the likelihood function analytically. These techniques are illustrated on models for adolescent alcohol use in a large school-based prevention trial.     

A Component-Wise EM Algorithm for Mixtures

Maximum likelihood estimation in finite mixture distributions is typically approached as an incomplete data problem to allow application of the expectation-maximization (EM) algorithm. In its general formulation, the EM algorithm involves the notion of a complete data space, in which the observed measurements and incomplete data are embedded. An advantage is that many difficult estimation problems are facilitated when viewed in this way. One drawback is that the simultaneous update used by standard EM requires overly informative complete data spaces, which leads to slow convergence in some situations. In the incomplete data context, it has been shown that the use of less informative complete data spaces, or equivalently smaller missing data spaces, can lead to faster convergence without sacrifying simplicity. However, in the mixture case, little progress has been made in speeding up EM. In this article we propose a component-wise EM for mixtures. It uses, at each iteration, the smallest admissible missing data space by intrinsically decoupling the parameter updates. Monotonicity is maintained, although the estimated proportions may not sum to one during the course of the iteration. However, we prove that the mixing proportions will satisfy this constraint upon convergence. Our proof of convergence relies on the interpretation of our procedure as a proximal point algorithm. For performance comparison, we consider standard EM as well as two other algorithms based on missing data space reduction, namely the SAGE and AECME algorithms. We provide adaptations of these general procedures to the mixture case. We also consider the ECME algorithm, which is not a data augmentation scheme but still aims at accelerating EM. Our numerical experiments illustrate the advantages of the component-wise EM algorithm relative to these other methods.     

AR（p）模型中的缺失数据估计

运用EM算法,对含有缺失数据的AR（p）模型进行参数估计,通过最大似然准则就非左端缺失的情况进行插补.最后,用蒙特卡洛方法给出实验分析,表明如下结果：（i）误差与AR模型的阶数正相关,与缺失比例正相关;（ii）当AR模型的特征根模长相对较小时,误差与数据长度负相关,且误差被控制在了标准差的30％以内;（iii）当模长中等时,误差基本控制在1个标准差左右;（iv）当模长较大时,误差与数据长度正相关,而且误差也相对较大.     

带缺失数据的偏正态众数回归模型的参数估计

针对现实生活中大量数据存在偏斜的情况,构建偏正态数据下的众数回归模型.又加之数据的缺失常有发生,采用插补方法处理缺失数据集,为比较插补效果,考虑对响应变量随机缺失情形进行统计推断研究.利用高斯牛顿迭代法给出众数回归模型参数的极大似然估计,比较该模型在均值插补,回归插补,众数插补三种插补条件下的插补效果.随机模拟和实例分...     

Population size estimation with covariate values missing non-ignorable

The main purpose of this paper is using capture-recapture data to estimate the population size when some covariate values are missing, possibly non-ignorable. Conditional likelihood method is adopted, with a sub-model describing various missing mechanisms. The derived estimate is proved to be asymptotically normal, and simulation studies via a version of EM algorithm show that it is approximately unbiased. The proposed method is applied to a real example, and the result is compared with previous ones.