Estimation of parameters in latent class models using fuzzy clustering algorithms

A mixture approach to clustering is an important technique in cluster analysis. A mixture of multivariate multinomial distributions is usually used to analyze categorical data with latent class model. The parameter estimation is an important step for a mixture distribution. Described here are four approaches to estimating the parameters of a mixture of multivariate multinomial distributions. The first approach is an extended maximum likelihood (ML) method. The second approach is based on the well-known expectation maximization (EM) algorithm. The third approach is the classification maximum likelihood (CML) algorithm. In this paper, we propose a new approach using the so-called fuzzy class model and then create the fuzzy classification maximum likelihood (FCML) approach for categorical data. The accuracy, robustness and effectiveness of these four types of algorithms for estimating the parameters of multivariate binomial mixtures are compared using real empirical data and samples drawn from the multivariate binomial mixtures of two classes. The results show that the proposed FCML algorithm presents better accuracy, robustness and effectiveness. Overall, the FCML algorithm has the superiority over the ML, EM and CML algorithms. Thus, we recommend FCML as another good tool for estimating the parameters of mixture multivariate multinomial models.     

混料对称设计最优性的图检验法

在混料试验中,当混料模型较为复杂且混料成份较多时,要验证一个设计ξ的最优性是比较困难的.一方面,当模型或约束较为复杂时难以证明方差函数是否满足最优性准则条件,另一方面,当混料成份多于3时不能通过绘制方差函数的曲面图来观察最优性.文章提出一种可用于验证混料对称设计的最优性的图检验法,通过实例分析,这种方法是有效的.     

Semiparametric Bayesian inference for mean-covariance regression models

In this paper, we propose a Bayesian semiparametric mean-covariance regression model with known covariance structures. A mixture model is used to describe the potential non-normal distribution of the regression errors. Moreover, an empirical likelihood adjusted mixture of Dirichlet process model is constructed to produce distributions with given mean and variance constraints. We illustrate through simulation studies that the proposed method provides better estimations in some non-normal cases. We also demonstrate the implementation of our method by analyzing the data set from a sleep deprivation study.     

Speed-up for the expectation-maximization algorithm for clustering categorical data

In model-based cluster analysis, the expectation-maximization (EM) algorithm has a number of desirable properties, but in some situations, this algorithm can be slow to converge. Some variants are proposed to speed-up EM in reducing the time spent in the E-step, in the case of Gaussian mixture. The main aims of such methods is first to speed-up convergence of EM, and second to yield same results (or not so far) than EM itself. In this paper, we compare these methods from categorical data, with the latent class model, and we propose a new variant that sustains better results on synthetic and real data sets, in terms of convergence speed-up and number of misclassified objects.     

Nonlinear system identification and control using a real-coded genetic algorithm

A real-coded genetic algorithm (GA) applied to the system identification and control for a class of nonlinear systems is proposed in this paper. It is well known that GA is a globally optimal method motivated from natural evolutionary concepts. For solving a given optimization problem, there are two different kinds of GA operations: binary coding and real coding. In general, a real-coded GA is more suitable and convenient to deal with most practical engineering applications. In this paper, in the beginning we attempt to utilize a real-coded GA to identify the unknown system which its structure is assumed to be known previously. Next, according to the estimated system model an optimal off-line PID controller is optimally solved by also using the real-coded GA. Two simulated examples are finally given to demonstrate the effectiveness of the proposed method.     

Decentralized robust model reference adaptive control for interconnected time-delay systems

In this paper, the problem of decentralized robust model reference control for a class of interconnected time-delay systems is investigated. The interconnections with time-varying time delays considered are high order and the gains are not known. A class of decentralized adaptive feedback controllers are proposed, which can render the resulting closed-loop error system uniformly ultimately bounded stable. A numerical example is given to show the feasibility and effectiveness of the proposed design techniques.     

Slice Sampling σ-Stable Poisson-Kingman Mixture Models

The article is concerned with the use of Markov chain Monte Carlo methods for posterior sampling in Bayesian nonparametric mixture models.In particular, we consider the problem of slice sampling mixture models for a large class of mixing measures generalizing the celebrated Dirichlet process. Such a class of measures, known in the literature as σ-stable Poisson-Kingman models, includes as special cases most of the discrete priors currently known in Bayesian nonparametrics, for example, the two-parameter Poisson-Dirichlet process and the normalized generalized Gamma process. The proposed approach is illustrated on some simulated data examples. This article has online supplementary material.     

基于混合模型对地震巨灾风险的分析

POT模型常被用于分析巨灾风险,然而在应用POT模型时,阀值的估计及选择存在很多困难。本文提出用混合模型对巨灾风险进行估计,并讨论混合模型的贝叶斯统计分析。基于混合模型及贝叶斯统计方法,本文对我国1966年至2014年问GDP调整后的地震直接经济损失进行分析,并根据最终模型计算出不同置信度水平下的VaR值和ES值,为我国地震巨灾风险管理提供了理论依据。     

Tail risk measures and risk allocation for the class of multivariate normal mean–variance mixture distributions

The Conditional Tail Expectation (CTE), also known as the Expected Shortfall and Tail-VaR, has received much attention as a preferred risk measure in finance and insurance applications. A related risk management exercise is to allocate the amount of the CTE computed for the aggregate or portfolio risk into individual risk units, a procedure known as the CTE allocation. In this paper we derive analytic formulas of the CTE and its allocation for the class of multivariate normal mean–variance mixture (NMVM) distributions, which is known to be extremely flexible and contains many well-known special cases as its members. We also develop the closed-form expression of the conditional tail variance (CTV) for the NMVM class, an alternative risk measure proposed in the literature to supplement the CTE by capturing the tail variability of the underlying distribution. To illustrate our findings, we focus on the multivariate Generalized Hyperbolic Distribution (GHD) family which is a popular subclass of the NMVM in connection with Lévy processes and contains some common distributions for financial modelling. In addition, we also consider the multivariate slash distribution which is not a member of GHD family but still belongs to the NMVM class. Our result is an extension of the recent contribution of Ignatieva and Landsman (2015).     

混料切片试验设计

混料试验设计在众多领域中都有广泛的应用,有时试验者不仅仅需要考虑各混料成分所占比例对响应变量的影响,同时还关心其它被称为过程变量的因素.在实际中,对于这类问题通常使用的设计方案是混料设计和因子设计的组合设计.这种组合设计在过程变量的不同水平组合下,使用的是相同的设计阵,因此空间填充性较差.基于混料球体堆积设计,文章提出了一类新的混料设计,称之为混料切片设计,它的整体设计和所有子设计(过程变量的每一水平组合对应的混料设计)都具有很好的空间填充性,从而比组合设计有更好的模型稳健性.基于同余子群的陪集分解方法,针对过程变量水平组合数的不同情况提出了相应的简单快速的构造算法,文章最后的数值例子解释了算法的可行性和设计的有效性.     

等价类空间中离散时间选举-排它混合模型的遍历性

利用李雅谱诺夫函数首先证明了等价类空间中离散时间非紧邻选举模型是正常返的,且首次击中D0时刻的阶为15/14,其次给出了等价类空间中离散时间非紧邻选举模型与排它过程的混合模型遍历性的一个判别准则,从而推广和改进了紧邻情形的相应结果.     

不确定性响应混料模型的最优设计

在混料试验中,响应变量存在着不确定性,提出了一类新的混料试验模型.基于模糊数的可能性方差理论,为该混料模型定义了D-最优和G-最优设计准则.同时,讨论了该模型最优设计的等价定理,并给出实例分析.     

混合位置分布中分量参数的统计推断

对混合位置分布族,当混合比已知时,提出了关于分量参数的假设检验和区间估计方法,所提出的方法基于广义枢轴模型.在一定的条件下,检验的实际水平等于名义水平,且各置信域的实际覆盖率等于名义覆盖率.在更一般的场合,检验是相合的,并且各置信域的实际覆盖率趋于名义覆盖率.模拟显示所给的方法是令人满意的.     

Merging experts’ opinions: A Bayesian hierarchical model with mixture of prior distributions

In this paper, a general approach is proposed to address a full Bayesian analysis for the class of quadratic natural exponential families in the presence of several expert sources of prior information. By expressing the opinion of each expert as a conjugate prior distribution, a mixture model is used by the decision maker to arrive at a consensus of the sources. A hyperprior distribution on the mixing parameters is considered and a procedure based on the expected Kullback–Leibler divergence is proposed to analytically calculate the hyperparameter values. Next, the experts’ prior beliefs are calibrated with respect to the combined posterior belief over the quantity of interest by using expected Kullback–Leibler divergences, which are estimated with a computationally low-cost method. Finally, it is remarkable that the proposed approach can be easily applied in practice, as it is shown with an application.     

A new approach for parameter estimation of finite Weibull mixture distributions for reliability modeling

The aim of this paper is to model lifetime data for systems that have failure modes by using the finite mixture of Weibull distributions. It involves estimating of the unknown parameters which is an important task in statistics, especially in life testing and reliability analysis. The proposed approach depends on different methods that will be used to develop the estimates such as MLE through the EM algorithm. In addition, Bayesian estimations will be investigated and some other extensions such as Graphic, Non-Linear Median Rank Regression and Monte Carlo simulation methods can be used to model the system under consideration. A numerical application will be used through the proposed approach. This paper also presents a comparison of the fitted probability density functions, reliability functions and hazard functions of the 3-parameter Weibull and Weibull mixture distributions using the proposed approach and other conventional methods which characterize the distribution of failure times for the system components. GOF is used to determine the best distribution for modeling lifetime data, the priority will be for the proposed approach which has more accurate parameter estimates.     

Temporal aggregation of Markov‐switching financial return models

In this paper we investigate the effects of temporal aggregation of a class of Markov‐switching models known as Markov‐switching normal (MSN) models. The growing popularity of the MSN processes in modelling financial returns can be attributed to their inherited flexibility characteristics, allowing for heteroscedasticity, asymmetry and excess kurtosis. The distributions of the process described by the basic MSN model and the model of the corresponding temporal aggregate data are derived. They belong to a general class of mixture normal distributions. The limiting behaviour of the aggregated MSN model, as the order of aggregation tends to infinity, is studied. We provide explicit formulae for the volatility, autocovariance, skewness and kurtosis of the aggregated processes. An application of measuring solvency risk with MSN models for horizons larger than 1 year and up to 10 years from the baseline U.S. S&P 500 stock market total return time series spanning about 50 years is given. Copyright © 2008 John Wiley & Sons, Ltd.     

On Testing for the Number of Components in a Mixed Poisson Model

Poisson mixtures are usually used to describe overdispersed data. Finite Poisson mixtures are used in many practical situations where often it is of interest to determine the number of components in the mixture. Identifying how many components comprise a mixture remains a difficult problem. The likelihood ratio test (LRT) is a general statistical procedure to use. Unfortunately, a number of specific problems arise and the classical theory fails to hold. In this paper a new procedure is proposed that is based on testing whether a new component can be added to a finite Poisson mixture which eventually leads to the number of components in the mixture. It is a sequential testing procedure based on the well known LRT that utilises a resampling technique to construct the distribution of the test statistic. The application of the procedure to real data reveals some interesting features of the distribution of the test statistic.     

非饱和土固结的混合物理论（Ⅰ）

非饱和土是由土粒、水、气组成的三相介质，本以混合物理论为基础研究了非饱和土的固结问题。中导出了各向异性多孔介质及非饱和土 的有效应力的理论公式，把有效应力原理和Curie对称原理作为非饱和土的两个重要的本构原理，建立了非饱和 土固结的数学模型：由25个方程求解25个未知量。在增量线性化的情况下，本模型简化为5个控制方程求解5个未知量：3个固相位移、孔隙水压力和孔隙气压力。模型中包含7个材料参数，都可由试验测定，便于工程应用，Biot理论是本模型的特例。     

A new class of bivariate distributions and its mixture

A new class of bivariate distributions is presented in this paper. The procedure used in this paper is based on a latent random variable with exponential distribution. The model introduced here is of Marshall-Olkin type. A mixture of the proposed bivariate distributions is also discussed. The results obtained here generalize those of the bivariate exponential distribution present in the literature.     

基于高斯混合和BP神经网络的卵巢癌质谱数据三分类模型

癌症的早期诊断可以显著提高癌症患者的存活率,三分类问题就是将未知样本与已知样本进行匹配度检测,预测样本是健康状态,良性发展状态,还是癌症状态.针对复杂难分的卵巢癌蛋白质质谱数据,提出了一种基于高斯混合模型和BP神经网络的三分类预测模型.首先,去除原数据中的冗余,对其进行方差排序及交集筛选提取特征集合一,再利用高斯混合模型处理求得参数作为特征集合二,最后使用BP神经网络进行样本三分类,准确率达到72.9%.结果表明:模型可以作为卵巢癌质谱数据三分类的可选择工具.