一类特殊矩阵方程的并行预处理变形共轭梯度算法

研究了求解一类矩阵方程AXB=C,提出了一种并行预处理变形共轭梯度法．该方法给出一种迭代法的预处理模式．首先给出的预处理矩阵是严格对角占优矩阵,构造并行迭代求解预处理矩阵方程的迭代格式,进而使用变形共轭梯度法并行求解．通过数值试验,预处理变形共轭梯度法与直接使用变形共轭梯度法相比较,该算法不仅有效提高了收敛速度,而且具有很高的并行性．     

求解非线性等式和不等式约束优化问题的三项记忆梯度广义投影算法

利用广义投影矩阵，对求解无约束规划的三项记忆梯度算法中的参数给一条件，确定它们的取值范围，以保证得到目标函数的三项记忆梯度广义投影下降方向，建立了求解非线性等式和不等式约束优化问题的三项记忆梯度广义投影算法，并证明了算法的收敛性．同时给出了结合FR，PR，HS共轭梯度参数的三项记忆梯度广义投影算法，从而将经典的共轭梯度算法推广用于求解约束规划问题．数值例子表明算法是有效的．     

求Lyapunov矩阵方程的双对称解的迭代算法

本文研究了Lyapunov矩阵方程.利用共轭梯度法,建立了求该矩阵方程双对称解的迭代算法.同时,也能给出指定矩阵的最佳逼近双对称矩阵.     

一种求解大型Lyapunov矩阵方程的预处理并行算法

研究了一种求解大型Lyapunov矩阵方程的并行预处理变形共轭梯度法.首先将处理小型矩阵方程的Smith预处理方法引入该问题的求解,将原矩阵方程转变为Stein方程,然后采用变形共轭梯度法并行求解预处理后的矩阵方程.其中遇到的难点是需要确定参数μ及求矩阵(A+μI)的逆.基于估计特征值的Gerschgorin圆定理给出了参数μ的估值,再采用变形共轭梯度法并行求得矩阵(A +μ l)的逆,从而形成预处理后的矩阵方程.通过数值试验,该算法与未预处理的变形共轭梯度法相比较,预处理算法明显优于未预处理的算法,而且其并行效率高达0.85.     

初始点任意的解非线性不等式约束优化问题的结合共轭梯度参数的超记忆梯度广义投影算法

本文利用广义投影矩阵，对求解无约束规划的超记忆梯度算法中的参数给出一种新的取值范围以保证得到目标函数的超记忆梯度广义投影下降方向，并与处理任意初始点的方法技巧结合建立求解非线性不等式约束优化问题的一个初始点任意的超记忆梯度广义投影算法，在较弱条件下证明了算法的收敛性．同时给出结合FR，PR，HS共轭梯度参数的超记忆梯度广义投影算法，从而将经典的共轭梯度法推广用于求解约束规划问题．数值例子表明算法是有效的．     

求解具有张量积结构线性系统的共轭梯度法

本文考虑具有张量积结构线性系统的数值解法．该线性系统常常来源于高维立方体上线性偏微分方程的有限差分离散化．利用张量一矩阵乘法,给出了基于张量格式的求解这类线性系统的共轭梯度法．与求解标准线性系统的共轭梯度法比较,新的算法能够节约大量的计算量及存储空间．     

实子矩阵约束下矩阵方程AX=B的共轭梯度迭代解法

本文研究了实子矩阵约束下矩阵方程AX=B及其最佳逼近的共轭梯度迭代解法.首先运用矩阵分块将原方程AX=B转换为2个低阶方程,利用共轭梯度的思想构造迭代算法;然后证明了算法的有限步终止性;最后给出数值实例验证算法的有效性.     

计算周期三对角矩阵行列式和逆矩阵的新算法

给出了一种计算周期三对角矩阵行列式和逆矩阵的新递推算法,它们的运算复杂度分别为O(n)和O(n2),该算法是文献[5]和[6]中相关算法的拓广.     

r—循环分块矩阵求逆和线性方程组的快速算法

1引言与引理阵．因此,对它的研究就引起了人们的高度重视［‘－’］．近年来,特别是对（块）循环矩阵的有关快速算法更为重视．由于（块）循环矩阵与离散傅里叶变换之间的关系,到目前为止几乎所有与（块）循环矩阵的有关快速算法都建立在傅里叶交换之上,而实际问题中的数据大多为实数,因此用FFT快速求（块）循环矩阵的有关问题时需将实数转化为复数运算而影响效率,如卜9］．本文利用多项式矩阵理论给出一般。循环分块矩阵有关的一种快速算法,它拓广和改进了［7－－9］的结果;另外,该快速算法也容易在计算机上实现且存贮量少,只…     

多元时间序列模型协方差矩阵的递归算法

本推导了多元时序横型的协方差矩阵与模型参数的关系式，并给出了计算多维时序过程自协方差矩阵的递归算法。     

基于T2FCM-FE-HMMs的隐马氏模型参数估计算法

把2型模糊集的思想引入到了基于模糊聚类的离散HMM参数训练中,提出了改进的T 2FCM-FE-HMM s算法。     

Hidden semi-Markov model-based methodology for multi-sensor equipment health diagnosis and prognosis

This paper presents an integrated platform for multi-sensor equipment diagnosis and prognosis. This integrated framework is based on hidden semi-Markov model (HSMM). Unlike a state in a standard hidden Markov model (HMM), a state in an HSMM generates a segment of observations, as opposed to a single observation in the HMM. Therefore, HSMM structure has a temporal component compared to HMM. In this framework, states of HSMMs are used to represent the health status of a component. The duration of a health state is modeled by an explicit Gaussian probability function. The model parameters (i.e., initial state distribution, state transition probability matrix, observation probability matrix, and health-state duration probability distribution) are estimated through a modified forward–backward training algorithm. The re-estimation formulae for model parameters are derived. The trained HSMMs can be used to diagnose the health status of a component. Through parameter estimation of the health-state duration probability distribution and the proposed backward recursive equations, one can predict the useful remaining life of the component. To determine the “value” of each sensor information, discriminant function analysis is employed to adjust the weight or importance assigned to a sensor. Therefore, sensor fusion becomes possible in this HSMM based framework.     

基于PCP特征的和弦识别研究与探讨

讨论了音乐识别领域中和弦的四种不同识别方法,给出了基于PCP特征的和弦识别算法.使用PCP作为和弦的特征作为输入送至隐马尔可夫模型中训练,利用Baum-Welch算法估计模型参数,通过Viterbi算法得到正确和弦.通过实验获得了76%的识别率,验证了该算法的可行性.     

Efficient sensitivity analysis in hidden markov models

Sensitivity analysis in hidden Markov models (HMMs) is usually performed by means of a perturbation analysis where a small change is applied to the model parameters, upon which the output of interest is re-computed. Recently it was shown that a simple mathematical function describes the relation between HMM parameters and an output probability of interest; this result was established by representing the HMM as a (dynamic) Bayesian network. To determine this sensitivity function, it was suggested to employ existing Bayesian network algorithms. Up till now, however, no special purpose algorithms for establishing sensitivity functions for HMMs existed. In this paper we discuss the drawbacks of computing HMM sensitivity functions, building only upon existing algorithms. We then present a new and efficient algorithm, which is specially tailored for determining sensitivity functions in HMMs.     

改进的带驻留时间隐Markov模型的前向-后向算法

对隐Maxkov模型(hidden Markov model:HMM)的状态驻留时间的概率进行了修订,给出了改进的带驻留时间隐Markov模型的结构,并在传统的隐Markov模型(traditional hidden Markov model:THMM)的基础上讨论了新模型的前向.后向变量,导出了新模型的前向-后向算法的迭代公式,同时也给出了新模型各个参数的重估公式.     

A note on kernel methods for multiscale systems with critical transitions

We study the maximum mean discrepancy (MMD) in the context of critical transitions modelled by fast‐slow stochastic dynamical systems. We establish a new link between the dynamical theory of critical transitions with the statistical aspects of the MMD. In particular, we show that a formal approximation of the MMD near fast subsystem bifurcation points can be computed to leading order. This leading order approximation shows that the MMD depends intricately on the fast‐slow systems parameters, which can influence the detection of potential early‐warning signs before critical transitions. However, the MMD turns out to be an excellent binary classifier to detect the change‐point location induced by the critical transition. We cross‐validate our results by numerical simulations for a van der Pol‐type model.     

Clustering Multivariate Longitudinal Observations: The Contaminated Gaussian Hidden Markov Model

The Gaussian hidden Markov model (HMM) is widely considered for the analysis of heterogenous continuous multivariate longitudinal data. To robustify this approach with respect to possible elliptical heavy-tailed departures from normality, due to the presence of outliers, spurious points, or noise (collectively referred to as bad points herein), the contaminated Gaussian HMM is here introduced. The contaminated Gaussian distribution represents an elliptical generalization of the Gaussian distribution and allows for automatic detection of bad points in the same natural way as observations are typically assigned to the latent states in the HMM context. Once the model is fitted, each observation has a posterior probability of belonging to a particular state and, inside each state, of being a bad point or not. In addition to the parameters of the classical Gaussian HMM, for each state we have two more parameters, both with a specific and useful interpretation: one controls the proportion of bad points and one specifies their degree of atypicality. A sufficient condition for the identifiability of the model is given, an expectation-conditional maximization algorithm is outlined for parameter estimation and various operational issues are discussed. Using a large-scale simulation study, but also an illustrative artificial dataset, we demonstrate the effectiveness of the proposed model in comparison with HMMs of different elliptical distributions, and we also evaluate the performance of some well-known information criteria in selecting the true number of latent states. The model is finally used to fit data on criminal activities in Italian provinces. Supplementary materials for this article are available online     

Hidden Markov Models Training by a Particle Swarm Optimization Algorithm

In this work we consider the problem of Hidden Markov Models (HMM) training. This problem can be considered as a global optimization problem and we focus our study on the Particle Swarm Optimization (PSO) algorithm. To take advantage of the search strategy adopted by PSO, we need to modify the HMM's search space. Moreover, we introduce a local search technique from the field of HMMs and that is known as the Baum–Welch algorithm. A parameter study is then presented to evaluate the importance of several parameters of PSO on artificial data and natural data extracted from images.     

An investigation of feasible descent algorithms for?estimating the condition number of a matrix

Techniques for estimating the condition number of a nonsingular matrix are developed. It is shown that Hager??s 1-norm condition number estimator is equivalent to the conditional gradient algorithm applied to the problem of maximizing the 1-norm of a matrix-vector product over the unit sphere in the 1-norm. By changing the constraint in this optimization problem from the unit sphere to the unit simplex, a new formulation is obtained which is the basis for both conditional gradient and projected gradient algorithms. In the test problems, the spectral projected gradient algorithm yields condition number estimates at least as good as those obtained by the previous approach. Moreover, in some cases, the spectral gradient projection algorithm, with a careful choice of the parameters, yields improved condition number estimates.     

A block algorithm for computing antitriangular factorizations of symmetric matrices

Any symmetric matrix can be reduced to antitriangular form in finitely many steps by orthogonal similarity transformations. This form reveals the inertia of the matrix and has found applications in, e.g., model predictive control and constraint preconditioning. Originally proposed by Mastronardi and Van Dooren, the existing algorithm for performing the reduction to antitriangular form is primarily based on Householder reflectors and Givens rotations. The poor memory access pattern of these operations implies that the performance of the algorithm is bound by the memory bandwidth. In this work, we develop a block algorithm that performs all operations almost entirely in terms of level 3 BLAS operations, which feature a more favorable memory access pattern and lead to better performance. These performance gains are confirmed by numerical experiments that cover a wide range of different inertia.