A new type SVM-projected SVM

Support vector machine (SVM), developed by Vapnik et al., is a new and promising technique for classification and regression and has been proved to be competitive with the best available learning machines in many applications. However, the classification speed of SVM is substantially slower than that of other techniques with similar generalization ability. A new type SVM named projected SVM (PSVM), which is a combination of feature vector selection (FVS) method and linear SVM (LSVM), is proposed in present paper. In PSVM, the FVS method is first used to select a relevant subset (feature vectors, FVs) from the training data, and then both the training data and the test data are projected into the subspace constructed by FVs, and finally linear SVM(LSVM) is applied to classify the projected data. The time required by PSVM to calculate the class of new samples is proportional to the count of FVs. In most cases, the count of FVs is smaller than that of support vectors (SVs), and therefore PSVM is faster than SVM in running. Compared with other speeding-up techniques of SVM, PSVM is proved to possess not only speeding-up ability but also de-noising ability for high-noised data, and is found to be of potential use in mechanical fault pattern recognition.     

A new type SVM—projected SVM

Support vector machine (SVM), developed by Vapnik et al., is a new and promising technique for classification and regression and has been proved to be competitive with the best available learning machines in many applications. However, the classification speed of SVM is substantially slower than that of other techniques with similar generalization ability. A new type SVM named projected SVM (PSVM), which is a combination of feature, vector selection (FVS) method and linear SVM (LSVM), is proposed in present paper. In PSVM, the FVS method is first used to select a relevant subset (feature vectors, FVs) from the training data, and then both the training data and the test data are projected into the subspace constructed by FVs, and finally linear SVM (LSVM) is applied to classify the projected data. The time required by PSVM to calculate the class of new samples is proportional to the count of FVs. In most cases, the count of FVs is smaller than that of support vectors (SVs), and therefore PSVM is faster than SVM in running. Compared with other speeding-up techniques of SVM, PSVM is proved to possess not only speeding-up ability but also de-noising ability for high-noised data, and is found to be of potential use in mechanical fault pattern recognition.     

A new type SVM—projected SVM

Support vector machine (SVM), developed by Vapnik et al., is a new and promising technique for classification and regression and has been proved to be competitive with the best available learning machines in many applications. However, the classification speed of SVM is substantially slower than that of other techniques with similar generalization ability. A new type SVM named projected SVM (PSVM), which is a combination of feature, vector selection (FVS) method and linear SVM (LSVM), is proposed in present paper. In PSVM, the FVS method is first used to select a relevant subset (feature vectors, FVs) from the training data, and then both the training data and the test data are projected into the subspace constructed by FVs, and finally linear SVM (LSVM) is applied to classify the projected data. The time required by PSVM to calculate the class of new samples is proportional to the count of FVs. In most cases, the count of FVs is smaller than that of support vectors (SVs), and therefore PSVM is faster than SVM in running. Compared with other speeding-up techniques of SVM, PSVM is proved to possess not only speeding-up ability but also de-noising ability for high-noised data, and is found to be of potential use in mechanical fault pattern recognition.

     

基于模糊支持向量机的高光谱图像分类

常规支持向量机应用到高光谱图像分类中有较好的分类效果,但它对训练样本内部的噪声和孤立点特别敏感,在一定程度上影响了支持向量机的分类性能,针对该问题,引入了模糊支持向量机(FSVM),并且利用灰色关联分析代替模糊隶属度的求解,将这种基于灰色关联分析的模糊支持向量机与一对多算法相结合,解决了多类高光谱图像分类问题。HYDICE高光谱图像分类结果表明,噪声和孤立点训练样本对支持向量机的影响得到了有效地抑制,相比于常规支持向量机方法,分类精度得到了明显的提高。     

A semi-supervised learning approach for detection of phishing webpages

This paper proposes a new phishing webpage detection approach based on a kind of semi-supervised learning method-transductive support vector machine (TSVM). Firstly the features of web image are extracted for complementing the disadvantage of phishing detection only based on document object model (DOM); they include gray histogram, color histogram, and spatial relationship between subgraphs. Then the features of sensitive information are examined by using page analysis based on DOM objects. In contrast to the drawback of support vector machine (SVM) algorithm which simply trains classifier by learning little and poor representative labeled samples, this method introduces the TSVM to train classifier that it takes into account the distribution information implicitly embodied in the large quantity of the unlabeled samples, and have better performance than SVM. The experimental results show that the proposed method not only achieves better classification accuracy, but also has strong applicability as the independent method of phishing detection.     

基于近红外光谱和支持向量机的子宫内膜癌早期诊断研究

近红外光谱结合化学计量学方法对癌症的辅助诊断已有了文献报道.该文测定了77例不同生理阶段的子官内膜组织病理切片的近红外光谱,对其分别进行多元散射校正(MSC)、正交信号校正(OSC)以及二者联用的预处理方法,采用拉丁配分法选择3/4样本作为训练集,1/4样本作测试集,建立支持向量机(SVM)模型进行分类,并与基于同样预...     

ISG-FHEV等效燃油消耗最小控制策略

针对室内复杂环境下火灾识别准确率会降低的问题,提出了一种改进的粒子群算法优化支持向量机参数进行火灾火焰识别的方法。首先在 颜色空间进行火焰图像分割,对获得的火焰图像进行预处理并提取相关特征量;其次采用PSO算法搜索SVM的最优核参数和惩罚因子,并在PSO算法中加入变异操作和非线性动态调整惯性权值的方法,加快了搜索SVM最优参数的精度和速度;然后将提取的火焰各个特征量作为训练样本输入SVM模型进行训练,并建立参数优化后的SVM分类器模型;最后将待测试样本输入SVM模型进行分类识别。算法的火灾识别准确率达到94.09%,分类效果明显优于其他分类算法。仿真结果表明,改进的PSO优化SVM算法提高了火焰识别的准确率和实时性,算法的自适应性更强,误判率更低。     

基于NIR分析和模式识别技术的玉米种子识别系统

模式识别技术及数据挖掘方法已成为化学计量学的研究热点。近红外(NIR)光谱分析以其快速、简便、非破坏性等优势广泛应用于光谱信号的处理和分析模型的建立。文章基于五种不同的模式识别方法:局部线性嵌入(LLE),小波变换(WT),主成分分析(PCA),偏最小二乘(PLS)和支持向量机(SVM),利用NIR技术建立了玉米种子的模式识别系统,并将其应用于108玉米杂交种和母本178种子的近红外光谱样品。首先利用LLE,WT,PCA,PLS进行消噪或降维,然后运用SVM进行分类识别,而一模支持向量机(1-norm SVM)算法直接进行分类识别。三个不同NIR光谱范围的数值实验显示:PCA+SVM,LLE+SVM,PLS+SVM识别效果甚佳,而WT+SVM和1-norm SVM方法也有较高的分类精度。实验结果表明了本文提出方法的可行性和有效性,为利用近红外光谱和模式识别技术进行种子识别研究提供了理论依据和实用方法。     

基于NIR分析和模式识别技术的玉米种子识别系统

模式识别技术及数据挖掘方法已成为化学计量学的研究热点。近红外(NIR)光谱分析以其快速、简便、非破坏性等优势广泛应用于光谱信号的处理和分析模型的建立。基于五种不同的模式识别方法:局部线性嵌入(LLE),小波变换(WT),主成分分析(PCA),偏最小二乘(PLS)和支持向量机(SVM),利用NIR技术建立了玉米种子的模式识别系统,并将其应用于108玉米杂交种和母本178种子的近红外光谱样品。首先利用LLE,WT,PCA,PLS进行消噪或降维,然后运用SVM进行分类识别,而一模支持向量机(1-normSVM)算法直接进行分类识别。三个不同NIR光谱范围的数值实验显示:PCA+SVM,LLE+SVM和PLS+SVM识别效果甚佳,而WT+SVM和1-norm SVM方法也有较高的分类精度。实验结果表明了本文提出方法的可行性和有效性,为利用近红外光谱和模式识别技术进行种子识别研究提供了理论依据和实用方法。     

基于主成分分析和支持向量机的太赫兹光谱冰片鉴别

利用主成分分析方法结合支持向量机建立了太赫兹时域光谱冰片种类鉴别模型。冰片是一些常用中成药的重要成分,由于其来源多、真假易混淆,在制药和交易环节,迫切需要快速、简便、准确的检测、鉴别方法。太赫兹时域光谱技术是利用太赫兹脉冲表征物质性质的一种新兴光谱技术。实验使用透射式太赫兹时域光谱系统分别获得了艾片、合成冰片和梅片三种冰片在0.2～2 THz之间的吸收谱线。通过主成分分析,做出了第一、第二主成分二维得分图以及第一、二、三主成分三维得分图,两者对三种不同种类冰片都具有很好的聚类效果。用前十个主成分的得分值矩阵代替原光谱数据,通过对三种冰片的60组样本训练,对未知的60组样本鉴别,建立了四种不同核函数的支持向量机模型。对比结果表明,径向基核函数构建的支持向量机对三种冰片的分类鉴别准确率均为100%,由此我们确定选择具有径向基核函数的支持向量机建立冰片种类的鉴别模型。此外,在含噪情况下,四种核函数SVM获得的总分类准确率都在85%以上,说明支持向量机具有很强的泛化能力。主成分分析结合支持向量机方法对冰片太赫兹光谱具有很好的分类和鉴别效果,为冰片等中成药剂的种类鉴别提供了一种新思路。     

基于高光谱图像技术的苹果粉质化LLE-SVM分类

苹果粉质化程度是衡量其内部品质的一个重要因素,采用了高光谱散射图像技术进行苹果粉质化的无损检测。针对高光谱散射图像数据量大的特点,提出了局部线性嵌入(local linear embedded,LLE)和支持向量机(support vector machine,SVM)相结合的用于检测苹果粉质化的新分类方法。LLE是一种通过局部线性关系的联合来揭示全局非线性结构的非线性降维方法,能有效计算高维输入数据在低维空间的嵌入流形。对降维后的高光谱数据采用SVM进行分类。将LLE-SVM分类方法与传统的SVM分类方法比较,仿真结果表明,对高光谱数据而言,用LLE-SVM得到的训练精度高于单纯使用SVM的训练精度;降维前后,分类器的测试精度变化不大,波动范围不超过5%。LLE-SVM为高光谱散射图像技术进行苹果粉质化无损检测提供了一个有效的分类方法。     

基于多模板子空间的支持向量机多类自然形状识别

自然物体的检测与识别是机器视觉以及模式识别的重要任务。由于自然物体形状的多样性与柔性以及视觉判别的复杂性,使基于计算机的自然形状物体的准确检测与识别变得比较困难。提出了基于多模板子空间的支持向量机(SVM)多类自然形状识别方法。利用广义Hough变换表示自然形状物体轮廓,针对每个类别通过训练得到多个匹配模板;检测时利用多模板最近邻相关匹配进行粗检测,使用支持向量机进行分类。在相关匹配限定的子空间内收集训练样本,有效地降低了训练样本数目。实验结果证明所提出的自然形状检测与识别方法是十分有效的,大大改进了经典检测算法的检测效果以及自动化程度。     

太赫兹时域光谱结合主成分分析线性判别和支持向量机用于大黄样品鉴定

太赫兹时域光谱技术(THz-TDS)结合主成分分析-线性判别分析(PCA-LDA)和支持向量机(SVM)用于正品大黄样品的鉴定。在时域测量41个大黄样品的太赫兹时域透射光谱,然后将这些时域信号转换成频域的吸收系数系数。根据样本的吸收系数建立了主成分分析-线性判别分析和支持向量机的定性分类模型,并对正品和非正品大黄样本的分类模型进行了交叉验证。模型的预测能力和稳定性使用自助拉丁配分进行评价,使用50次自助拉丁配分,配分数为4。使用主成分分析-线性判别分析和支持向量机均得到了满意的结果。提出的方法证明是一种方便、无污染、准确和无需化学处理的鉴定大黄样本的方法。该文提出的步骤可以应用于其他中草药分类和生产的质量控制。     

基于凸组合核函数的化合物太赫兹透射光谱分类

物质的太赫兹光谱包含着非常丰富的物理和化学信息。它对化合物晶体具有高的灵敏度、 单光子能量低等特点。但受到检测人员知识背景、 背景噪声、 识别算法精度等因素的影响,光谱样本识别准确率和效率较低。为了提高对太赫兹光谱的检测能力,提出应用基于凸组合核函数的support vector machines(SVM)对化合物的THz脉冲透射谱进行分类。在使用小波变换对数据进行滤波预处理之后,提取了传统波峰、 波谷位置特征和term frequency-inverse document frequency (TF-IDF) 最大间隔特征。TF-IDF方法使用信息论的原理确定每个采样点的权重,选择权重较大的点作为特征。针对太赫兹透射谱特征相似、 维数较低带来的分类困难问题,构建基于凸组合核函数的SVM分类模型。并利用核评价的方法,通过高维非线性规划方程求解最优凸组合参数。当最优凸组合参数被确定时,构建分类模型进行分类和预测。相比较于单一核函数,凸组合核函数将透射谱特征与分类模型融合起来。对于不同的检测样本,数据经过凸组合核函数映射到高维空间后,特征具有更显著的区分度。使用不同的太赫兹透射谱样本进行分类实验,结果表明,分类准确率得到极大提高。     

利用带无标签数据的双支持向量机对恒星光谱分类

恒星光谱分类是天文技术与方法领域一直关注的热点问题之一。随着观测设备持续运行和不断改进,人类获得的光谱数量与日俱增。这些海量光谱为人工处理带来了极大挑战。鉴于此,研究人员开始关注数据挖掘算法,并尝试对这些光谱进行数据挖掘。近年来,神经网络、自组织映射、关联规则等数据挖掘方法广泛应用于恒星光谱分类。在这些方法中,支持向量机(SVM)以其强大的学习能力和高效的分类性能而备受推崇。SVM的基本思想是试图在两类样本之间找到一个最优分类面将两类分开。SVM在求解时,通过将其最优化问题转化为具有(QP)形式的凸问题,进而得到全局最优解。尽管该方法在实际应用中表现优良,但为了进一步提高其分类能力,有的学者提出双支持向量机(TSVM)。该方法通过构造两个非平行的分类面将两类分开,每一类靠近某个分类面,而远离另一个分类面。TSVM的计算效率较之传统SVM提高近4倍,因此,自TSVM提出后便受到研究人员的持续关注,并出现若干改进算法。在恒星光谱分类中,一般分类算法都是根据历史观测光谱来建立分类模型,其中最关键的是对光谱进行人工标注,这项工作极为繁琐,且容易犯错。如何利用已标记的光谱以及部分无标签的光谱来建立分类模型显得尤为重要。因此,提出带无标签数据的双支持向量机(TSVMUD)用以实现对恒星光谱智能分类的目的。该方法首先将光谱分为训练数据集和测试数据集两部分;然后,在训练集上进行学习,得到分类依据;最后利用分类依据对测试集上的光谱进行验证。继承了双支持向量机的优势,更重要的是,在训练集上学习分类模型过程中,不仅考虑有标记的训练样本,也考虑部分未标记的样本。一方面提高了学习效率,另一方面得到更优的分类模型。在SDSS DR8恒星光谱数据集上的比较实验表明,与支持向量机SVM、双支持向量机TSVM以及K近邻(KNN)等传统分类方法相比,带无标签数据的双支持向量机TSVMUD具有更优的分类能力。然而,该方法亦存在一定的局限性,其中一大难题是其无法处理海量光谱数据。该工作将借鉴海量数据随机采样思想,利用大数据处理技术,来对所提方法在大数据环境下的适应性展开进一步研究。     

TCVQ-SVM algorithm for narrowband spectrum sensing

Spectrum sensing is viewed as the basic and crucial technology for cognitive radio. To improve the accuracy of spectrum sensing in low signal to noise ratio (SNR), this paper presents an efficient TCVQ-SVM method based on machine learning for narrowband spectrum sensing. Firstly, trace of covariance matrix and variance of quadratic covariance matrix (TCVQ) is extracted as feature vectors and combined as training samples of spectrum sensing. Then, the classification model can be achieved by training samples based on support vector machine (SVM), which can avoid setting threshold and adjusting classification hyperplane by its self-learning ability. Lastly, the result of spectrum sensing can be obtained. By utilizing trace and variance as input features of SVM, the algorithm can make full use of the eigenvalue difference and structure characteristic of the received signal, and at the same time, achieve good performance in low SNR. Theoretical analysis reveals that the proposed method has low computational complexity. Simulation results and experiments on the hardware platform illustrate that the proposed algorithm is effective and robust.     

基于数据挖掘的本体构建与重构技术研究

针对目前本体构建与重构过程中数据处理效率低的问题,运用支持向量机分类及K-均值聚类的方法对本体构建数据进行处理,从文本数据中抽取关注的特定的信息,运用基于二叉树的多分类支持向量机以及支持向量机与K-均值融合的多样本聚类,总结基于分类与聚类的本体构建过程,并以离散型和连续型两种数据样本验证了方法的可行性。实验结果表明,基于数据挖掘的本体构建与重构技术具有良好的应用效果。     

基于流形模糊双支持向量机的恒星光谱分类方法

支持向量机(support vector machine, SVM)具有良好的学习性能和泛化能力,因而被广泛应用于恒星光谱分类中。然而实际应用面临的数据规模往往很大,SVM便暴露出计算量大、分类速度慢等问题。为了解决上述问题,Jayadeva等提出双支持向量机(twin support vector machine, TWSVM),将计算时间减少至SVM的1/4。然后上述方法仅关注数据的全局特征,对每类数据的局部特征并未关注。鉴于此,提出基于流形模糊双支持向量机(manifold fuzzy twin support vector machine, MF-TSVM)的恒星光谱分类方法。利用流形判别分析获得数据的全局特征和局部特征,模糊隶属度函数的引入将各类数据区别对待,尽可能减少噪声点和奇异点对分类结果的影响。与C-SVM,KNN等传统分类方法在SDSS恒星光谱数据集上的比较实验表明了该方法的有效性。     

A novel binary tree support vector machine for hyperspectral remote sensing image classification

According to the principle of support vector machine (SVM) and the inter-class separability rule of hyperspectral data, a novel binary tree SVM classifier based on separability measure among different classes is proposed for hyperspectral image classification. J–M distance is used to measure the separability in order to generate the binary tree automatically. By experiments using airborne operational modular imaging spectrometer II (OMIS II) data, satellite EO-1 Hyperion hyperspectral data and airborne AVIRIS data, the classification accuracy of different multi-class SVMs is obtained and compared. Experimental results indicate that the proposed adaptive binary tree classifier outperforms other existing multi-class SVM strategies. Use of the adaptive binary tree SVM classifier is a novel approach to improve the accuracy of hyperspectral image classification and expand the possibilities for interpretation and application of hyperspectral remote sensing image.     

基于克隆选择支持向量机高光谱遥感影像分类技术

作为支持向量机(support vector machine, SVM)高光谱影像分类的一个重要环节,参数设置的效率和精度直接影响到SVM模型训练效率和最终分类精度。本文首先建立一个SVM高光谱影像分类器,提出了利用免疫克隆选择算法优化的交叉验证进行核函数参数和惩罚因子C的优化选择的方法,得到了一种基于克隆选择优化的支持向量机(clonal selection SVM, CSSVM)高光谱影像分类器。然后将CSSVM与传统的基于网格搜索交叉验证的支持向量机（gird search SVM, GSSVM）分类器进行了对比评价,评价指标包括模型训练时间和分类精度等。最后基于AVIRIS高光谱遥感影像进行了两算法分类对比试验,结果表明：提出的CSSVM测试样本总分类精度超过85.1%和Kappa系数超过0.821 3,影像总分类精度超过81.58%和Kappa系数超过0.772 8,CSSVM与GSSVM的分类精度差别在0.08%以内,Kappa系数差别在0.001以内;CSSVM的模型训练时间是GSSVM的1/6至1/10,得到显著缩短;CSSVM方法在保持传统GSSVM优良分类精度的基础上,极大提高了模型的训练效率。