Multidimensional Pattern Recognition and Classification of White Blood Cells Using Support Vector Machines

This study introduces a new algorithm to optimize the pattern recognition of different white blood cell types in flow cytometry. The behavior of parametric data clusters in a multidimensional space is analyzed using the learning system known as Support Vector Machines (SVM). Beckman‐Coulter Corporation supplied flow cytometry data of numerous patients to be used as training and testing sets for the algorithm. Subsequently, the characteristics of the cells provided in these sets were used to train a SVM based classifier. The objective in developing this algorithm was to identify the category of a given blood sample and provide information to medical doctors in the form of diagnostic references for a specific disease state, lymphocytic leukemia. With the application of the hypothesis space, the learning bias and the learning algorithm, the SVM classifier was successfully trained to evaluate misclassification ratios in flow cytometry data in an effort to recognize abnormal blood cell patterns and address the ubiquitous problem of data overlap through the use of the maximal margin classifier.     

An Overview of Infrared Spectroscopy Based on Continuous Wavelet Transform Combined with Machine Learning Algorithms: Application to Chinese Medicines,Plant Classification,and Cancer Diagnosis

Abstract

Infrared spectroscopy has been a workhorse technique for materials analysis and can result in positively identifying many different types of material. In recent years there have been reports using wavelet analysis and machine learning algorithms to extract features of Fourier transform infrared spectrometry (FTIR). The machine learning algorithms contain back-propagation neural network (BPNN), radial basis function neural network (RBFNN), and support vector machine (SVM). This article reviews the important advances in FTIR analysis employing a continuous wavelet transform (CWT) and machine learning algorithms, especially in the applications of the method for Chinese medicine identification, plant classification, and cancer diagnosis.     

VIS/NIR imaging application for honey floral origin determination

Nondestructive methods are of utmost importance for honey characterization. This study investigates the potential application of VIS-NIR hyperspectral imaging for detection of honey flower origin using machine learning techniques. Hyperspectral images of 52 honey samples were taken in transmittance mode in the visible/near infrared (VIS-NIR) range (400–1000 nm). Three different machine learning algorithms were implemented to predict honey floral origin using honey spectral images. These methods, included radial basis function (RBF) network, support vector machine (SVM), and random forest (RF). Principal component analysis (PCA) was also exploited for dimensionality reduction. According to the obtained results, the best classifier (RBF) achieved a precision of 94% in a fivefold cross validation experiment using only the first two PCs. Mapping of the classifier results to the test set images showed 90% accuracy for honey images. Three types of honey including buckwheat, rapeseed and heather were classified with 100% accuracy. The proposed approach has great potential for honey floral origin detection. As some other honey properties can also be predicted using image features, in addition to floral origin detection, this method may be applied to predict other honey characteristics.     

Classifier ensembles for fMRI data analysis: an experiment

Functional magnetic resonance imaging (fMRI) is becoming a forefront brain–computer interface tool. To decipher brain patterns, fast, accurate and reliable classifier methods are needed. The support vector machine (SVM) classifier has been traditionally used. Here we argue that state-of-the-art methods from pattern recognition and machine learning, such as classifier ensembles, offer more accurate classification. This study compares 18 classification methods on a publicly available real data set due to Haxby et al. [Science 293 (2001) 2425–2430]. The data comes from a single-subject experiment, organized in 10 runs where eight classes of stimuli were presented in each run. The comparisons were carried out on voxel subsets of different sizes, selected through seven popular voxel selection methods. We found that, while SVM was robust, accurate and scalable, some classifier ensemble methods demonstrated significantly better performance. The best classifiers were found to be the random subspace ensemble of SVM classifiers, rotation forest and ensembles with random linear and random spherical oracle.     

基于可见光谱和支持向量机的黄瓜叶部病害识别方法研究

以黄瓜叶部病害作为研究对象,基于可见光谱反射率差异识别黄瓜叶部病害,研究基于SVM的黄瓜叶部病害识别预测模型。采用小波变换进行数据预处理;选取Otsu、边缘分割法和K均值聚类三类分割方法进行病斑分割,比较错分率和运行时间,K均值聚类方法更适合黄瓜叶部病斑分割;提取纹理、颜色和形状特征参数,共15个特征参数;通过交叉验证选择最优参数c和g,对核函数参数进行优化处理,并通过比较线性核、多项式核、RBF核等不同核函数情况下SVM的正确识别率,确定RBF核SVM模式识别方法能够更精准地识别黄瓜叶部病害。并将基于SVM与另外两种常见的黄瓜叶部病害识别方法,BP神经网络和模糊聚类进行比较,结果表明,基于SVM的识别模型对霜霉病的正确识别率为95%,白粉病和褐斑病的正确识别率均为90%,平均诊断正确率为92%;该模式识别方法识别效果最佳,运行时间最短,为基于可见光谱的黄瓜病害识别模型提供参考。     

A semi-supervised learning approach for detection of phishing webpages

This paper proposes a new phishing webpage detection approach based on a kind of semi-supervised learning method-transductive support vector machine (TSVM). Firstly the features of web image are extracted for complementing the disadvantage of phishing detection only based on document object model (DOM); they include gray histogram, color histogram, and spatial relationship between subgraphs. Then the features of sensitive information are examined by using page analysis based on DOM objects. In contrast to the drawback of support vector machine (SVM) algorithm which simply trains classifier by learning little and poor representative labeled samples, this method introduces the TSVM to train classifier that it takes into account the distribution information implicitly embodied in the large quantity of the unlabeled samples, and have better performance than SVM. The experimental results show that the proposed method not only achieves better classification accuracy, but also has strong applicability as the independent method of phishing detection.     

Curvelet based image compression via core vector machine

In this paper, a novel curvelet based digital image compression scheme is proposed. Aiming at achieving high compression ratio, the proposed scheme embeds a representative machine learning method, core vector machine (CVM), in the encoding process of the image compression technique. The core vector machine (CVM) has been introduced as an extremely fast classifier which is demonstrably superior to standard support vector machine (SVM) on very large datasets. In this scheme, we appropriately utilize the characteristic of CVM to reduce huge numbers of curvelet coefficients. Compared with image compression algorithms do not use CVM and methods based on wavelet transform, experimental results show that the compression performance of our method gains much improvement in peak-signal-to-noise-ratio (PSNR) and CPU time. Moreover, the algorithm works fairly well for declining block effect at higher compression ratios.     

Individual identification using multi-metric of DTI in Alzheimer's disease and mild cognitive impairment

Accurate identification of Alzheimer's disease(AD) and mild cognitive impairment(MCI) is crucial so as to improve diagnosis techniques and to better understand the neurodegenerative process. In this work, we aim to apply the machine learning method to individual identification and identify the discriminate features associated with AD and MCI. Diffusion tensor imaging scans of 48 patients with AD, 39 patients with late MCI, 75 patients with early MCI, and 51 age-matched healthy controls(HCs) are acquired from the Alzheimer's Disease Neuroimaging Initiative database. In addition to the common fractional anisotropy, mean diffusivity, axial diffusivity, and radial diffusivity metrics, there are two novel metrics,named local diffusion homogeneity that used Spearman's rank correlation coefficient and Kendall's coefficient concordance,which are taken as classification metrics. The recursive feature elimination method for support vector machine(SVM)and logistic regression(LR) combined with leave-one-out cross validation are applied to determine the optimal feature dimensions. Then the SVM and LR methods perform the classification process and compare the classification performance.The results show that not only can the multi-type combined metrics obtain higher accuracy than the single metric, but also the SVM classifier with multi-type combined metrics has better classification performance than the LR classifier.Statistically, the average accuracy of the combined metric is more than 92% for all between-group comparisons of SVM classifier. In addition to the high recognition rate, significant differences are found in the statistical analysis of cognitive scores between groups. We further execute the permutation test, receiver operating characteristic curves, and area under the curve to validate the robustness of the classifiers, and indicate that the SVM classifier is more stable and efficient than the LR classifier. Finally, the uncinated fasciculus, cingulum, corpus callosum, corona radiate, external capsule, and internal capsule have been regarded as the most important white matter tracts to identify AD, MCI, and HC. Our findings reveal a guidance role for machine-learning based image analysis on clinical diagnosis.     

ISG-FHEV等效燃油消耗最小控制策略

针对室内复杂环境下火灾识别准确率会降低的问题,提出了一种改进的粒子群算法优化支持向量机参数进行火灾火焰识别的方法。首先在 颜色空间进行火焰图像分割,对获得的火焰图像进行预处理并提取相关特征量;其次采用PSO算法搜索SVM的最优核参数和惩罚因子,并在PSO算法中加入变异操作和非线性动态调整惯性权值的方法,加快了搜索SVM最优参数的精度和速度;然后将提取的火焰各个特征量作为训练样本输入SVM模型进行训练,并建立参数优化后的SVM分类器模型;最后将待测试样本输入SVM模型进行分类识别。算法的火灾识别准确率达到94.09%,分类效果明显优于其他分类算法。仿真结果表明,改进的PSO优化SVM算法提高了火焰识别的准确率和实时性,算法的自适应性更强,误判率更低。     

基于波段选择的拉曼光谱血痕鉴别

血痕的种属鉴别在刑事技术和检验检疫等领域有重要的实践意义,拉曼光谱技术为血痕种属鉴别提供了思路。实验采集人血及猪、鸡、鸭、牛、鼠5种动物的血样并获取其拉曼光谱,采用Savitzky-Golay方法平滑降噪,airPLS方法进行基线校正,选取100~1 700 cm-1波段进行实验。训练集有600组数据,测试集有300组拉曼光谱数据。第一部分实验对比了PLS-DA,LDA,PCA+LDA,SVM和PCA+SVM等方法,测试集准确率分别为84.0%,49.3%,78%,83.0%和85.7%,验证了降维算法结合SVM分类器的有效性。第二部分采用互信息算法、遗传算法和等间隔组合三种波段选择算法,结合SVM分类器做对比实验,结果显示互信息结合SVM算法的分类准确率最优,在选择波段数为50时,测试集准确率达到86.0%。在波段选择数为300时,三种波段选择算法结合SVM分类器的准确率都达到93%左右,大幅高于传统分类方法。实验结果表明,采用波段选择算法进行光谱降维,可以有效的提高算法的准确率和鲁棒性,同时使拉曼光谱种属鉴定的可解释性更强。波段选择算法确定了血痕鉴别的关键波段位置,对设计用于执法的便携式拉曼系统也有重要意义。     

基于ICA与SVM算法的高光谱遥感影像分类

提出了一种利用独立分量分析(ICA)与支撑向量机(SVM)算法进行高光谱遥感影像分类的新方法。采用ICA算法对高光谱遥感影像(PHI传感器获取,80波段)进行了特征提取,并以提取出的影像数据(光谱维数为20)构建SVM分类器。对SVM算法进行核函数删选与参数寻优后,发现采用RBF核的SVM算法(C=103,γ=0.05)分类结果最佳,分类精度与Kappa系数分别达94.5127%与0.935 1,优于BP-神经网络(分类精度39.4758%,Kappa系数0.315 5)、波谱角分类(分类精度80.282 6,Kappa系数0.770 9)、最小距离分类(分类精度85.462 7%,Kappa系数0.827 7)以及最大似然分类(分类精度86.015 6%,Kappa系数0.835 1)4种方法。针对分类结果常出现的"椒盐"现象,利用形态学算子对SVM(RBF核)分类结果进行了类别集群处理,将分类精度与Kappa系数分别提高至94.758 4%与0.938 0,获得了更接近实况的分类图像。结果表明:ICA结合SVM算法准确率高,是高光谱遥感影像分类的优选方法,且类别集群是优化影像分类的有效方法之一。     

Quantum-enhanced least-square support vector machine: Simplified quantum algorithm and sparse solutions

Quantum algorithms can enhance machine learning in different aspects. Here, we study quantum-enhanced least-square support vector machine (LS-SVM). Firstly, a novel quantum algorithm that uses continuous variable to assist matrix inversion is introduced to simplify the algorithm for quantum LS-SVM, while retaining exponential speed-up. Secondly, we propose a hybrid quantum-classical version for sparse solutions of LS-SVM. By encoding a large dataset into a quantum state, a much smaller transformed dataset can be extracted using quantum matrix toolbox, which is further processed in classical SVM. We also incorporate kernel methods into the above quantum algorithms, which uses both exponential growth Hilbert space of qubits and infinite dimensionality of continuous variable for quantum feature maps. The quantum LS-SVM exploits quantum properties to explore important themes for SVM such as sparsity and kernel methods, and stresses its quantum advantages ranging from speed-up to the potential capacity to solve classically difficult machine learning tasks.     

Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data

Applying machine learning algorithms for assessing the transmission quality in optical networks is associated with substantial challenges. Datasets that could provide training instances tend to be small and heavily imbalanced. This requires applying imbalanced compensation techniques when using binary classification algorithms, but it also makes one-class classification, learning only from instances of the majority class, a noteworthy alternative. This work examines the utility of both these approaches using a real dataset from a Dense Wavelength Division Multiplexing network operator, gathered through the network control plane. The dataset is indeed of a very small size and contains very few examples of “bad” paths that do not deliver the required level of transmission quality. Two binary classification algorithms, random forest and extreme gradient boosting, are used in combination with two imbalance handling methods, instance weighting and synthetic minority class instance generation. Their predictive performance is compared with that of four one-class classification algorithms: One-class SVM, one-class naive Bayes classifier, isolation forest, and maximum entropy modeling. The one-class approach turns out to be clearly superior, particularly with respect to the level of classification precision, making it possible to obtain more practically useful models.     

一种基于形状的红外图像泄漏气体检测方法

针对工业生产中泄漏气体导致的爆炸和火灾问题, 提出一种基于形状和SVM分类的红外图像泄漏气体检测方法。采用泄漏气体和干扰物红外图像样本的形状特征训练SVM分类器, 通过对红外图像序列采用基于背景差分的运动检测得到候选目标区域, 再对候选目标区域提取其形状特征, 最后使用SVM分类器进行判别, 从而得到最终的检测结果。使用乙烯气体泄漏仿真数据进行实验, 检测率最高可达98%, 结果表明, 采用该方法可以有效检测泄漏气体, 相比其他方法, 极大地减少了干扰物造成的误检。     

Combined multi-kernel support vector machine and wavelet analysis for hyperspectral remote sensing image classification

Many remote sensing image classifiers are limited in their ability to combine spectral features with spatial features.Multi-kernel classifiers,however,are capable of integrating spectral features with spatial or structural features using multiple kernels and summing them for final outputs.Using a support vector machine(SVM) as classifier,different multi-kernel classifiers are constructed and tested using 64-band Operational Modular Imaging Spectrometer II hyperspectral image of Changping Area,Beijing City.Results show that by integrating spectral and wavelet texture information,multi-kernel SVM classifiers can obtain more accurate classification results than sole-kernel SVM classifiers and cross-information SVM kernel classifiers.Moreover,when the multi-kernel SVM classifier is used,the combination of the first four principal components from principal component analysis and wavelet texture provides the highest accuracy(97.06%).Multi-kernel SVM is therefore an effective approach to improve the accuracy of hyperspectral image classification and to expand possibilities for remote sensing image interpretation and application.     

结合高光谱成像和机器学习的棉种年份鉴别

棉花精量播种技术目前已经在新疆兵团全面推广,该技术能精确实现一穴一粒的农艺技术指标,但是也对高质量棉种的筛选提出了更高的要求。为了避免播种往年活力不足的棉种而导致发芽率降低的问题,结合机器学习和近红外（NIR）高光谱成像技术（HSI）进行棉种年份精确鉴别,实现棉种的快速无损筛选。采集2016年—2019年近四年外观无明显差异的棉种各360粒,共1 440粒棉种（按照3∶1∶1划分训练集、验证集和测试集）作为样本,按照每批60粒采集915~1 698 nm范围的棉种高光谱图像,去除首尾两端噪声大的光谱,保留1 002~1 602 nm范围的光谱为原始数据。利用Savitzky-Golay（SG）平滑算法对光谱进行预处理,采用主成分载荷方法（PCA-loading）选取13个特征波段,基于全部光谱数据和特征波段（±10 nm）数据建立逻辑回归（LR）、偏最小二乘判别分析（PLS-DA）、支持向量机（SVM）、循环神经网络（RNN）、长短记忆网络（LSTM）和卷积神经网络（CNN）六种分类模型。使用全光谱数据建模时,六种分类模型在测试集上的鉴别准确率分别为96.27%,98.98%,99.32%,96.95%,97.63%和100%,其中CNN和SVM模型取得了较好的结果;使用特征光谱数据建模时,六种分类模型在测试集上的鉴别精度分别为93.56%,97.29%,98.30%,95.25%,94.24%和99.66%,其中CNN和SVM模型仍有较好的分类结果。结果表明,使用全光谱数据建模时,六种分类模型都可以实现较高精度的棉种年份鉴别,使用特征光谱数据建模时CNN和SVM模型的鉴别精度仍可达到98%;其中深度学习方法优于传统机器学习方法,但是传统机器学习方法仍能保持较好的鉴别准确率。因此,结合近红外高光谱成像技术和机器学习方法能够实现棉种年份的高精度鉴别,为棉花精量播种过程中的优质棉种选种技术提供理论依据和方法。     

基于支持向量机的机载吊舱故障诊断优化算法

提升机载吊舱的后勤保障能力,适应吊舱测试中多型号、多故障类型和测试环境动态变化的测试要求,是打赢现代化战争的重要保障。支持向量机（SVM）算法适用于小样本、高维度、非线性分类问题,SVM相关参数是影响算法性能的重要因素。基于K-CV算法和粒子群算法两种改进的SVM模型可以实现SVM参数优化,K-CV算法可以交叉验证优化模型参数,粒子群算法可以对SVM参数进行动态寻优,建立多核SVM吊舱故障诊断模型。两种算法都可以提高吊舱故障诊断模型的准确率,提高模型的学习能力和泛化能力,有效对吊舱的故障进行定量和定位诊断。     

利用高性能混合深度学习网络提升光谱分类性能研究

随着观测设备的不断完善,人们获得的光谱数量持续上升,如何进一步提高光谱自动分类的性能引起广泛关注.为此,以恒星光谱为研究对象,在近年来新出现的BERT和CNN等深度学习模型的基础上,试图融合了BERT模型和CNN模型在特征提取和智能分类方面的优势,提出高性能混合深度学习网络BERT-CNN,用以探讨该模型在提升光谱分类...     

Effect of the target positions on the rapid identification of aluminum alloys by using filament-induced breakdown spectroscopy combined with machine learning

Filament-induced breakdown spectroscopy (FIBS) combined with machine learning algorithms was used to identify five aluminum alloys. To study the effect of the distance between focusing lens and target surface on the identification accuracy of aluminum alloys, principal component analysis (PCA) combined with support vector machine (SVM) and K-nearest neighbor (KNN) was used. The intensity and intensity ratio of fifteen lines of six elements (Fe, Si, Mg, Cu, Zn, and Mn) in the FIBS spectrum were selected. The distances between the focusing lens and the target surface in the pre-filament, filament, and post-filament were 958 mm, 976 mm, and 1000 mm, respectively. The source data set was fifteen spectral line intensity ratios, and the cumulative interpretation rates of PC1, PC2, and PC3 were 97.22%, 98.17%, and 95.31%, respectively. The first three PCs obtained by PCA were the input variables of SVM and KNN. The identification accuracy of the different positions of focusing lens and target surface was obtained, and the identification accuracy of SVM and KNN in the filament was 100% and 90%, respectively. The source data set of the filament was obtained by PCA for the first three PCs, which were randomly selected as the training set and test set of SVM and KNN in 3:2. The identification accuracy of SVM and KNN was 97.5% and 92.5%, respectively. The research results can provide a reference for the identification of aluminum alloys by FIBS.     

基于时频谱特征的白酒品质分类方法研究

为了建立快速、准确的白酒品质鉴别方法,利用机器学习方法对不同品质的白酒建模。为了提取不同品质白酒的特征,使用离子迁移谱对不同品质白酒进行分析,构建了基于白酒离子迁移谱信号的特征向量,并对不同品质的白酒进行了识别与分类。白酒样本的离子迁移谱信号通过利用美国Excellims公司GA2100型电喷雾-离子迁移谱仪（ESI-IMS）采集获得,每一个离子迁移谱信号是强度随时间变化的时间序列信号;提取了原始数据离子迁移谱的时域特征谱峰。为了获得更全面的特征,对离子迁移谱数据进行了傅里叶变换并提取频域内的特征谱峰。同时为了表述信号变化的特征,计算了离子迁移谱的谱熵和过零率,构建N×9维的特征向量矩阵;使用主成分分析(PCA)和线性判别分析(LDA)分别对上述获得的特征进行了特征降维,其中使用PCA对特征向量矩阵降维后的前三维特征对整体特征的累计贡献率达到了95%,而使用LDA对特征向量矩阵降维后的前两维特征对整体特征的累计贡献率就达到了95%。因此,选择了LDA作为特征降维方法;最后,利用机器学习中的非线性分类器支持向量机(SVM)对白酒离子迁移谱数据进行分类研究。实验结果表明,在真酒和添加酒精的白酒二分类中,SVM方法正确分类率达到100%;而在真酒和分别添加10%,20%,30%,40%和50%酒精浓度的五种假酒的六分类中,SVM方法正确分类率达到99.7%。比较了逻辑回归(LRM)分类、模糊C均值分类(FCM)和K近邻分类(KNN)对白酒样本离子迁移谱分类实验结果。研究表明,对于离子迁移谱非常接近的真酒和添加酒精的白酒,基于频谱特征向量的SVM方法能够准确的区分开来,为白酒的品质鉴别提供了一种新的检测方法。