水下高分辨率声图中小目标的深度网络分类方法

针对声成像数据缺少条件下的水下沉底小目标分类问题,提出一种深度网络分类算法。首先,采用高斯混合模型对声影区统计特性进行建模并提取声图阴影,在此基础上构建仿真数据集和真实数据集。将仿真数据集输入卷积神经网络进行训练,保留其特征提取部分,用于对真实数据集进行特征提取.重建网络分类部分并采用真实数据集的特征向量进行训练。结果表明,所提出的方法分类正确率可达88.24%,与6种对照方法相比平均分类正确率分别提升8.67%,20.47%,19.78%,11.59%,9.01%,11.58%。验证了所提出方法在小样本条件下具有较好对水下沉底小目标的分类能力。其学习曲线收敛到96.25%,仅比验证曲线高5.14%,说明在一定程度上缓解了过拟合问题。将改进的卷积神经网络应用于融合分类器,通过与逻辑回归分类器、支持向量机对目标进行分类并融合决策,正确率为93.33%,可进一步提高算法的正确率和稳定性.      

基于BP神经网络的血液荧光光谱识别分类研究

光谱技术在生物和医学检测方面具有积极的应用前景。由于血液成分的复杂性和类同性,有关不同动物血液光谱识别分类的技术研究尚未出现较为完善的结论。基于机器学习理论, 以BP神经网络为工具, 建立了对不同动物血液荧光光谱进行特征提取和识别分类的方法。实验采用Cary Eclipse光谱仪分别采集了鸽、鸡、鼠、羊四种动物不同浓度(1%和3%)的全血与红细胞荧光光谱数据(每个类型样本各50组数据);基于移动平滑算法对原始数据进行了平滑处理,以减少实验仪器噪声对特征提取和识别分类的影响;进一步根据血液光谱数据的特性, 该文出了“组合放大”的特征提取方法, 并建立了BP神经网络分类器进行训练和识别。相比于常用的光谱数据(单一)特征, 提出的“组合放大”特征和所设计的BP神经网络能对不同动物、不同类型(全血与红细胞)、不同浓度(1%和3%)的血液荧光光谱实现100%的准确分类, 同时神经网络测试误差均远小于设定的允许误差值。研究的动物血液光谱特征提取及识别技术具有较好的普适性和可靠性, 在农业、食品检查、以及生物医学检测等方面均可发挥重要作用。     

Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data

Applying machine learning algorithms for assessing the transmission quality in optical networks is associated with substantial challenges. Datasets that could provide training instances tend to be small and heavily imbalanced. This requires applying imbalanced compensation techniques when using binary classification algorithms, but it also makes one-class classification, learning only from instances of the majority class, a noteworthy alternative. This work examines the utility of both these approaches using a real dataset from a Dense Wavelength Division Multiplexing network operator, gathered through the network control plane. The dataset is indeed of a very small size and contains very few examples of “bad” paths that do not deliver the required level of transmission quality. Two binary classification algorithms, random forest and extreme gradient boosting, are used in combination with two imbalance handling methods, instance weighting and synthetic minority class instance generation. Their predictive performance is compared with that of four one-class classification algorithms: One-class SVM, one-class naive Bayes classifier, isolation forest, and maximum entropy modeling. The one-class approach turns out to be clearly superior, particularly with respect to the level of classification precision, making it possible to obtain more practically useful models.     

激光诱导击穿光谱技术结合神经网络和支持向量机算法的人参产地快速识别研究

利用激光诱导击穿光谱技术结合机器学习算法,对东北5个产地(大兴安岭、集安、恒仁、石柱、抚松)的人参进行产地识别,建立了主成分分析算法分别结合反向传播(BP)神经网络和支持向量机算法的人参产地识别模型.实验采集了5个产地人参共657组在200—975 nm的激光诱导击穿光谱,经光谱数据预处理后,对C,Mg,Ca,Fe,H...     

基于波形叠加极限学习机的近红外光谱药品鉴别

近红外光谱药品鉴别作为识别假冒伪劣药品的一种有效技术手段,已被广泛应用到各大医疗行业和药品监督管理机构,并结合模式识别建模方法在基层药品打假中得到较好的推广。由于传统建模方法很难满足药品鉴别中大规模、多分类、快速建模等问题,因此采用一种基于波形叠加极限学习机(SWELM(CS))分类方法对光谱数据进行鉴别。通过选用极限学习机(ELM)作为光谱药品分类器,使得分类模型具有快速学习能力以及对训练样本不敏感的特点;由于极限学习机的连接权值和隐层神经元阈值是随机生成导致网络稳定性差,因此结合布谷鸟搜索算法优化分类模型参数;采用反双曲线正弦函数与Morlet小波函数叠加的激励函数代替ELM原有的单一激励函数改善了分类模型的收敛速度和稳健性。通过上述改进方法使得SWELM(CS)具有对训练样本不敏感性,布谷鸟参数优化的分类稳定性、波形叠加函数的强收敛性与信号特征提取能力。该方法为核函数提供的信号特征提取及拟合的思想,可推广到其他学习算法中以获取更高的分类准确度及稳定性。该实验选定西安杨森制药厂生产的249个近红外光谱药品样本作为研究的主要对象,重点研究光谱药品的二分类和多分类实验,实验证明SWELM(CS)分类器相比BP神经网络、标准ELM以及粒子群优化ELM等传统分类器算法具有更高的分类准确度、分类稳定性及更小的训练样本敏感性。     

An Overview of Infrared Spectroscopy Based on Continuous Wavelet Transform Combined with Machine Learning Algorithms: Application to Chinese Medicines,Plant Classification,and Cancer Diagnosis

Abstract

Infrared spectroscopy has been a workhorse technique for materials analysis and can result in positively identifying many different types of material. In recent years there have been reports using wavelet analysis and machine learning algorithms to extract features of Fourier transform infrared spectrometry (FTIR). The machine learning algorithms contain back-propagation neural network (BPNN), radial basis function neural network (RBFNN), and support vector machine (SVM). This article reviews the important advances in FTIR analysis employing a continuous wavelet transform (CWT) and machine learning algorithms, especially in the applications of the method for Chinese medicine identification, plant classification, and cancer diagnosis.     

Green's function Monte Carlo method combined with restricted Boltzmann machine approach to the frustrated J1-J2 Heisenberg model

Restricted Boltzmann machine (RBM) has been proposed as a powerful variational ansatz to represent the ground state of a given quantum many-body system. On the other hand, as a shallow neural network, it is found that the RBM is still hardly able to capture the characteristics of systems with large sizes or complicated interactions. In order to find a way out of the dilemma, here, we propose to adopt the Green's function Monte Carlo (GFMC) method for which the RBM is used as a guiding wave function. To demonstrate the implementation and effectiveness of the proposal, we have applied the proposal to study the frustrated J₁-J₂ Heisenberg model on a square lattice, which is considered as a typical model with sign problem for quantum Monte Carlo simulations. The calculation results demonstrate that the GFMC method can significantly further reduce the relative error of the ground-state energy on the basis of the RBM variational results. This encourages to combine the GFMC method with other neural networks like convolutional neural networks for dealing with more models with sign problem in the future.     

基于双向长短期记忆网络的太赫兹光谱识别

特征提取是太赫兹光谱识别的关键处理步骤,通常利用降维方法作为特征提取手段。然而,当一些化合物的太赫兹光谱曲线整体差异度较小时,降维方法往往会缺失样本差异的重要特征信息,从而导致分类错误。如果不采用降维方法提取特征,传统机器学习分类算法对维数较高的原始太赫兹光谱数据又不能很好的分类。针对此问题,提出了一种基于双向长短期记忆网络（BLSTM-RNN）自动提取太赫兹光谱特征的识别方法。BLSTM-RNN作为一种特殊的循环神经网络,利用其LSTM单元可以有效解决原始太赫兹光谱数据维数较高使得模型难以训练问题。再结合模型的双向频谱信息利用架构模式,可以增强模型对复杂光谱数据自动提取有效特征信息的能力。采用三类、15种化合物太赫兹透射光谱作为测试对象,首先利用S-G滤波和三次样条插值对Anthraquinone,Benomyl和Carbazole等十五种化合物在0.9～6 THz内的太赫兹透射光谱数据进行归一化处理,然后通过构建一个具有双向长短期记忆的循环神经网络对太赫兹光谱的全频谱信息进行自动特征提取并利用Softmax分类器进行分类。通过试验优化网络结构和各项参数,最终获得了针对复杂太赫兹透射光谱数据的预测模型,并与传统机器学习算法SVM,KNN及神经网络算法MLP,CNN进行对比实验。结果表明,dataset-1和dataset-2分别作为差异度较大和无明显峰值特征的五种化合物太赫兹透射光谱数据集,其平均识别率分别为100%和98.51%,与其他方法相比识别率有所提高;最重要的是,dataset-3作为5种化合物谱线极为相似的太赫兹透射光谱数据集,其平均识别率为96.56%,与其他方法相比识别率提高显著;dataset-4作为dataset-1,dataset-2和dataset-3的透射光谱数据集集合,其平均识别率为98.87%。从而验证了BLSTM-RNN模型能自动提取有效的太赫兹光谱特征,同时又能保证复杂太赫兹光谱的预测精度。在选择模型训练优化算法方面,使用Adam优化算法要好于RMSProp,SGD和AdaGrad,其模型的目标函数损失值收敛速度最快。同时随着模型训练迭代次数增加,相似太赫兹透射光谱数据集的预测准确率也不断提升。可为复杂太赫兹光谱数据库的光谱识别检索提供一种新的识别方法。     

FedHGCDroid: An Adaptive Multi-Dimensional Federated Learning for Privacy-Preserving Android Malware Classification

With the popularity of Android and its open source, the Android platform has become an attractive target for hackers, and the detection and classification of malware has become a research hotspot. Existing malware classification methods rely on complex manual operation or large-volume high-quality training data. However, malware data collected by security providers contains user privacy information, such as user identity and behavior habit information. The increasing concern for user privacy poses a challenge to the current malware classification scheme. Based on this problem, we propose a new android malware classification scheme based on Federated learning, named FedHGCDroid, which classifies malware on Android clients in a privacy-protected manner. Firstly, we use a convolutional neural network and graph neural network to design a novel multi-dimensional malware classification model HGCDroid, which can effectively extract malicious behavior features to classify the malware accurately. Secondly, we introduce an FL framework to enable distributed Android clients to collaboratively train a comprehensive Android malware classification model in a privacy-preserving way. Finally, to adapt to the non-IID distribution of malware on Android clients, we propose a contribution degree-based adaptive classifier training mechanism FedAdapt to improve the adaptability of the malware classifier based on Federated learning. Comprehensive experimental studies on the Androzoo dataset (under different non-IID data settings) show that the FedHGCDroid achieves more adaptability and higher accuracy than the other state-of-the-art methods.     

圈养瓶鼻海豚通讯信号分析及融合分类方法

针对圈养条件下瓶鼻海豚通讯信号（whistle）分类时混叠大量回声定位信号（click）导致分类正确率降低的问题,提出了一种基于机器学习的融合分类方法。分别提取whistle信号的时频分布特征训练随机森林分类器,梅尔时频图特征训练卷积神经网络分类器,在此基础上设计融合判决器对混叠whistle信号进行分类识别。对圈养海豚声信号采集实验数据的分类识别结果表明,融合分类方法具有更好的分类性能,对混叠whistle信号分类正确率大于94%,优于时频分布特征分类器和梅尔时频图特征分类器,能够提高混叠信号的分类能力。      

基于可见光谱和支持向量机的黄瓜叶部病害识别方法研究

以黄瓜叶部病害作为研究对象,基于可见光谱反射率差异识别黄瓜叶部病害,研究基于SVM的黄瓜叶部病害识别预测模型。采用小波变换进行数据预处理;选取Otsu、边缘分割法和K均值聚类三类分割方法进行病斑分割,比较错分率和运行时间,K均值聚类方法更适合黄瓜叶部病斑分割;提取纹理、颜色和形状特征参数,共15个特征参数;通过交叉验证选择最优参数c和g,对核函数参数进行优化处理,并通过比较线性核、多项式核、RBF核等不同核函数情况下SVM的正确识别率,确定RBF核SVM模式识别方法能够更精准地识别黄瓜叶部病害。并将基于SVM与另外两种常见的黄瓜叶部病害识别方法,BP神经网络和模糊聚类进行比较,结果表明,基于SVM的识别模型对霜霉病的正确识别率为95%,白粉病和褐斑病的正确识别率均为90%,平均诊断正确率为92%;该模式识别方法识别效果最佳,运行时间最短,为基于可见光谱的黄瓜病害识别模型提供参考。     

VIS/NIR imaging application for honey floral origin determination

Nondestructive methods are of utmost importance for honey characterization. This study investigates the potential application of VIS-NIR hyperspectral imaging for detection of honey flower origin using machine learning techniques. Hyperspectral images of 52 honey samples were taken in transmittance mode in the visible/near infrared (VIS-NIR) range (400–1000 nm). Three different machine learning algorithms were implemented to predict honey floral origin using honey spectral images. These methods, included radial basis function (RBF) network, support vector machine (SVM), and random forest (RF). Principal component analysis (PCA) was also exploited for dimensionality reduction. According to the obtained results, the best classifier (RBF) achieved a precision of 94% in a fivefold cross validation experiment using only the first two PCs. Mapping of the classifier results to the test set images showed 90% accuracy for honey images. Three types of honey including buckwheat, rapeseed and heather were classified with 100% accuracy. The proposed approach has great potential for honey floral origin detection. As some other honey properties can also be predicted using image features, in addition to floral origin detection, this method may be applied to predict other honey characteristics.     

混杂复合材料等效热传导性能预测的小波-机器学习混合方法

混杂复合材料是一种新型复合材料,其复杂的细观结构导致预测其等效热传导性能极富挑战性.本文结合渐近均匀化方法、小波变换方法和机器学习方法发展了一种新的可以有效预测混杂复合材料等效热传导性能的小波-机器学习混合方法.该方法主要包括离线多尺度建模和在线机器学习两部分.首先借助渐近均匀化方法通过离线多尺度建模建立了混杂复合材料的热传导性能材料数据库,然后利用小波变换方法对离线的材料数据库进行预处理,接下来分别运用人工神经网络和支持向量回归方法建立混杂复合材料等效热传导性能预测的在线机器学习模型.最后通过对周期和随机混杂复合材料进行数值实验,验证了小波-机器学习混合方法的有效性,数值实验结果表明小波-神经网络混合方法具有最优的预测效果和抗噪能力.此外,需要强调的是对于具有高维大规模数据特征的随机混杂复合材料,小波-机器学习混合方法不仅可以提取离线材料数据库的重要特征,还可以显著减少在线监督学习的输入数据规模并提高机器学习模型的训练效率及抗噪性能.本文建立的小波-机器学习混合方法不仅适用于混杂复合材料等效热传导性能的预测,还可进一步推广应用于复合材料等效物理、力学性能的预测.     

基于DBN,SVM和BP神经网络的光谱分类比较

恒星的分类对了解恒星和星系形成与演化历史具有重要的研究价值。面对大型巡天计划及由此产生的海量数据,如何迅速准确地将天体自动分类显得尤为重要。通过对SDSS DR9的恒星光谱数据进行深度置信神经网络(DBN)、神经网络和支持向量机(SVM)等算法分类的对比,分析三种自动光谱分类方法在恒星分类上的适用性。首先利用上述三种方法对K,F恒星进行识别分类,然后再分别对K1,K3和K5次型和F2,F5,F9次型识别,最后基于SVM支持向量机的二次分类模型,利用K次型的数据,构建剔除不属于K次型的模型。结果表明:深度置信网络对K,F型恒星分类效果较好,但是对K,F次型的分类效果不佳;SVM支持向量机在K,F型恒星分类以及相应的次型分类都具有较好的识别率,对K,F型分类效果要好于K,F次型的分类效果;BP神经网络对K,F型恒星以及其次型的识别一般;在剔除不属于K次型实验中,剔除率高达100%,可知SVM能够对未知的光谱数据进行筛选与分类。     

A Novel Method for Colorectal Cancer Screening Based on Circulating Tumor Cells and Machine Learning

Colorectal cancer is one of the most common types of cancer, and it can have a high mortality rate if left untreated or undiagnosed. The fact that CRC becomes symptomatic at advanced stages highlights the importance of early screening. The reference screening method for CRC is colonoscopy, an invasive, time-consuming procedure that requires sedation or anesthesia and is recommended from a certain age and above. The aim of this study was to build a machine learning classifier that can distinguish cancer from non-cancer samples. For this, circulating tumor cells were enumerated using flow cytometry. Their numbers were used as a training set for building an optimized SVM classifier that was subsequently used on a blind set. The SVM classifier’s accuracy on the blind samples was found to be 90.0%, sensitivity was 80.0%, specificity was 100.0%, precision was 100.0% and AUC was 0.98. Finally, in order to test the generalizability of our method, we also compared the performances of different classifiers developed by various machine learning models, using over-sampling datasets generated by the SMOTE algorithm. The results showed that SVM achieved the best performances according to the validation accuracy metric. Overall, our results demonstrate that CTCs enumerated by flow cytometry can provide significant information, which can be used in machine learning algorithms to successfully discriminate between healthy and colorectal cancer patients. The clinical significance of this method could be the development of a simple, fast, non-invasive cancer screening tool based on blood CTC enumeration by flow cytometry and machine learning algorithms.     

基于深层信念网络的太赫兹光谱识别

特征提取和分类是太赫兹光谱识别的关键。部分物质在太赫兹波段内没有明显的吸收峰,难以人工定义、提取特征及分类识别,为此,结合深度信念网络(deep belief network,DBN)和K-Nearest Neighbors (KNN)分类器的优点,提出了一种基于DBN的太赫兹光谱识别方法。首先利用S-G滤波和三次样条插值对ATP,acetylcholine_bromide,bifenthrin,buprofezin,carbazole,bleomycin,buckminster和cylotriphosphazene在0.9～6 THz内的太赫兹透射光谱进行归一化处理;然后由两层受限波尔兹曼机(restricted Boltzmann machine, RBM)构建DBN模型,并采用逐层无监督的方法训练模型,以自动提取太赫兹光谱特征;最后用KNN分类器对8种物质的太赫兹透射光谱进行分类。结果表明,使用DBN自动提取的光谱特征,KNN分类器、BP神经网络、SOM神经网络和RBF神经网络的分类准确率达到了90%以上,且KNN分类器的识别率优于其他三种分类器;采用DBN自动提取物质的太赫兹光谱特征大大减少了工作量,在海量光谱数据识别中具有广阔的应用前景。     

Federated Quantum Machine Learning

Distributed training across several quantum computers could significantly improve the training time and if we could share the learned model, not the data, it could potentially improve the data privacy as the training would happen where the data is located. One of the potential schemes to achieve this property is the federated learning (FL), which consists of several clients or local nodes learning on their own data and a central node to aggregate the models collected from those local nodes. However, to the best of our knowledge, no work has been done in quantum machine learning (QML) in federation setting yet. In this work, we present the federated training on hybrid quantum-classical machine learning models although our framework could be generalized to pure quantum machine learning model. Specifically, we consider the quantum neural network (QNN) coupled with classical pre-trained convolutional model. Our distributed federated learning scheme demonstrated almost the same level of trained model accuracies and yet significantly faster distributed training. It demonstrates a promising future research direction for scaling and privacy aspects.     

一种改进的DNN-HMM的语音识别方法*

针对深度神经网络与隐马尔可夫模型(DNN-HMM)结合的声学模型在语音识别过程中建模能力有限等问题,提出了一种改进的DNN-HMM模型语音识别算法。首先根据深度置信网络(DBN)结合深度玻尔兹曼机(DBM),建立深度神经网络声学模型,然后提取梅尔频率倒谱系数(MFCC)和对数域的Mel滤波器组系数(Fbank)作为声学特征参数,通过TIMIT语音数据集进行实验。实验结果表明:结合了DBM的DNN-HMM模型相比DNN-HMM模型更具优势,其中,使用MFCC声学特征在词错误率与句错误率方面分别下降了1.26%和0.20%。此外,使用默认滤波器组的Fbank特征在词错误率与句错误率方面分别下降了0.48%和0.82%,并且适量增加滤波器组可以降低错误率。总之,研究取得句错误率与词错误率分别降低到21.06%和3.12%的好成绩。     

A Multi-Classification Hybrid Quantum Neural Network Using an All-Qubit Multi-Observable Measurement Strategy

Quantum machine learning is a promising application of quantum computing for data classification. However, most of the previous research focused on binary classification, and there are few studies on multi-classification. The major challenge comes from the limitations of near-term quantum devices on the number of qubits and the size of quantum circuits. In this paper, we propose a hybrid quantum neural network to implement multi-classification of a real-world dataset. We use an average pooling downsampling strategy to reduce the dimensionality of samples, and we design a ladder-like parameterized quantum circuit to disentangle the input states. Besides this, we adopt an all-qubit multi-observable measurement strategy to capture sufficient hidden information from the quantum system. The experimental results show that our algorithm outperforms the classical neural network and performs especially well on different multi-class datasets, which provides some enlightenment for the application of quantum computing to real-world data on near-term quantum processors.     

基于AdaBoost与GABP的模拟电路软故障诊断方法

针对容差模拟电路软故障诊断精度较低的问题,提出了一种基于AdaBoost与GABP的组合分类器诊断方法;首先,在Pspice中对故障模式进行Monte-Carlo分析,并利用波形有效点提取法提取故障特征,在此基础上,做归一化处理构建神经网络的原始样本;其次,利用GA算法与L-M算法组合优化BP网络构建GABP分类器;最后,利用AdaBoost算法对GABP单分类器进行迭代提升,构建AdaBoost-GABP组合分类器;诊断实例的结果表明,该方法比传统的单分类器诊断方法具有更高的诊断精度、更低的绝对误差,能够克服单分类器容易陷入局部最优,诊断结论不可信的缺陷。