Research on classification of LiDAR images derived from waveform decomposition over a suburban area

Light detection and ranging (LiDAR), as an active remote sensing technology, is characterized by providing high-precision geographical location information. In this study, we further explored its capability in image classification over a suburban area. Firstly, full waveforms of small footprint airborne LiDAR were decomposed into discrete point clouds. During the decomposition, six parameters describing the physical interaction between laser pulse and the targets were calculated. They are amplitude, pulse width, central position, range, backscatter cross-section and backscatter coefficient. Secondly, the point clouds were interpolated into raster. Correspondingly, six high spatial resolution images (0.5 m) were produced. Three classification models namely decision tree (DT), maximum likelihood (ML) and support vector machine (SVM) were established based on these images. The objects of interest were classified into buildings, trees, bare soil and crop land. Results showed that all these three models yielded high overall accuracy and kappa coefficient. SVM performed the best with the highest overall accuracy (87.85%) and kappa coefficient (83.29%). Therefore, we came to conclude that classification models can also achieve satisfactory classification accuracy on LiDAR images as they did on common remote-sensed images. In addition, our study proved that physical information derived from waveform LiDAR showed good potential in classification.     

Application of Machine Learning for Tool Condition Monitoring in Turning

The machining process is primarily used to remove material using cutting tools. Any variation in tool state affects the quality of a finished job and causes disturbances. So, a tool monitoring scheme (TMS) for categorization and supervision of failures has become the utmost priority. To respond, traditional TMS followed by the machine learning (ML) analysis is advocated in this paper. Classification in ML is supervised based learning method wherein the ML algorithm learn from the training data input fed to it and then employ this model to categorize the new datasets for precise prediction of a class and observation. In the current study, investigation on the single point cutting tool is carried out while turning a stainless steel (SS) workpeice on the manual lathe trainer. The vibrations developed during this activity are examined for failure-free and various failure states of a tool. The statistical modeling is then incorporated to trace vital signs from vibration signals. The multiple-binary-rule-based model for categorization is designed using the decision tree. Lastly, various tree-based algorithms are used for the categorization of tool conditions. The Random Forest offered the highest classification accuracy, i.e., 92.6%.

     

Machine Learning and Micromagnetic Studies of Magnetization Switching

Magnetization switching is one of the most fundamental topics in the field of magnetism.Machine learning(ML)models of random forest(RF),support vector machine(SVM),deep neural network(DNN)methods are built and trained to classify the magnetization reversal and non-reversal cases of single-domain particle,and the classification performances are evaluated by comparison with micromagnetic simulations.The results show that the ML models have achieved great accuracy and the DNN model reaches the best area under curve(AUC)of 0.997,even with a small training dataset,and RF and SVM models have lower AUCs of 0.964 and 0.836,respectively.This work validates the potential of ML applications in studies of magnetization switching and provides the benchmark for further ML studies in magnetization switching.     

Classification of star/galaxy/QSO and star spectral types from LAMOST data release 5 with machine learning approaches

We use 343,747 sources from LAMOST DR5 to do star/galaxy/QSO classification with machine learning approaches. Specifically, the 312,767 spectral labeled stars (G, K, M, F, A) are used to do star classification. The photometry of u, g, r, i, z, J, and H are used as machine learning features. For star/galaxy/QSO classification, the k nearest neighbor algorithm (KNN), decision tree (DT), random forest (RF) and support vector machine (SVM) perform well. For star classification, the accuracy of RF and SVM classification are higher than the accuracy of KNN and DT. The area under receiver operating characteristic curves of the four models are approaching to 1. The accuracy, precision, recall, f_score, Matthews correlation coefficient are always greater than 0.5. The four models perform all right in predicting the nature of sources and the star label.     

A novel binary tree support vector machine for hyperspectral remote sensing image classification

According to the principle of support vector machine (SVM) and the inter-class separability rule of hyperspectral data, a novel binary tree SVM classifier based on separability measure among different classes is proposed for hyperspectral image classification. J–M distance is used to measure the separability in order to generate the binary tree automatically. By experiments using airborne operational modular imaging spectrometer II (OMIS II) data, satellite EO-1 Hyperion hyperspectral data and airborne AVIRIS data, the classification accuracy of different multi-class SVMs is obtained and compared. Experimental results indicate that the proposed adaptive binary tree classifier outperforms other existing multi-class SVM strategies. Use of the adaptive binary tree SVM classifier is a novel approach to improve the accuracy of hyperspectral image classification and expand the possibilities for interpretation and application of hyperspectral remote sensing image.     

Detecting Unfavorable Driving States in Electroencephalography Based on a PCA Sample Entropy Feature and Multiple Classification Algorithms

Unfavorable driving states can cause a large number of vehicle crashes and are significant factors in leading to traffic accidents. Hence, the aim of this research is to design a robust system to detect unfavorable driving states based on sample entropy feature analysis and multiple classification algorithms. Multi-channel Electroencephalography (EEG) signals are recorded from 16 participants while performing two types of driving tasks. For the purpose of selecting optimal feature sets for classification, principal component analysis (PCA) is adopted for reducing dimensionality of feature sets. Multiple classification algorithms, namely, K nearest neighbor (KNN), decision tree (DT), support vector machine (SVM) and logistic regression (LR) are employed to improve the accuracy of unfavorable driving state detection. We use 10-fold cross-validation to assess the performance of the proposed systems. It is found that the proposed detection system, based on PCA features and the cubic SVM classification algorithm, shows robustness as it obtains the highest accuracy of 97.81%, sensitivity of 96.93%, specificity of 98.73% and precision of 98.75%. Experimental results show that the system we designed can effectively monitor unfavorable driving states.     

基于影像组学的直肠癌术前T分期预测

直肠癌T分期对患者的术前评估有重要作用.然而,传统的放射科医生根据患者磁共振图像直接判断分期的方法效果欠佳.本文提出使用影像组学的方法预测直肠癌T分期,首先获取105例直肠癌患者影像数据,根据病理报告中的T分期结果将T1、T2期患者划分为未突破肌层组,将T3、T4期患者分为突破肌层组,整理数据得到未突破肌层组31例,突破肌层组74例.在患者的轴向位T2WI图像中勾画病灶区域,并在病灶上使用pyradiomics工具包提取影像组学特征,使用最小绝对值收敛和选择算子（LASSO）对高维特征做特征选择,得到与T分期高度相关的特征数据,使用随机森林、支持向量机（SVM）、逻辑回归、梯度提升树（GBDT）分别建模,进行交叉验证调参,评估模型性能.每层图像提取100维特征,经LASSO特征选择后得到7个与T分期高度相关的特征,使用4种模型分别建模,其中SVM算法表现最优,平均受试者操作特征曲线下面积（AUC）、准确率、灵敏度、特异度分别为0.968 5、0.886 4、0.962 5、0.899 2,测试集准确率达到了0.904 7.结果表明,使用影像组学方法可以提高直肠癌T分期预测的准确率.     

基于计算机视觉技术的茶叶品质随机森林感官评价方法研究

为弥补茶叶品质感官审评存在的缺陷，利用计算机视觉技术对茶叶品质进行快速无损评价研究。以碧螺春绿茶为对象，依据专家感官审评结果，将茶样分成4个等级；采用中值滤波及拉普拉斯算子对茶样图像进行预处理，并提取预处理后的茶样图像的颜色特征和纹理特征以表征茶叶图像的外形特征，利用随机森林算法对茶叶外形特征属性进行重要性排序；筛选出重要性较大的特征及随机森林算法中最优的决策树棵数建立感官评价模型，并与建立的支持向量机(SVM)模型性能相比较。结果表明：色调均值、色调标准差、绿体均值、平均灰度级、饱和度均值、红体均值、饱和度标准差、亮度均值、一致性等9个特征属性的重要性较大，且与感官审评特征描述结果相一致；当采用优选出的9个重要性较大的特征及决策数棵数为500时，建立的模型性能最优，模型总体判别率为95.75%，Kappa系数为0.933，OOB误差为5%，较SVM模型分别提高了3.5%，0.066，优选的9个重要性较大的图像特征与感官审评特征描述相一致。研究表明：利用随机森林方法筛选出对茶叶外形特征属性贡献最大的少数几个特征建立模型，模型性能就能达到很好的识别效果，模型得到简化，同时模型精度和稳定性都高于其他方法。     

塑料激光诱导击穿光谱技术快速分类应用研究

在大气环境中,采用激光诱导击穿光谱技术与支持向量机算法相结合,对来自不同厂家不同颜色的20种工业塑料进行分类研究。首先对分类结果有影响的实验参数进行优化,在最佳的实验参数条件下进行光谱采集,采用6条非金属元素特征谱线,有效缩短了训练支持向量机分类模型所需时间,从而提高了塑料的分类效率。实验结果表明,利用碳、氢、氧、氮等主量非金属元素对这些工业塑料样品进行分类,测试集1 000个光谱数据中有996个识别正确,算术平均识别精度达到99.6%。在选取较少的主量非金属特征谱线的情况下,结合采用支持向量机算法,可以实现激光诱导击穿光谱技术对更多类型的塑料制品快速、高精度分类,为激光诱导击穿光谱技术在实现塑料分类方面提供了数据参考。     

基于SVM与RF的苹果树冠LAI高光谱估测

叶面积指数(leaf area index,LAI)是反映作物群体大小的较好的动态指标。运用高光谱技术快速、无损地估测苹果树冠叶面积指数,为监测苹果树长势和估产提供参考。以盛果期红富士苹果树为研究对象,采用ASD地物光谱仪和LAI-2200冠层分析仪,在山东省烟台栖霞研究区,连续2年测量了30个果园90棵苹果树冠层光谱反射率及LAI值;通过相关性分析方法构建并筛选出了最优的植被指数;利用支持向量机(support vector machine, SVM)与随机森林(random forests, RF)多元回归分析方法构建了LAI估测模型。新建的GNDVI₅₂₇,NDVI₆₇₆,RVI₆₈₂,FD-NVI₆₅₆和GRVI₅₁₇五个植被指数及前人建立的两个植被指数NDVI₆₇₀和NDVI₇₀₅与LAI的相关性都达到了极显著水平;建立的RF回归模型中,校正集决定系数C-R2和验证集决定系数V-R2为0.920,0.889,分别比SVM回归模型提高了0.045和0.033,校正集均方根误差C-RMSE、验证集均方根误差V-RMSE为0.249,0.236,分别比SVM回归模型降低了0.054和0.058, 校正集相对分析误C-RPD、验证集相对分析误V-RPD达到了3.363和2.520,分别比SVM回归模型提高了0.598和0.262,校正集及验证集的实测值与预测值散点图趋势线的斜率C-S和V-S都接近于1,RF回归模型的估测效果优于SVM。RF多元回归模型适合盛果期红富士苹果树LAI的估测。     

ISG-FHEV等效燃油消耗最小控制策略

针对室内复杂环境下火灾识别准确率会降低的问题,提出了一种改进的粒子群算法优化支持向量机参数进行火灾火焰识别的方法。首先在 颜色空间进行火焰图像分割,对获得的火焰图像进行预处理并提取相关特征量;其次采用PSO算法搜索SVM的最优核参数和惩罚因子,并在PSO算法中加入变异操作和非线性动态调整惯性权值的方法,加快了搜索SVM最优参数的精度和速度;然后将提取的火焰各个特征量作为训练样本输入SVM模型进行训练,并建立参数优化后的SVM分类器模型;最后将待测试样本输入SVM模型进行分类识别。算法的火灾识别准确率达到94.09%,分类效果明显优于其他分类算法。仿真结果表明,改进的PSO优化SVM算法提高了火焰识别的准确率和实时性,算法的自适应性更强,误判率更低。     

Machine learning identification of symmetrized base states of Rydberg atoms

Studying the complex quantum dynamics of interacting many-body systems is one of the most challenging areas in modern physics. Here, we use machine learning (ML) models to identify the symmetrized base states of interacting Rydberg atoms of various atom numbers (up to six) and geometric configurations. To obtain the data set for training the ML classifiers, we generate Rydberg excitation probability profiles that simulate experimental data by utilizing Lindblad equations that incorporate laser intensities and phase noise. Then, we classify the data sets using support vector machines (SVMs) and random forest classifiers (RFCs). With these ML models, we achieve high accuracy of up to 100% for data sets containing only a few hundred samples, especially for the closed atom configurations such as the pentagonal (five atoms) and hexagonal (six atoms) systems. The results demonstrate that computationally cost-effective ML models can be used in the identification of Rydberg atom configurations.     

基于SVM集成学习的网络故障诊断方法

针对现有SVM多分类方法在网络故障诊断中识别精度较低的问题,本文提出一种基于二叉树结构和模型二重扰动的SVM集成学习算法。通过集成学习思想提高网络故障诊断的精度。在集成过程中对二叉树结构和核参数进行扰动,加大个体分类器的差异度,提升了诊断模型的泛化性。在实际网络中的诊断实验表明所提的方法较二叉树等其它SVM多分类方法具有更高的诊断精度。     

基于频谱分析与支持向量机的车型音频识别研究

机动车车型识别是城市道路交通流监测统计的一个重要方面。本文基于频谱分析与支持向量机方法提出一种车型音频识别方法,以1/3倍频程频谱数据作为特征数据,并使用支持向量机方法完成不同车型分类下的车型识别,同时还分析比较了不同训练样本量及不同单个样本数据量大小对识别结果的影响。在将车型细分的情况下,对小汽车、大型公交车、水泥车、摩托车四种车型的样本外识别结果达到96.9%的准确率,验证了方法的有效性。     

融合学习模型的岩石光谱特征自动分类

岩石光谱综合反映了岩石的物理化学性质、成分及其结构构造。岩石光谱数据已被应用于岩石分类的研究,但是不同于矿物光谱,岩石光谱并无标准数据库,且受较多干扰因素影响,例如矿物组分、结构构造、化学成分、风化力度,测量仪器的误差等。传统岩石光谱分类模型先是对岩石光谱进行预处理排除干扰,然后采用不同方法对部分光谱特征分析,以达到分类目的。但对光谱数据特征遗失较多,使得分类准确率低下且操作过程繁琐、效率不高。因此,建立一个简单、快速、准确的岩石光谱自动分类模型具有重要意义。机器学习能够对获得的所有数据进行学习,不存在遗漏,大大提高了分类精度,且是对原始数据直接操作,不需预处理,简化流程。为此,选取辽宁兴城地区作为研究区,采集了若干种典型岩石样本,利用美国ASD便携式光谱仪实测光谱,最终获得608条数据,依据岩石光谱特征分为三类进行研究。首先利用决策树(DT)及决策树的升级模型--随机森林（RF）对数据进行分类,但当数据噪音较大时随机森林容易陷入过拟合;因而利用对异常值不敏感的K-最近邻（KNN）建模,但KNN需要对每个样本都考虑,数据量大时计算量会很大,效率不高;所以通过支持向量机（SVM）来提升分类准确率。从实验结果可以看出,4种分类模型的准确率排序为：SVM>KNN>RF>DT。为进一步提高岩石光谱特征的自动分类精度,采取了融合多个不同模型的办法,即对不同模型的分类结果进行投票,选择投票最多的作为最后分类结果。由于硬投票可在一定程度上减少过拟合现象的发生,更加适合分类模型,所以利用硬投票法融合了RF、KNN与SVM三个机器学习模型,最终的分类准确率可达到99.17%。综上所述,基于融合学习模型进行岩石光谱特征自动分类是切实可行且准确高效的。     

基于多类运动想象任务的EEG信号分类研究

针对多类运动想象脑电信号个体差异性强和分类正确率比较低的问题,提出了一种时-空-频域相结合的脑电信号分析方法：首先利用小波包对EEG原始信号进行分解,根据EEG信号的频域分布提取出运动想象脑电节律,通过“一对多”共空间模式（CSP）算法对不同运动想象任务的脑电节律进行空间滤波提取特征;然后将特征向量输入到“一对多”模式下的支持向量机（SVM）中,并利用判断决策函数值的方法对SVM的输出结果进行融合;最后通过引入时间窗对脑电信号进行时域滤波,消除运动想象开始和结束时脑电的波动,进一步提高信号信噪比和算法的分类效果。实验结果显示：在时间窗为2s时,平均最大 系数达到了0.72,比脑机接口竞赛第一名提高了0.15,验证了该算法能够有效减小脑电信号个体差异性影响,提高多类识别正确率。     

高光谱成像的多种类柑橘病虫药害叶片检测方法研究

影响柑橘生长的病虫药害种类繁多，目前的检测方法大多针对单一病症，开发基于高光谱成像和机器学习的多种类柑橘病虫药害叶片快速精准检测方法，对果园精准施药和柑橘产业健康发展具有重要意义。以果园自然发病的柑橘叶片为研究对象，包括柑橘正常叶（50片）、溃疡病叶（50片）、煤烟病叶（103片）、缺素病叶（60片）、红蜘蛛叶（56片）和除草剂危害叶（85片），采集350～1 050 nm波段内的高光谱数据。分别利用一阶求导（1stDer）、多元散射校正（MSC）和中值滤波（MF）方法对原始（Origin）高光谱数据进行预处理，对预处理后的高光谱数据采用主成分分析（PCA）和竞争性自适应重加权（CARS）算法提取特征波长，CARS降维得到的特征波长分别为10个、5个、12个和10个，4组PCA提取的特征波长均为7个，两种方法所得特征波长范围都集中在700～760 nm波段内。对全波段（FS）使用极限梯度提升树（XGBoost）算法，特征波长使用支持向量机（SVM）建立柑橘病叶多分类模型。采用XGBoost建立的检测识别模型有Origin-FS-XGBoost，1stDer-FS-XGBoost，MSC-FS-XGBoost和MF-FS-XGBoost，对6种病虫害叶片检测得到的整体分类准确率（OA）分别为94.32%，93.60%，95.98%和96.56%；SVM建立的检测识别模型为Origin-CARS-SVM，1stDer-CARS-SVM，MSC-CARS-SVM，MF-CARS-SVM，Origin-PCA-SVM，1stDer-PCA-SVM，MSC-PCA-SVM和MF-PCA-SVM，各模型OA依次为93.63%，90.26%，87.90%，91.95%，87.53%，90.82%，83.50%和90.98%。结果表明，以FS为输入的XGBoost模型识别率整体优于以特征波长为输入的SVM模型，MF-FS-XGBoost模型OA为96.56%，召回率（Recall）为95.91%，模型训练时间（Train-time）为63 s，综合性能最好；CARS-SVM建模效果优于PCA-SVM，在3种预处理方式下，CARS-SVM模型识别率均高于87%，PCA-SVM模型识别率均在83%以上。结果证实了，高光谱成像技术结合机器学习方法可实现多种类柑橘病虫药害分类识别，为柑橘病虫药害快速无损检测和防治提供科学依据。     

Effect of the target positions on the rapid identification of aluminum alloys by using filament-induced breakdown spectroscopy combined with machine learning

Filament-induced breakdown spectroscopy (FIBS) combined with machine learning algorithms was used to identify five aluminum alloys. To study the effect of the distance between focusing lens and target surface on the identification accuracy of aluminum alloys, principal component analysis (PCA) combined with support vector machine (SVM) and K-nearest neighbor (KNN) was used. The intensity and intensity ratio of fifteen lines of six elements (Fe, Si, Mg, Cu, Zn, and Mn) in the FIBS spectrum were selected. The distances between the focusing lens and the target surface in the pre-filament, filament, and post-filament were 958 mm, 976 mm, and 1000 mm, respectively. The source data set was fifteen spectral line intensity ratios, and the cumulative interpretation rates of PC1, PC2, and PC3 were 97.22%, 98.17%, and 95.31%, respectively. The first three PCs obtained by PCA were the input variables of SVM and KNN. The identification accuracy of the different positions of focusing lens and target surface was obtained, and the identification accuracy of SVM and KNN in the filament was 100% and 90%, respectively. The source data set of the filament was obtained by PCA for the first three PCs, which were randomly selected as the training set and test set of SVM and KNN in 3:2. The identification accuracy of SVM and KNN was 97.5% and 92.5%, respectively. The research results can provide a reference for the identification of aluminum alloys by FIBS.     

Injection attack detection using machine learning for smart IoT applications

Smart cities are a rapidly growing IoT application. These smart cities mainly rely on wireless sensors to connect their different components (smart devices) together. Smart cities rely on the integration of IoT and 5G technologies, and this has created a demand for a massive IoT network of connected devices. The data traffic coming from indoor wireless networks (e.g., smart homes, smart hospitals, smart factories , or smart school buildings) contributes to over 80% of the total data traffic of the current IoT network. As smart cities and their applications grow, security and privacy challenges have become a major concern for billions of IoT smart devices. One reason for this could be the oversight of handling security issues of IoT devices by their manufacturers, which enables attackers to exploit the vulnerabilities in these devices by performing different types of attacks, e.g., DDoS and injection attacks. Intrusion detection is one way to detect and mitigate the risk of such attacks. In this paper, an intrusion detection method was proposed to detect injection attacks in IoT applications (e.g. smart cities). In this method, two types of feature selection techniques (constant removal and recursive feature elimination) were used and tested by a number of machine learning classifiers (i.e., SVM, Random Forest, and Decision Tree). The T-Test was conducted to evaluate the quality of this proposed feature selection method. Using the public dataset, AWID, the evaluation results showed that the decision tree classifier can be used to detect injection attacks with an accuracy of 99% using only 8 features, which were selected using the proposed feature selection method. Also, the comparison with the most related work showed the advantages of the proposed intrusion detection method.     

可见光光谱和支持向量机的温室黄瓜霜霉病图像分割

针对温室现场环境下采集的黄瓜霜霉病叶片图像中存在光照不均匀和背景复杂的问题,提出了一种基于可见光光谱和支持向量机的温室黄瓜霜霉病图像分割方法。首先,提出了一种基于可见光谱的颜色特征CVCF(combination of three visible color features)及其检测方法,该颜色特征将超红特征(excess red,ExR)、H分量和b*分量三种颜色特征结合,通过设置ExR参数,降低光照条件对ExR的影响,克服了光照不均匀对病斑分割的影响。在CVCF的基础上,结合基于径向基核函数的支持向量机分类器,通过优化分类器参数构建病斑分割模型,获得了温室黄瓜霜霉病图像初始分割结果。在初始分割结果基础上,采用SURF(speeded up robust features)特征及形态学操作,对分割结果进一步优化,消除背景噪声对分割结果的影响,从而获得最终病斑分割结果。为进一步验证方法的有效性,选择了OTSU算法、K均值聚类算法和决策树算法,作对比研究。结果表明,OTSU+H*0.2,K-means+H+b*,DT+H+b*和该研究算法的错分率分别为：19.44%,40.19%,16.27%和7.37%,该算法对温室现场环境下采集的黄瓜霜霉病图像的分割效果明显优于其他对比方法。该方法能够充分克服光照不均匀和复杂背景的影响准确地提取病斑,为病害识别提供了良好的数据来源。