一种基于2D-CNN的激光超声表面缺陷检测方法

激光超声表面缺陷检测的过程中,缺陷的定量表征通常依赖于操作者的判断,易受到人为因素干扰,致使检测结果不稳定。针对这一问题,提出一种基于图像识别的二维卷积神经网络（2D-CNN）的缺陷自动分类检测方法。利用有限元方法模拟激光超声检测过程,并采集超声信号数据用于训练分类模型;使用连续小变换（CWT）处理超声信号得到小波时频图,以小波时频图作为输入训练卷积神经网络（CNN）分类模型,实现对表面缺陷深度的自动分类。验证结果表明:提出的检测方法能够对不同深度的缺陷准确分类,测试的平均准确率达到97.3%;构建的CNN分类模型能够自主学习输入图像的缺陷特征并完成分类,提高了检测结果稳定性,为激光超声缺陷检测的自动化分析处理提供了新的思路。     

基于深度学习的无波前探测自适应光学系统研究进展

近年来自适应光学（AO）系统向着小型化和低成本化趋势发展,无波前探测自适应光学（WFSless AO）系统由于结构简单、应用范围广,成为目前相关领域的研究热点。硬件环境确定后,系统控制算法决定了WFSless AO系统的校正效果和系统收敛速度。新兴的深度学习及人工神经网络为WFSless AO系统控制算法注入了新的活力,进一步推动了WFSless AO系统的理论发展与应用发展。在回顾前期WFSless AO系统控制算法的基础上,全面介绍了近年来卷积神经网络（CNN）、长短期记忆神经网络（LSTM）、深度强化学习在WFSless AO系统控制中的应用,并对WFSless AO系统中各种深度学习模型的特点进行了总结。概述了WFSless AO技术在天文观测、显微成像、眼底成像、激光通信等领域的应用。     

基于深度神经网络的太阳能电池组件缺陷检测算法研究

针对太阳能电池组件中电池片出现隐裂导致整片电池破碎,最终影响整个组件发电量的问题，在对电池组件光致发光（PL）图像待检测区域筛选定位的基础上，提出了一种利用卷积神经网络（CNN）进行电池组件隐裂缺陷检测的方法。首先利用PL成像方法获取电池组件图像，然后对图像进行预处理，基于聚类的方法对待检测目标区域进行筛选定位，最后利用3种不同结构的卷积神经网络模型对电池片进行缺陷检测，并进行准确率对比，使最优识别准确率达到99.25%。实验结果验证了该方法能准确地检测出太阳能电池组件的隐裂缺陷。     

利用深度神经网络和小波包变换进行缺陷类型分析

超声检测中对缺陷进行类型分析通常取决于操作人员对于特定专业知识的了解及检测经验,从而导致其分析结果的不稳定性和个体差异性。本文提出了一种使用小波包变换提取缺陷特征信息,并应用深度神经网络对得到的信息进行分类识别的方法。利用超声相控阵系统对于不锈钢试块上的通孔、斜通孔和平底孔进行超声检测,并对得到的超声回波波形按照新方法进行分析。实验结果表明,使用小波包变换后的数据进行分类识别能够在提高识别准确率的同时降低神经网络的学习时间,而使用深度神经网络相比通用的BP神经网络以可接受延长学习时间的代价提高了识别的准确率。采用新方法后,缺陷分类正确率提高了21.66%,而网络学习时间只延长了91.9s。在超声检测中使用小波包变换和深度神经网络来对于缺陷进行类型分析,能够排除人为干扰,增加识别准确率,对于实际应用有着极大的意义。      

极紫外光刻掩模相位型缺陷检测方法

提出了一种基于空间像的极紫外光刻掩模相位型缺陷检测方法,用于检测多层膜相位型缺陷的类型、位置和表面形貌。缺陷的类型、位置和表面形貌均会影响含缺陷掩模的空间像的分布。因此,采用深度学习模型构建含缺陷掩模的空间像与待测缺陷信息之间的映射,利用训练后的模型可从含缺陷掩模的空间像中获取待测缺陷信息。采用卷积神经网络（CNN）模型构建含缺陷空白掩模的空间像和缺陷类型与位置之间的关系,建立用于缺陷类型和位置检测的CNN模型。在获取缺陷的类型与位置后,基于测得的缺陷位置对空间像进行截取,利用截取后的空间像的频谱信息和多层感知机模型获取缺陷表面形貌参数。仿真结果表明,所提方法可对多层膜相位型缺陷的类型、位置和表面形貌参数进行准确检测。     

基于深度学习的多模光纤通信系统的模式与模群识别

基于模式/模群复用的多模光纤通信系统是目前光通信领域的研究热点.系统中存在多个模式/模群,如何准确识别它们是提升传输系统性能的关键问题之一.提出了一种基于深度学习的多模光纤模式与模群的智能识别模型,通过引入全卷积神经网络(CNN),对噪声影响情况下线偏振模式及其模群进行仿真和实验研究.首先,基于多平面光转换模式复用器件...     

卷积神经网络的缺陷类型识别分析

该文提出一种基于卷积神经网络直接对阵列超声检测原始信号进行缺陷类型识别的方法,该方法无需对超声回波原始信号进行特征提取.文章研究对比了不同卷积神经网络及其优化的识别性能.首先采用超声相控阵系统对不同试块上的平底孔、球底孔、通孔三种缺陷进行超声检测,然后利用LeNet5、VGG16和ResNet三种卷积神经网络对一维和二...     

深度学习在高能物理领域中的应用

深度学习是一类通过多层信息抽象来学习复杂数据内在表示关系的机器学习算法。近年来,深度学习算法在物体识别和定位、语音识别等人工智能领域,取得了飞跃性进展。文章将首先介绍深度学习算法的基本原理及其在高能物理计算中应用的主要动机。然后结合实例综述卷积神经网络、递归神经网络和对抗生成网络等深度学习算法模型的应用。最后,文章将介绍深度学习与现有高能物理计算环境结合的现状、问题及一些思考。     

基于声发射和GAN-CNN的铝合金管道法兰 连接松动泄漏检测*

面向管道法兰连接松动引起的泄漏检测需求,为解决数据样本不足和减少特征指标手动选取的繁琐环节。本文,考虑到生成性对抗网络（GAN）作为数据扩充工具,已被证明能够生成与真实数据相似的样本数据。同时,卷积神经网络（CNN）作为一种深度学习方法,为自动提取数据的特征提供了一种有效的方法。开展了基于GAN和CNN的铝合金管道法兰连接松动泄漏检测研究。首先,搭建管道泄漏标定和数据采集实验台,利用声发射技术获取不同等级的原始泄漏信号。其次,采用GAN生成样本数据扩充原始数据。同时,为了评估生成模型的性能,引入统计特评估生成质量。最后,将生成的样本数据与原始数据设置为不同训练集,基于卷积神经网络构建智能分类检测模型,应用于管道泄漏检测。同时,分类检测结果与小样本智能分类方法SVM进行了比较,实验结果表明,基于GAN和CNN构建的智能分类模型可显著提高管道法兰连接松动泄漏检测精度。     

基于GADF变换和多尺度CNN的哈密瓜表面农药残留可见-近红外光谱判别方法

针对哈密瓜表面农药残留化学检测方法成本高且具有破坏性等问题,探索了可见-近红外（Vis-NIR）光谱技术对农药残留定性判别的可行性。以哈密瓜为载体,百菌清和吡虫啉农药为研究对象,采集哈密瓜表面无残留、百菌清和吡虫啉残留的可见-近红外漫反射光谱,利用格拉姆角场（GAF）将一维光谱数据转换为二维彩色图像,构建GAF图像数据集。设计一种包含Inception结构的多尺度卷积神经网络模型用于哈密瓜表面农药残留种类判别,包括1层输入层、3层卷积层、1层融合层、1层平坦层、2层全连接层和1层输出层。模型测试混淆矩阵结果表明,格拉姆角差场（GADF）变换对哈密瓜表面农药残留的可见-近红外光谱表达能力较强。此外,构建AlexNet、VGG-16卷积神经网络（CNN）模型和支持向量机（SVM）、极限学习机（ELM）机器学习模型与提出的多尺度CNN模型进行性能对比。结果表明,3种CNN模型对哈密瓜表面有无农药残留的判别效果较好,综合判别准确率均高于SVM和ELM模型。对比3种CNN模型性能,多尺度CNN模型的性能最佳,训练耗时为14 s,综合判别准确率为98.33%。多尺度CNN模型结构利用多种小尺寸滤波器组合（1×1,3×3和5×5）和并行卷积模块,能够捕获不同层次和尺度的特征,通过级联融合模式进行深度特征融合,提高了模型的特征提取能力。与传统深度CNN模型相比,在保证计算复杂度不变的情况下,多尺度CNN模型的精度得到了有效提高。实验结果表明,GADF变换结合多尺度CNN模型可以有效进行光谱数据解析,利用可见-近红外光谱技术可以实现哈密瓜表面农药残留的定性判别。研究结果为大型瓜果表面农药残留的快速无损检测技术的研发提供了理论参考。     

Recognizing pedestrian’s unsafe behaviors in far-infrared imagery at night

Pedestrian behavior recognition is important work for early accident prevention in advanced driver assistance system (ADAS). In particular, because most pedestrian-vehicle crashes are occurred from late of night to early of dawn, our study focus on recognizing unsafe behavior of pedestrians using thermal image captured from moving vehicle at night. For recognizing unsafe behavior, this study uses convolutional neural network (CNN) which shows high quality of recognition performance. However, because traditional CNN requires the very expensive training time and memory, we design the light CNN consisted of two convolutional layers and two subsampling layers for real-time processing of vehicle applications. In addition, we combine light CNN with boosted random forest (Boosted RF) classifier so that the output of CNN is not fully connected with the classifier but randomly connected with Boosted random forest. We named this CNN as randomly connected CNN (RC-CNN). The proposed method was successfully applied to the pedestrian unsafe behavior (PUB) dataset captured from far-infrared camera at night and its behavior recognition accuracy is confirmed to be higher than that of some algorithms related to CNNs, with a shorter processing time.     

Sensor and Actuator Fault Diagnosis for Robot Joint Based on Deep CNN

This paper proposes a data-driven method-based fault diagnosis method using the deep convolutional neural network (DCNN). The DCNN is used to deal with sensor and actuator faults of robot joints, such as gain error, offset error, and malfunction for both sensors and actuators, and different fault types are diagnosed using the trained neural network. In order to achieve the above goal, the fused data of sensors and actuators are used, where both types of fault are described in one formulation. Then, the deep convolutional neural network is applied to learn characteristic features from the merged data to try to find discriminative information for each kind of fault. After that, the fully connected layer does prediction work based on learned features. In order to verify the effectiveness of the proposed deep convolutional neural network model, different fault diagnosis methods including support vector machine (SVM), artificial neural network (ANN), conventional neural network (CNN) using the LeNet-5 method, and long-term memory network (LTMN) are investigated and compared with DCNN method. The results show that the DCNN fault diagnosis method can realize high fault recognition accuracy while needing less model training time.     

Diabetic Retinal Grading Using Attention-Based Bilinear Convolutional Neural Network and Complement Cross Entropy

Diabetic retinopathy (DR) is a common complication of diabetes mellitus (DM), and it is necessary to diagnose DR in the early stages of treatment. With the rapid development of convolutional neural networks in the field of image processing, deep learning methods have achieved great success in the field of medical image processing. Various medical lesion detection systems have been proposed to detect fundus lesions. At present, in the image classification process of diabetic retinopathy, the fine-grained properties of the diseased image are ignored and most of the retinopathy image data sets have serious uneven distribution problems, which limits the ability of the network to predict the classification of lesions to a large extent. We propose a new non-homologous bilinear pooling convolutional neural network model and combine it with the attention mechanism to further improve the network’s ability to extract specific features of the image. The experimental results show that, compared with the most popular fundus image classification models, the network model we proposed can greatly improve the prediction accuracy of the network while maintaining computational efficiency.     

基于MRI和深度学习的桥小脑角区脑膜瘤与听神经瘤分类算法研究

桥小脑角区脑膜瘤与听神经瘤是两种常见的脑部肿瘤，它们的临床表现和影像学表现极为相似，在临床诊断时极易发生误诊．将影像数据与深度学习方法相结合，建立脑膜瘤与听神经瘤的判别模型，可以为两种脑肿瘤的及时准确诊断提供重要手段．本文采集了307名脑肿瘤患者的T₁W-SE序列图像，通过对原始图像进行限制对比度自适应直方图均衡化（Contrast Limited Adaptive Histogram Equalization，CLAHE）等预处理，提升数据集图像质量，再经过建立的三维卷积神经网络（3-Dimensional Convolutional Neural Network，3D CNN）深度学习框架中图像特征的学习，实现对脑膜瘤与听神经瘤的分类．图像增强参数与网络结构参数经过优化后，对脑膜瘤与听神经瘤分类的准确率达到0.918 0，曲线下面积（Area Under Curve，AUC）为0.913 4，实现了对桥小脑角区脑膜瘤与听神经瘤的有效判别．     

A New Pooling Approach Based on Zeckendorf’s Theorem for Texture Transfer Information

The pooling layer is at the heart of every convolutional neural network (CNN) contributing to the invariance of data variation. This paper proposes a pooling method based on Zeckendorf’s number series. The maximum pooling layers are replaced with Z pooling layer, which capture texels from input images, convolution layers, etc. It is shown that Z pooling properties are better adapted to segmentation tasks than other pooling functions. The method was evaluated on a traditional image segmentation task and on a dense labeling task carried out with a series of deep learning architectures in which the usual maximum pooling layers were altered to use the proposed pooling mechanism. Not only does it arbitrarily increase the receptive field in a parameterless fashion but it can better tolerate rotations since the pooling layers are independent of the geometric arrangement or sizes of the image regions. Different combinations of pooling operations produce images capable of emphasizing low/high frequencies, extract ultrametric contours, etc.     

Learnable three-dimensional Gabor convolutional network with global affinity attention for hyperspectral image classification

Benefiting from the development of hyperspectral imaging technology, hyperspectral image (HSI) classification has become a valuable direction in remote sensing image processing. Recently, researchers have found a connection between convolutional neural networks (CNNs) and Gabor filters. Therefore, some Gabor-based CNN methods have been proposed for HSI classification. However, most Gabor-based CNN methods still manually generate Gabor filters whose parameters are empirically set and remain unchanged during the CNN learning process. Moreover, these methods require patch cubes as network inputs. Such patch cubes may contain interference pixels, which will negatively affect the classification results. To address these problems, in this paper, we propose a learnable three-dimensional (3D) Gabor convolutional network with global affinity attention for HSI classification. More precisely, the learnable 3D Gabor convolution kernel is constructed by the 3D Gabor filter, which can be learned and updated during the training process. Furthermore, spatial and spectral global affinity attention modules are introduced to capture more discriminative features between spatial locations and spectral bands in the patch cube, thus alleviating the interfering pixels problem. Experimental results on three well-known HSI datasets (including two natural crop scenarios and one urban scenario) have demonstrated that the proposed network can achieve powerful classification performance and outperforms widely used machine-learning-based and deep-learning-based methods.     

Deep Learning Methods for Heart Sounds Classification: A Systematic Review

The automated classification of heart sounds plays a significant role in the diagnosis of cardiovascular diseases (CVDs). With the recent introduction of medical big data and artificial intelligence technology, there has been an increased focus on the development of deep learning approaches for heart sound classification. However, despite significant achievements in this field, there are still limitations due to insufficient data, inefficient training, and the unavailability of effective models. With the aim of improving the accuracy of heart sounds classification, an in-depth systematic review and an analysis of existing deep learning methods were performed in the present study, with an emphasis on the convolutional neural network (CNN) and recurrent neural network (RNN) methods developed over the last five years. This paper also discusses the challenges and expected future trends in the application of deep learning to heart sounds classification with the objective of providing an essential reference for further study.     

基于密集连接结构的超分辨精简网络

近年来, 随着深度神经网络的发展并被应用在超分辨领域, 图像超分辨率重建的效果得到了明显的提升。但是之前的工作大都把精力放在如何设计深度模型来提高重建的效果上, 而忽视了设计模型需要大量参数与计算量这一问题, 严重制约了深度学习方法在图像超分辨率重建方面的实际应用范围。针对该问题, 基于密集连接结构设计了一种新的网络。在以下3个方面进行了算法改进:1)提出了一种基于密集连接结构的新模型; 2)加入1×1卷积层作为特征选择层, 同时进一步减少计算量; 3)探讨了通道数量与重建精度、计算量之间的关系。实验结果表明本文提出的模型取得了与其他卷积神经网络模型相近的复原精度, 同时计算速度只有之前最快深度模型FSRCNN的一半以下。     

Deep learning and expert knowledge based underwater acoustic OFDM receiver

In this paper, a deep learning and expert knowledge based receiver is proposed for underwater acoustic (UWA) orthogonal frequency division multiplexing (OFDM). Different from the existing deep learning based UWA OFDM receivers, the proposed receiver combines deep learning with the classical expert knowledge of block-based signal processing in UWA OFDM to improve system performance and interpretability. It performs joint channel estimation and signal detection by designing skip connection (SC) convolutional neural network (CNN) cascaded attention mechanism (AM) enhanced bi-directional long short-term memory (BiLSTM) network, abbreviated as SC-CNN-AM-BiLSTM network (SCABNet). Specifically, the channel estimation subnet is designed with SC-CNN to utilize the thought of image super-resolution to reconstruct the entire channel frequency response of all subcarriers. The signal detection subnet is designed with AM-BiLSTM to extract the correlations of received sequential data for signal detection. Especially with the AM, the signal detection subnet can focus more on effective information of the received distorted signal to train the optimal network weights to improve the accuracy of data recovery. The proposed SCABNet is evaluated by experimental data, and the results have demonstrated that the SCABNet has the lowest BER and robust performance compared to the traditional linear algorithm, deep learning based black-box receiver, and ComNet receiver. And the proposed SCABNet is effective and robust when multiple nonideal factors co-exist.