Deep learning and expert knowledge based underwater acoustic OFDM receiver

In this paper, a deep learning and expert knowledge based receiver is proposed for underwater acoustic (UWA) orthogonal frequency division multiplexing (OFDM). Different from the existing deep learning based UWA OFDM receivers, the proposed receiver combines deep learning with the classical expert knowledge of block-based signal processing in UWA OFDM to improve system performance and interpretability. It performs joint channel estimation and signal detection by designing skip connection (SC) convolutional neural network (CNN) cascaded attention mechanism (AM) enhanced bi-directional long short-term memory (BiLSTM) network, abbreviated as SC-CNN-AM-BiLSTM network (SCABNet). Specifically, the channel estimation subnet is designed with SC-CNN to utilize the thought of image super-resolution to reconstruct the entire channel frequency response of all subcarriers. The signal detection subnet is designed with AM-BiLSTM to extract the correlations of received sequential data for signal detection. Especially with the AM, the signal detection subnet can focus more on effective information of the received distorted signal to train the optimal network weights to improve the accuracy of data recovery. The proposed SCABNet is evaluated by experimental data, and the results have demonstrated that the SCABNet has the lowest BER and robust performance compared to the traditional linear algorithm, deep learning based black-box receiver, and ComNet receiver. And the proposed SCABNet is effective and robust when multiple nonideal factors co-exist.     

Novel Convolutional Neural Network with Variational Information Bottleneck for P300 Detection

In the area of brain-computer interfaces (BCI), the detection of P300 is a very important technique and has a lot of applications. Although this problem has been studied for decades, it is still a tough problem in electroencephalography (EEG) signal processing owing to its high dimension features and low signal-to-noise ratio (SNR). Recently, neural networks, like conventional neural networks (CNN), has shown excellent performance on many applications. However, standard convolutional neural networks suffer from performance degradation on dealing with noisy data or data with too many redundant information. In this paper, we proposed a novel convolutional neural network with variational information bottleneck for P300 detection. Wiht the CNN architecture and information bottleneck, the proposed network termed P300-VIB-Net could remove the redundant information in data effectively. The experimental results on BCI competition data sets show that P300-VIB-Net achieves cutting-edge character recognition performance. Furthermore, the proposed model is capable of restricting the flow of irrelevant information adaptively in the network from perspective of information theory. The experimental results show that P300-VIB-Net is a promising tool for P300 detection.     

混沌神经网络的动态阈值控制

提出了混沌神经网络的动态阈值控制方法, 将大脑脑电波的主要成分, 正弦信号作为控制变量实现对混沌神经网络内部状态的阈值动态改变, 从而达到了控制混沌神经网络混沌的目的. 利用该方法可以将混沌神经网络的输出稳定在一个与网络初始模式相关的存储模式和其反相模式上, 从而使混沌神经网络在模式识别、信息搜索等信息处理功能得以实现. 该控制方法不需要事先指定阈值, 是一种自适应方法, 符合实际人脑的思维运动. 关键词： 混沌控制 混沌神经网络 动态阈值控制 信息处理     

一种基于2D-CNN的激光超声表面缺陷检测方法

激光超声表面缺陷检测的过程中,缺陷的定量表征通常依赖于操作者的判断,易受到人为因素干扰,致使检测结果不稳定。针对这一问题,提出一种基于图像识别的二维卷积神经网络（2D-CNN）的缺陷自动分类检测方法。利用有限元方法模拟激光超声检测过程,并采集超声信号数据用于训练分类模型;使用连续小变换（CWT）处理超声信号得到小波时频图,以小波时频图作为输入训练卷积神经网络（CNN）分类模型,实现对表面缺陷深度的自动分类。验证结果表明:提出的检测方法能够对不同深度的缺陷准确分类,测试的平均准确率达到97.3%;构建的CNN分类模型能够自主学习输入图像的缺陷特征并完成分类,提高了检测结果稳定性,为激光超声缺陷检测的自动化分析处理提供了新的思路。     

深度学习在超声检测缺陷识别中的应用与发展*

深度学习（Deep Learning）是目前最强大的机器学习算法之一,其中卷积神经网络（Convolutional Neural Network, CNN）模型具有自动学习特征的能力,在图像处理领域较其他深度学习模型有较大的性能优势。本文先简述了深度学习的发展史,然后综述了深度学习在超声检测缺陷识别中的应用与发展,从早期浅层神经网络到现在深度学习的应用现状,并借鉴医学影像识别和射线图像识别领域的方法,分析了卷积神经网络对超声图像缺陷识别的适用性。最后,探讨归纳了目前在超声检测图像识别中使用CNN存在的一些问题,及其主要应对策略的研究方向。     

GIS Partial Discharge Pattern Recognition Based on a Novel Convolutional Neural Networks and Long Short-Term Memory

Distinguishing the types of partial discharge (PD) caused by different insulation defects in gas-insulated switchgear (GIS) is a great challenge in the power industry, and improving the recognition accuracy of the relevant models is one of the key problems. In this paper, a convolutional neural network and long short-term memory (CNN-LSTM) model is proposed, which can effectively extract and utilize the spatiotemporal characteristics of PD input signals. First, the spatial characteristics of higher-level PD signals can be obtained through the CNN network, but because CNN is a deep feedforward neural network, it does not have the ability to process time-series data. The PD voltage signal is related to the time dimension, so LSTM saves and analyzes the previous voltage signal information, realizes the modeling of the time dependence of the data, and improves the accuracy of the PD signal pattern recognition. Finally, the pattern recognition results based on CNN-LSTM are given and compared with those based on other traditional analysis methods. The results show that the pattern recognition rate of this method is the highest, with an average of 97.9%, and its overall accuracy is better than that of other traditional analysis methods. The CNN-LSTM model provides a reliable reference for GIS PD diagnosis.     

Sensor and Actuator Fault Diagnosis for Robot Joint Based on Deep CNN

This paper proposes a data-driven method-based fault diagnosis method using the deep convolutional neural network (DCNN). The DCNN is used to deal with sensor and actuator faults of robot joints, such as gain error, offset error, and malfunction for both sensors and actuators, and different fault types are diagnosed using the trained neural network. In order to achieve the above goal, the fused data of sensors and actuators are used, where both types of fault are described in one formulation. Then, the deep convolutional neural network is applied to learn characteristic features from the merged data to try to find discriminative information for each kind of fault. After that, the fully connected layer does prediction work based on learned features. In order to verify the effectiveness of the proposed deep convolutional neural network model, different fault diagnosis methods including support vector machine (SVM), artificial neural network (ANN), conventional neural network (CNN) using the LeNet-5 method, and long-term memory network (LTMN) are investigated and compared with DCNN method. The results show that the DCNN fault diagnosis method can realize high fault recognition accuracy while needing less model training time.     

Recognizing pedestrian’s unsafe behaviors in far-infrared imagery at night

Pedestrian behavior recognition is important work for early accident prevention in advanced driver assistance system (ADAS). In particular, because most pedestrian-vehicle crashes are occurred from late of night to early of dawn, our study focus on recognizing unsafe behavior of pedestrians using thermal image captured from moving vehicle at night. For recognizing unsafe behavior, this study uses convolutional neural network (CNN) which shows high quality of recognition performance. However, because traditional CNN requires the very expensive training time and memory, we design the light CNN consisted of two convolutional layers and two subsampling layers for real-time processing of vehicle applications. In addition, we combine light CNN with boosted random forest (Boosted RF) classifier so that the output of CNN is not fully connected with the classifier but randomly connected with Boosted random forest. We named this CNN as randomly connected CNN (RC-CNN). The proposed method was successfully applied to the pedestrian unsafe behavior (PUB) dataset captured from far-infrared camera at night and its behavior recognition accuracy is confirmed to be higher than that of some algorithms related to CNNs, with a shorter processing time.     

卷积神经网络用于近红外光谱预测土壤含水率

近红外光谱分析技术在土壤含水率预测方面具有独特的优势,是一种便捷且有效的方法。卷积神经网络作为高性能的深度学习模型,能够从复杂光谱数据中自主提取有效特征结构进行学习,与传统的浅层学习模型相比具有更强的模型表达能力。将卷积神经网络用于近红外光谱预测土壤含水率,并提出了有效的卷积神经网络光谱回归建模方法,简化了光谱数据的预处理要求,且具有更高的光谱预测精度。首先对不同含水率下土壤样品的光谱反射率数据进行简单的预处理,通过主成分分析减少光谱数据量,并将处理后的光谱数据变换为二维光谱信息矩阵,以适应卷积神经网络特殊的学习结构。然后基于卷积神经网络算法,设置双层卷积和池化结构逐层提取光谱数据的内部特征信息,并采用局部连接和权值共享减少网络参数、提高泛化性能。通过试验优化网络结构和各项参数,最终获得针对土壤光谱数据的卷积神经网络土壤含水率预测模型,并与传统的BP,PLSR和LSSVM模型进行对比实验。结果表明在训练样本达到一定数量时,卷积神经网络的预测精度和回归拟合度均高于三种传统模型。在少量训练样本参与建模的情况下,模型预测表现高于BP神经网络,但略低于PLSR和LSSVM模型。随着参与训练样本量的增加,卷积神经网络的预测精度和回归拟合度也随之稳定提升,达到并显著优于传统模型水平。因此,卷积神经网络能够利用近红外光谱数据对土壤含水率做出有效预测,且在较多样本参与建模时取得更好效果。     

基于可见/近红外光谱和深度学习的早期鸭胚雌雄信息无损检测

胚蛋雌雄识别一直是家禽业发展的瓶颈问题,在禽肉生产过程中倾向于养殖雄性个体,而禽蛋生产产业倾向于养殖雌性家禽。若能在孵化过程中较早鉴别出种蛋的雌雄,不仅能够降低家禽孵化产业的成本,还能够提高禽蛋和禽肉生产行业的经济效益。该文以种鸭蛋为研究对象,为了在种鸭蛋孵化早期实现对种蛋的雌雄识别,构建了可见/近红外透射光谱信息采集系统,在200～1 100 nm的波长范围内采集了345枚孵化了0~8 d的种鸭蛋光谱数据。搭建了适用于种鸭蛋光谱信息的6层卷积神经网络（convolutional neural network, CNN）,其中包括输入层、3个卷积层、全连接层与输出分类层。卷积层可以提取光谱中的有效信息,全连接层通过对卷积层提取的局部特征进行整合供输出层分类决策。另外在卷积神经网络中引入局部响应归一化和dropout操作能够加快网络的收敛速度。利用该卷积神经网络构建鸭胚雌雄信息识别网络,通过对比与分析不同孵化天数的识别效果,发现孵化7d的识别效果最佳。随后将孵化7 d的种鸭蛋原始光谱数据进行噪声去除,选取500~900 nm波段用于后续的特征波长选取和建模。分别运用了竞争性自适应重加权算法(CARS)、连续投影算法( SPA)与遗传算法(GA)选择能够区分鸭胚性别的波长点,将选取的特征波长转换为二维的光谱信息矩阵,二维光谱信息矩阵保留了一维光谱的有效信息,同时极大地方便了与卷积神经网络的结合。利用二维光谱信息矩阵和卷积神经网络相结合,实现孵化早期阶段鸭胚的雌雄识别。经检验,基于 SPA算法和CNN网络建立的模型效果较佳,其中训练集、开发集及测试集的准确率分别为93.36%,93.12%和93.83%;基于GA算法和CNN网络建立的模型效果次之,训练集、开发集及测试集的准确率分别为90.87%,93.12%和86.42%;基于CARS算法和CNN网络建立的模型的训练集、开发集及测试集的准确率分别为84.65%,83.75%和77.78%。研究结果表明基于可见/近红外光谱技术和卷积神经网络可以实现孵化早期鸭胚胎雌雄的无损鉴别,为后续相关自动化检测装置的研发提供了技术支撑。     

卷积神经网络主动目标方位估计

复杂海洋环境中信道的传输特性、时空变化、频散效应等一定程度上制约了主动声呐目标方位估计的性能。该文引入卷积神经网络(CNN),提出了适用于主动声呐中目标方位的高精度估计方法。仿真声场环境为浅海负梯度,主动发射信号为具有多普勒不变性质的双曲调频信号,水平线列阵作为接收装置,目标按仿真路线运动。该文利用Kraken进行声场数据仿真,并对接收的信号在频域做均匀加权常规波束形成,进而进行卷积神经网络的模型训练和测试。数值仿真研究表明,该文所用方法可以有效估计目标波达方向,对信噪比具有一定的鲁棒性。     

The Multi-Focus-Image-Fusion Method Based on Convolutional Neural Network and Sparse Representation

Multi-focus-image-fusion is a crucial embranchment of image processing. Many methods have been developed from different perspectives to solve this problem. Among them, the sparse representation (SR)-based and convolutional neural network (CNN)-based fusion methods have been widely used. Fusing the source image patches, the SR-based model is essentially a local method with a nonlinear fusion rule. On the other hand, the direct mapping between the source images follows the decision map which is learned via CNN. The fusion is a global one with a linear fusion rule. Combining the advantages of the above two methods, a novel fusion method that applies CNN to assist SR is proposed for the purpose of gaining a fused image with more precise and abundant information. In the proposed method, source image patches were fused based on SR and the new weight obtained by CNN. Experimental results demonstrate that the proposed method clearly outperforms existing state-of-the-art methods in addition to SR and CNN in terms of both visual perception and objective evaluation metrics, and the computational complexity is greatly reduced. Experimental results demonstrate that the proposed method not only clearly outperforms the SR and CNN methods in terms of visual perception and objective evaluation indicators, but is also significantly better than other state-of-the-art methods since our computational complexity is greatly reduced.     

Design for CNN Templates with Performance of Global Connectivity Detection

The cellular neural/nonlinear network (CNN) is a powerful tool for image and video signal processing, robotic and biological visions. This paper discusses a general method for designing template of the global connectivity detection (GCD) CNN, which provides parameter inequalities for determining parameter intervals for implementing the corresponding functions. The GCD CNN has stronger ability and faster rate for determining global connectivity in binary patterns than the GCD CNN proposed by Zarandy. An example for detecting the connectivity in complex patterns is given.     

A one-dimension convolutional neural network based interference classification method

Interference is a common problem in wireless communication, navigation and radar systems. A wide variety of interferences are used to degrade the communication quality especially in electronic warfare environment. In modern military communication systems, interference classification is an important module for its ability to obtain prior interference information before adopting related anti-interference method. This paper proposes a deep learning based interference classification method, which applies one-dimension convolutional neural networks to automatically extract interference features for classification. Computer simulations show better classification performance and lower computational complexity. Meanwhile, this proposed method is implied on software defined radios (SDR) hardware, more than 99% correct classification probability can be achieved with limited samples of the received signal, which verifies the robustness of this proposed method.     

Binary neutron stars gravitational wave detection based on wavelet packet analysis and convolutional neural networks

This work investigates the detection of binary neutron stars gravitational wave based on convolutional neural network(CNN).To promote the detection performance and efficiency,we proposed a scheme based on wavelet packet(WP)decomposition and CNN.The WP decomposition is a time-frequency method and can enhance the discriminant features between gravitational wave signal and noise before detection.The CNN conducts the gravitational wave detection by learning a function mapping relation from the data under being processed to the space of detection results.This function-mapping-relation style detection scheme can detection efficiency significantly.In this work,instrument effects are con-sidered,and the noise are computed from a power spectral density(PSD)equivalent to the Advanced LIGO design sensitivity.The quantitative evaluations and comparisons with the state-of-art method matched filtering show the excellent performances for BNS gravitational wave detection.On efficiency,the current experiments show that this WP-CNN-based scheme is more than 960 times faster than the matched filtering.     

卷积神经网络在气体泄漏超声识别中的应用

为了克服现有气体泄漏检测方法的不足,提出一种基于卷积神经网络的气体泄漏超声信号识别方法。在设计卷积神经网络网络结构时,通过多次预训练确定网络层数、卷积核数目和尺寸、全连接层神经元数目。同时,选择Inception模块平衡网络宽度和深度,防止过拟合的同时提高网络对尺度的适应性。通过输气管道泄漏实验平台模拟工况中常见的阀门泄漏和垫片泄漏,利用短时傅里叶变换进行时频图表征,在此基础上,建立二分类模型和不同泄漏类型的三分类模型。结果表明,相比二分类模型,不同泄漏类型的三分类模型识别准确率有所降低,添加Inception模块可以有效提高三分类模型的性能。     

基于改进卷积神经网络算法的语音识别

为了解决传统卷积神经网络识别连续语音数据时识别性能较差的问题,提出一种改进的卷积神经网络算法。该方法引入Fisher准则以及L2正则化约束,在反向传播调整参数阶段,既保证参数误差的最小化,又确保分类以后的样本类间分布较分散,类内分布较集中,同时保证网络权值具有合适的数量级以有效缓解过拟合问题;采用一种更符合生物神经元激活特性的新型log激活函数进行卷积神经网络的优化,进一步提高语音识别的正确率。在语音识别库TIMIT以及THCHS30上的实验结果表明,相较于传统卷积神经网络算法,本文提出的改进算法能较好的提高语音识别率,且泛化能力更强。     

CNN-based demodulation for a complex amplitude modulation code in holographic data storage

Optical Review - We developed a modulation code using a complex amplitude and established a method to demodulate the code based on a convolutional neural network (CNN) for holographic data storage....     

基于深度神经网络的太阳能电池组件缺陷检测算法研究

针对太阳能电池组件中电池片出现隐裂导致整片电池破碎,最终影响整个组件发电量的问题，在对电池组件光致发光（PL）图像待检测区域筛选定位的基础上，提出了一种利用卷积神经网络（CNN）进行电池组件隐裂缺陷检测的方法。首先利用PL成像方法获取电池组件图像，然后对图像进行预处理，基于聚类的方法对待检测目标区域进行筛选定位，最后利用3种不同结构的卷积神经网络模型对电池片进行缺陷检测，并进行准确率对比，使最优识别准确率达到99.25%。实验结果验证了该方法能准确地检测出太阳能电池组件的隐裂缺陷。     

基于多输出的 3D 卷积神经网络诊断阿尔兹海默病

随着人口老龄化的加深，阿尔兹海默疾病更加大众化地出现在我们生活中，而早期精准诊断阿尔兹海默疾病并进行正向干预可有效延缓阿尔兹海默疾病的进程．基于磁共振图像的阿尔兹海默疾病的精准诊断需要综合利用多个感兴趣区域（ROIs）的信息，而单个ROI无法体现不同ROIs之间存在的联系与影响．本文首先提出三输入3D卷积神经网络（CNN），综合利用大脑3D磁共振图像中海马体、灰质（无海马体）和白质3个ROIs的信息．此外，随着神经网络的加深，原始图像的重要特征信息会部分丢失，因此我们又提出一种多输出3D CNN，通过增加中间层的连接和输出，缩短输入和输出之间的距离，增强特征传播，减少特征信息的丢失．结果显示采用多输出3DCNN模型实现整个测试集三分类的准确率为90.5%、精确率为91.0%、灵敏度为90.4%、特异性为95.2%、F1-score为90.5%，诊断性能优于单输出3D CNN模型．