Using Convolutional Neural Network and a Single Heartbeat for ECG Biometric Recognition

The electrocardiogram (ECG) signal has become a popular biometric modality due to characteristics that make it suitable for developing reliable authentication systems. However, the long segment of signal required for recognition is still one of the limitations of existing ECG biometric recognition methods and affects its acceptability as a biometric modality. This paper investigates how a short segment of an ECG signal can be effectively used for biometric recognition, using deep-learning techniques. A small convolutional neural network (CNN) is designed to achieve better generalization capability by entropy enhancement of a short segment of a heartbeat signal. Additionally, it investigates how various blind and feature-dependent segments with different lengths affect the performance of the recognition system. Experiments were carried out on two databases for performance evaluation that included single and multisession records. In addition, a comparison was made between the performance of the proposed classifier and four well-known CNN models: GoogLeNet, ResNet, MobileNet and EfficientNet. Using a time–frequency domain representation of a short segment of an ECG signal around the R-peak, the proposed model achieved an accuracy of 99.90% for PTB, 98.20% for the ECG-ID mixed-session, and 94.18% for ECG-ID multisession datasets. Using the preprinted ResNet, we obtained 97.28% accuracy for 0.5-second segments around the R-peaks for ECG-ID multisession datasets, outperforming existing methods. It was found that the time–frequency domain representation of a short segment of an ECG signal can be feasible for biometric recognition by achieving better accuracy and acceptability of this modality.     

A novel CNN algorithm for pathological complete response prediction using an I-SPY TRIAL breast MRI database

PurposeTo apply our convolutional neural network (CNN) algorithm to predict neoadjuvant chemotherapy (NAC) response using the I-SPY TRIAL breast MRI dataset.MethodsFrom the I-SPY TRIAL breast MRI database, 131 patients from 9 institutions were successfully downloaded for analysis. First post-contrast MRI images were used for 3D segmentation using 3D slicer. Our CNN was implemented entirely of 3 × 3 convolutional kernels and linear layers. The convolutional kernels consisted of 6 residual layers, totaling 12 convolutional layers. Dropout with a 0.5 keep probability and L2 normalization was utilized. Training was implemented by using the Adam optimizer. A 5-fold cross validation was used for performance evaluation. Software code was written in Python using the TensorFlow module on a Linux workstation with one NVidia Titan X GPU.ResultsOf 131 patients, 40 patients achieved pCR following NAC (group 1) and 91 patients did not achieve pCR following NAC (group 2). Diagnostic accuracy of our CNN two classification model distinguishing patients with pCR vs non-pCR was 72.5 (SD ± 8.4), with sensitivity 65.5% (SD ± 28.1) and specificity of 78.9% (SD ± 15.2). The area under a ROC Curve (AUC) was 0.72 (SD ± 0.08).ConclusionIt is feasible to use our CNN algorithm to predict NAC response in patients using a multi-institution dataset.     

Similarity Changes Analysis for Heart Rate Fluctuation Regularity as a New Screening Method for Congestive Heart Failure

Congestive heart failure (CHF) is a chronic cardiovascular condition associated with dysfunction of the autonomic nervous system (ANS). Heart rate variability (HRV) has been widely used to assess ANS. This paper proposes a new HRV analysis method, which uses information-based similarity (IBS) transformation and fuzzy approximate entropy (fApEn) algorithm to obtain the fApEn_IBS index, which is used to observe the complexity of autonomic fluctuations in CHF within 24 h. We used 98 ECG records (54 health records and 44 CHF records) from the PhysioNet database. The fApEn_IBS index was statistically significant between the control and CHF groups (p < 0.001). Compared with the classical indices low-to-high frequency power ratio (LF/HF) and IBS, the fApEn_IBS index further utilizes the changes in the rhythm of heart rate (HR) fluctuations between RR intervals to fully extract relevant information between adjacent time intervals and significantly improves the performance of CHF screening. The CHF classification accuracy of fApEn_IBS was 84.69%, higher than LF/HF (77.55%) and IBS (83.67%). Moreover, the combination of IBS, fApEn_IBS, and LF/HF reached the highest CHF screening accuracy (98.98%) with the random forest (RF) classifier, indicating that the IBS and LF/HF had good complementarity. Therefore, fApEn_IBS effusively reflects the complexity of autonomic nerves in CHF and is a valuable CHF assessment tool.     

A Machine Learning Model for the Prognosis of Pulseless Electrical Activity during Out-of-Hospital Cardiac Arrest

Pulseless electrical activity (PEA) is characterized by the disassociation of the mechanical and electrical activity of the heart and appears as the initial rhythm in 20–30% of out-of-hospital cardiac arrest (OHCA) cases. Predicting whether a patient in PEA will convert to return of spontaneous circulation (ROSC) is important because different therapeutic strategies are needed depending on the type of PEA. The aim of this study was to develop a machine learning model to differentiate PEA with unfavorable (unPEA) and favorable (faPEA) evolution to ROSC. An OHCA dataset of 1921 5s PEA signal segments from defibrillator files was used, 703 faPEA segments from 107 patients with ROSC and 1218 unPEA segments from 153 patients with no ROSC. The solution consisted of a signal-processing stage of the ECG and the thoracic impedance (TI) and the extraction of the TI circulation component (ICC), which is associated with ventricular wall movement. Then, a set of 17 features was obtained from the ECG and ICC signals, and a random forest classifier was used to differentiate faPEA from unPEA. All models were trained and tested using patientwise and stratified 10-fold cross-validation partitions. The best model showed a median (interquartile range) area under the curve (AUC) of 85.7(9.8)% and a balance accuracy of 78.8(9.8)%, improving the previously available solutions at more than four points in the AUC and three points in balanced accuracy. It was demonstrated that the evolution of PEA can be predicted using the ECG and TI signals, opening the possibility of targeted PEA treatment in OHCA.     

Recognizing pedestrian’s unsafe behaviors in far-infrared imagery at night

Pedestrian behavior recognition is important work for early accident prevention in advanced driver assistance system (ADAS). In particular, because most pedestrian-vehicle crashes are occurred from late of night to early of dawn, our study focus on recognizing unsafe behavior of pedestrians using thermal image captured from moving vehicle at night. For recognizing unsafe behavior, this study uses convolutional neural network (CNN) which shows high quality of recognition performance. However, because traditional CNN requires the very expensive training time and memory, we design the light CNN consisted of two convolutional layers and two subsampling layers for real-time processing of vehicle applications. In addition, we combine light CNN with boosted random forest (Boosted RF) classifier so that the output of CNN is not fully connected with the classifier but randomly connected with Boosted random forest. We named this CNN as randomly connected CNN (RC-CNN). The proposed method was successfully applied to the pedestrian unsafe behavior (PUB) dataset captured from far-infrared camera at night and its behavior recognition accuracy is confirmed to be higher than that of some algorithms related to CNNs, with a shorter processing time.     

Ensemble Approach for Detection of Depression Using EEG Features

Depression is a public health issue that severely affects one’s well being and can cause negative social and economic effects to society. To raise awareness of these problems, this research aims at determining whether the long-lasting effects of depression can be determined from electroencephalographic (EEG) signals. The article contains an accuracy comparison for SVM, LDA, NB, kNN, and D3 binary classifiers, which were trained using linear (relative band power, alpha power variability, spectral asymmetry index) and nonlinear (Higuchi fractal dimension, Lempel–Ziv complexity, detrended fluctuation analysis) EEG features. The age- and gender-matched dataset consisted of 10 healthy subjects and 10 subjects diagnosed with depression at some point in their lifetime. Most of the proposed feature selection and classifier combinations achieved accuracy in the range of 80% to 95%, and all the models were evaluated using a 10-fold cross-validation. The results showed that the motioned EEG features used in classifying ongoing depression also work for classifying the long-lasting effects of depression.     

Clifford Wavelet Entropy for Fetal ECG Extraction

Analysis of the fetal heart rate during pregnancy is essential for monitoring the proper development of the fetus. Current fetal heart monitoring techniques lack the accuracy in fetal heart rate monitoring and features acquisition, resulting in diagnostic medical issues. The challenge lies in the extraction of the fetal ECG from the mother ECG during pregnancy. This approach has the advantage of being a reliable and non-invasive technique. In the present paper, a wavelet/multiwavelet method is proposed to perfectly extract the fetal ECG parameters from the abdominal mother ECG. In a first step, due to the wavelet/mutiwavelet processing, a denoising procedure is applied to separate the noised parts from the denoised ones. The denoised signal is assumed to be a mixture of both the MECG and the FECG. One of the well-known measures of accuracy in information processing is the concept of entropy. In the present work, a wavelet/multiwavelet Shannon-type entropy is constructed and applied to evaluate the order/disorder of the extracted FECG signal. The experimental results apply to a recent class of Clifford wavelets constructed in Arfaoui, et al. J. Math. Imaging Vis. 2020, 62, 73–97, and Arfaoui, et al. Acta Appl. Math. 2020, 170, 1–35. Additionally, classical Haar–Faber–Schauder wavelets are applied for the purpose of comparison. Two main well-known databases have been applied, the DAISY database and the CinC Challenge 2013 database. The achieved accuracy over the test databases resulted in Se = 100%, PPV = 100% for FECG extraction and peak detection.     

Correction of out-of-FOV motion artifacts using convolutional neural network

PurposeSubject motion during MRI scan can result in severe degradation of image quality. Existing motion correction algorithms rely on the assumption that no information is missing during motions. However, this assumption does not hold when out-of-FOV motion happens. Currently available algorithms are not able to correct for image artifacts introduced by out-of-FOV motion. The purpose of this study is to demonstrate the feasibility of incorporating convolutional neural network (CNN) derived prior image into solving the out-of-FOV motion problem.Methods and materialsA modified U-net network was proposed to correct out-of-FOV motion artifacts by incorporating motion parameters into the loss function. A motion model based data fidelity term was applied in combination with the CNN prediction to further improve the motion correction performance. We trained the CNN on 1113 MPRAGE images with simulated oscillating and sudden motion trajectories, and compared our algorithm to a gradient-based autofocusing (AF) algorithm in both 2D and 3D images. Additional experiment was performed to demonstrate the feasibility of transferring the networks to different dataset. We also evaluated the robustness of this algorithm by adding Gaussian noise to the motion parameters. The motion correction performance was evaluated using mean square error (NMSE), peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM).ResultsThe proposed algorithm outperformed AF-based algorithm for both 2D (NMSE: 0.0066 ± 0.0009 vs 0.0141 ± 0.008, P < .01; PSNR: 29.60 ± 0.74 vs 21.71 ± 0.27, P < .01; SSIM: 0.89 ± 0.014 vs 0.73 ± 0.004, P < .01) and 3D imaging (NMSE: 0.0067 ± 0.0008 vs 0.070 ± 0.021, P < .01; PSNR: 32.40 ± 1.63 vs 22.32 ± 2.378, P < .01; SSIM: 0.89 ± 0.01 vs 0.62 ± 0.03, P < .01). Robust reconstruction was achieved with 20% data missed due to the out-of-FOV motion.ConclusionIn conclusion, the proposed CNN-based motion correction algorithm can significantly reduce out-of-FOV motion artifacts and achieve better image quality compared to AF-based algorithm.     

Malicious URL Detection Based on Associative Classification

Cybercriminals use malicious URLs as distribution channels to propagate malware over the web. Attackers exploit vulnerabilities in browsers to install malware to have access to the victim’s computer remotely. The purpose of most malware is to gain access to a network, ex-filtrate sensitive information, and secretly monitor targeted computer systems. In this paper, a data mining approach known as classification based on association (CBA) to detect malicious URLs using URL and webpage content features is presented. The CBA algorithm uses a training dataset of URLs as historical data to discover association rules to build an accurate classifier. The experimental results show that CBA gives comparable performance against benchmark classification algorithms, achieving 95.8% accuracy with low false positive and negative rates.     

基于可见/近红外光谱和深度学习的早期鸭胚雌雄信息无损检测

胚蛋雌雄识别一直是家禽业发展的瓶颈问题,在禽肉生产过程中倾向于养殖雄性个体,而禽蛋生产产业倾向于养殖雌性家禽。若能在孵化过程中较早鉴别出种蛋的雌雄,不仅能够降低家禽孵化产业的成本,还能够提高禽蛋和禽肉生产行业的经济效益。该文以种鸭蛋为研究对象,为了在种鸭蛋孵化早期实现对种蛋的雌雄识别,构建了可见/近红外透射光谱信息采集系统,在200～1 100 nm的波长范围内采集了345枚孵化了0~8 d的种鸭蛋光谱数据。搭建了适用于种鸭蛋光谱信息的6层卷积神经网络（convolutional neural network, CNN）,其中包括输入层、3个卷积层、全连接层与输出分类层。卷积层可以提取光谱中的有效信息,全连接层通过对卷积层提取的局部特征进行整合供输出层分类决策。另外在卷积神经网络中引入局部响应归一化和dropout操作能够加快网络的收敛速度。利用该卷积神经网络构建鸭胚雌雄信息识别网络,通过对比与分析不同孵化天数的识别效果,发现孵化7d的识别效果最佳。随后将孵化7 d的种鸭蛋原始光谱数据进行噪声去除,选取500~900 nm波段用于后续的特征波长选取和建模。分别运用了竞争性自适应重加权算法(CARS)、连续投影算法( SPA)与遗传算法(GA)选择能够区分鸭胚性别的波长点,将选取的特征波长转换为二维的光谱信息矩阵,二维光谱信息矩阵保留了一维光谱的有效信息,同时极大地方便了与卷积神经网络的结合。利用二维光谱信息矩阵和卷积神经网络相结合,实现孵化早期阶段鸭胚的雌雄识别。经检验,基于 SPA算法和CNN网络建立的模型效果较佳,其中训练集、开发集及测试集的准确率分别为93.36%,93.12%和93.83%;基于GA算法和CNN网络建立的模型效果次之,训练集、开发集及测试集的准确率分别为90.87%,93.12%和86.42%;基于CARS算法和CNN网络建立的模型的训练集、开发集及测试集的准确率分别为84.65%,83.75%和77.78%。研究结果表明基于可见/近红外光谱技术和卷积神经网络可以实现孵化早期鸭胚胎雌雄的无损鉴别,为后续相关自动化检测装置的研发提供了技术支撑。     

A Two-Branch CNN Fusing Temporal and Frequency Features for Motor Imagery EEG Decoding

With the development of technology and the rise of the meta-universe concept, the brain-computer interface (BCI) has become a hotspot in the research field, and the BCI based on motor imagery (MI) EEG has been widely concerned. However, in the process of MI-EEG decoding, the performance of the decoding model needs to be improved. At present, most MI-EEG decoding methods based on deep learning cannot make full use of the temporal and frequency features of EEG data, which leads to a low accuracy of MI-EEG decoding. To address this issue, this paper proposes a two-branch convolutional neural network (TBTF-CNN) that can simultaneously learn the temporal and frequency features of EEG data. The structure of EEG data is reconstructed to simplify the spatio-temporal convolution process of CNN, and continuous wavelet transform is used to express the time-frequency features of EEG data. TBTF-CNN fuses the features learned from the two branches and then inputs them into the classifier to decode the MI-EEG. The experimental results on the BCI competition IV 2b dataset show that the proposed model achieves an average classification accuracy of 81.3% and a kappa value of 0.63. Compared with other methods, TBTF-CNN achieves a better performance in MI-EEG decoding. The proposed method can make full use of the temporal and frequency features of EEG data and can improve the decoding accuracy of MI-EEG.     

基于改进卷积神经网络算法的语音识别

为了解决传统卷积神经网络识别连续语音数据时识别性能较差的问题,提出一种改进的卷积神经网络算法。该方法引入Fisher准则以及L2正则化约束,在反向传播调整参数阶段,既保证参数误差的最小化,又确保分类以后的样本类间分布较分散,类内分布较集中,同时保证网络权值具有合适的数量级以有效缓解过拟合问题;采用一种更符合生物神经元激活特性的新型log激活函数进行卷积神经网络的优化,进一步提高语音识别的正确率。在语音识别库TIMIT以及THCHS30上的实验结果表明,相较于传统卷积神经网络算法,本文提出的改进算法能较好的提高语音识别率,且泛化能力更强。     

CNN-FWS: A Model for the Diagnosis of Normal and Abnormal ECG with Feature Adaptive

(1) Background and objective: Cardiovascular disease is one of the most common causes of death in today’s world. ECG is crucial in the early detection and prevention of cardiovascular disease. In this study, an improved deep learning method is proposed to diagnose abnormal and normal ECG accurately. (2) Methods: This paper proposes a CNN-FWS that combines three convolutional neural networks (CNN) and recursive feature elimination based on feature weights (FW-RFE), which diagnoses abnormal and normal ECG. F1 score and Recall are used to evaluate the performance. (3) Results: A total of 17,259 records were used in this study, which validated the diagnostic performance of CNN-FWS for normal and abnormal ECG signals in 12 leads. The experimental results show that the F1 score of CNN-FWS is 0.902, and the Recall of CNN-FWS is 0.889. (4) Conclusion: CNN-FWS absorbs the advantages of convolutional neural networks (CNN) to obtain three parts of different spatial information and enrich the learned features. CNN-FWS can select the most relevant features while eliminating unrelated and redundant features by FW-RFE, making the residual features more representative and effective. The method is an end-to-end modeling approach that enables an adaptive feature selection process without human intervention.     

A convolutional neural network approach to calibrating the rotation axis for X‐ray computed tomography

This paper presents an algorithm to calibrate the center‐of‐rotation for X‐ray tomography by using a machine learning approach, the Convolutional Neural Network (CNN). The algorithm shows excellent accuracy from the evaluation of synthetic data with various noise ratios. It is further validated with experimental data of four different shale samples measured at the Advanced Photon Source and at the Swiss Light Source. The results are as good as those determined by visual inspection and show better robustness than conventional methods. CNN has also great potential for reducing or removing other artifacts caused by instrument instability, detector non‐linearity, etc. An open‐source toolbox, which integrates the CNN methods described in this paper, is freely available through GitHub at tomography/xlearn and can be easily integrated into existing computational pipelines available at various synchrotron facilities. Source code, documentation and information on how to contribute are also provided.     

基于MRI和深度学习的桥小脑角区脑膜瘤与听神经瘤分类算法研究

桥小脑角区脑膜瘤与听神经瘤是两种常见的脑部肿瘤,它们的临床表现和影像学表现极为相似,在临床诊断时极易发生误诊．将影像数据与深度学习方法相结合,建立脑膜瘤与听神经瘤的判别模型,可以为两种脑肿瘤的及时准确诊断提供重要手段．本文采集了307名脑肿瘤患者的T₁W-SE序列图像,通过对原始图像进行限制对比度自适应直方图均衡化（Contrast Limited Adaptive Histogram Equalization,CLAHE）等预处理,提升数据集图像质量,再经过建立的三维卷积神经网络（3-Dimensional Convolutional Neural Network,3D CNN）深度学习框架中图像特征的学习,实现对脑膜瘤与听神经瘤的分类．图像增强参数与网络结构参数经过优化后,对脑膜瘤与听神经瘤分类的准确率达到0.918 0,曲线下面积（Area Under Curve,AUC）为0.913 4,实现了对桥小脑角区脑膜瘤与听神经瘤的有效判别．     

Determination of quantum toric error correction code threshold using convolutional neural network decoders

Quantum error correction technology is an important solution to solve the noise interference generated during the operation of quantum computers.In order to find the best syndrome of the stabilizer code in quantum error correction,we need to find a fast and close to the optimal threshold decoder.In this work,we build a convolutional neural network(CNN)decoder to correct errors in the toric code based on the system research of machine learning.We analyze and optimize various conditions that affect CNN,and use the RestNet network architecture to reduce the running time.It is shortened by 30%-40%,and we finally design an optimized algorithm for CNN decoder.In this way,the threshold accuracy of the neural network decoder is made to reach 10.8%,which is closer to the optimal threshold of about 11%.The previous threshold of 8.9%-10.3%has been slightly improved,and there is no need to verify the basic noise.     

白矮主序双星光谱的卷积特征提取

通过卷积运算提取白矮主序双星的光谱特征是提高识别精度的有效手段。通过设计一维卷积神经网络,以判别学习的方式从大量混合光谱中拟合出具有稳定分布的12个卷积核,有效提取白矮主序双星的卷积特征。通过引入相对松弛的光谱类别先验分布,提出反贝叶斯学习策略以解决由于光谱抽样有偏带来的问题,显著提高识别精度。通过比较光谱在不同信噪比下的交叉熵测试误差,分析卷积特征的提取过程对光谱信噪比的鲁棒性。实验发现,基于反贝叶斯学习策略的一维卷积神经网络对白矮主序双星的识别准确率达到99.0(±0.3),超过了经典的PCA+SVM模型。卷积特征谱的池化过程以降低光谱分辨率的形式缓解了光谱噪声对识别精度的影响。当信噪比小于3时,必须通过增加模型在光谱上的迭代次数以形成稳定的卷积核;当信噪比介于3与6之间时,光谱卷积特征较为稳定;当信噪比大于6时,光谱卷积特征的稳定性显著上升,信噪比对于模型识别精度带来的影响可以忽略。     

Automatic ECG Classification Using Continuous Wavelet Transform and Convolutional Neural Network

Early detection of arrhythmia and effective treatment can prevent deaths caused by cardiovascular disease (CVD). In clinical practice, the diagnosis is made by checking the electrocardiogram (ECG) beat-by-beat, but this is usually time-consuming and laborious. In the paper, we propose an automatic ECG classification method based on Continuous Wavelet Transform (CWT) and Convolutional Neural Network (CNN). CWT is used to decompose ECG signals to obtain different time-frequency components, and CNN is used to extract features from the 2D-scalogram composed of the above time-frequency components. Considering the surrounding R peak interval (also called RR interval) is also useful for the diagnosis of arrhythmia, four RR interval features are extracted and combined with the CNN features to input into a fully connected layer for ECG classification. By testing in the MIT-BIH arrhythmia database, our method achieves an overall performance of 70.75%, 67.47%, 68.76%, and 98.74% for positive predictive value, sensitivity, F1-score, and accuracy, respectively. Compared with existing methods, the overall F1-score of our method is increased by 4.75~16.85%. Because our method is simple and highly accurate, it can potentially be used as a clinical auxiliary diagnostic tool.     

基于卷积神经网络与光谱特征的夏威夷果品质鉴定研究

夏威夷果含油量高,在开缝之后容易发生变质,现有关于夏威夷果品质鉴定的方法多为传统的破坏性检验,很难满足无损检测的需求。卷积神经网络(CNN)作为应用最广泛的深度学习网络模型之一,具有比浅层学习方法更强的特征提取与模型表达能力,在光谱数据方面的应用拥有很大潜力。基于夏威夷果在可见-近红外的光谱特征分析,研究用于提取夏威夷果光谱特征的卷积神经网络模型,并提出一种高效无损鉴定夏威夷果品质的方法。首先以三种不同品质的夏威夷果(好籽、哈籽及霉籽)为研究对象,分析样本在500~2 100 nm的光谱信息;在光谱数据预处理中引入白化处理方法,用以增强数据的相关性差异;然后在模型训练过程中,将样本随机分为训练集和预测集,探讨不同CNN结构、卷积层数、卷积核大小及个数、池化层类型、全连接层神经元个数以及激活函数对分类结果的影响,并采用激活函数ReLU和Dropout方法,预防样本数据过少引起的过拟合现象;最后通过分析模型分类准确率和计算效率,确定了一个6层结构的CNN模型： 输入层-卷积层-池化层-全连接层(200神经元)-全连接层(100神经元)-输出层。实验结果表明： 上述网络模型对校正集和预测集的分类准确率均达到100％。因此,改进后的卷积神经网络模型可充分学习夏威夷果的光谱特征并有效分类,将深度学习理论与光谱分析相结合的方法能够实现对夏威夷果品质的准确鉴定,同时为夏威夷果等坚果类食品的高效、无损、实时在线检测提供了新思路。