基于改进降噪自编码器的馈线终端失效率预测

配电网中馈线终端设备由于运行环境恶劣,往往面临意外失效问题。本文针对海量馈线终端装置的失效率预测问题,使用堆叠降噪自编码器实现基于馈线终端的各个关键元件的失效率预测;采用基于Dropout的模型正则化方法防止自编码器训练过程中出现过拟合现象,同时采用Adadelta算法对堆叠自编码器进行优化,在保证预测准确率的同时提高学习速率,实现馈线终端故障失效率的高效准确预测;最后基于馈线终端装置现场数据进行仿真验证。仿真结果验证了本文方法对失效率预测的准确性和泛化能力。     

Densely connected convolutional network block based autoencoder for panorama map compression

As a novel virtual reality (VR) format, panorama maps are attracting increasing attention, while the compression of panorama images is still a concern. In this paper, a densely connected convolutional network block (dense block) based autoencoder is proposed to compress panorama maps. In the proposed autoencoder, dense blocks are specially designed to reuse feature maps and reduce redundancy of features. Meanwhile, a loss function, which imports a position-dependent weight item for each pixel, is proposed to train and adjust network parameters, in order to make the autoencoder fit to properties of panorama maps. Based on the proposed autoencoder and the weighted loss function, a greedy block-wise training scheme is also designed to avoid gradient vanishing problem and speed up training. During training process, the autoencoder is divided into several sub-nets. After each sub-net is trained separately, the whole network is fine-tuned to achieve the best performance. Experimental results demonstrate that the proposed autoencoder, compared with JPEG, saves up to 79.69 % bit rates, and obtains 7.27dB gain in BD-WS-PSNR or 0.0789 gain in BD-WS-SSIM. The proposed autoencoder also outperforms JPEG 2000, HEVC and VVC in both BD-WS-PSNR and BD-WS-SSIM. Meanwhile, subjective results show that the proposed autoencoder can recover details of panorama images, and reconstruct maps with high visual quality.     

Fooling intrusion detection systems using adversarially autoencoder

Due to the increasing cyber-attacks, various Intrusion Detection Systems (IDSs) have been proposed to identify network anomalies. Most existing machine learning-based IDSs learn patterns from the features extracted from network traffic flows, and the deep learning-based approaches can learn data distribution features from the raw data to differentiate normal and anomalous network flows. Although having been used in the real world widely, the above methods are vulnerable to some types of attacks. In this paper, we propose a novel attack framework, Anti-Intrusion Detection AutoEncoder (AIDAE), to generate features to disable the IDS. In the proposed framework, an encoder transforms features into a latent space, and multiple decoders reconstruct the continuous and discrete features, respectively. Additionally, a generative adversarial network is used to learn the flexible prior distribution of the latent space. The correlation between continuous and discrete features can be kept by using the proposed training scheme. Experiments conducted on NSL-KDD, UNSW-NB15, and CICIDS2017 datasets show that the generated features indeed degrade the detection performance of existing IDSs dramatically.     

基于自编码网络流形学习的毛竹笋不溶性膳食纤维含量红外光谱建模

提出了一种结合自编码网络(AN)流形学习和偏最小二乘(PLS)法的红外光谱建模方法AN-PLS。AN-PLS方法首先用AN算法对红外光谱数据进行非线性降维,再结合PLS建立回归模型。利用该方法建立了毛竹笋中不溶性膳食纤维含量的近红外光谱和中红外光谱回归模型。结果表明,用AN-PLS方法建立的回归模型,比用其他常用光谱数据预处理方法结合PLS及用单独PLS算法建立的模型具有更小的预测均方根误差RMSEP和更高的决定系数R2,因此,AN-PLS具有较优的建模与预测能力,利用近红外光谱和中红外光谱技术结合AN-PLS建模,可实现毛竹笋中不溶性膳食纤维含量的准确测量。     

稀疏降噪自编码结合高斯过程的近红外光谱药品鉴别方法

提出一种稀疏降噪自编码结合高斯过程的近红外光谱药品鉴别方法。首先对近红外光谱数据进行小波变换以消除基线漂移,然后用稀疏降噪自编码(SDAE)网络提取光谱特征并降维表示,最后采用高斯过程(GP)进行二分类,其中GP选用光谱混合(SM)核函数作为协方差函数,记此分类网络为wSDAG_SM。自编码网络具有很强的模型表示能力,高斯过程分类器在处理小样本数据时具有优势。wSDAG_SM网络通过稀疏降噪自编码学习得到维数更低但更有价值的特征来表示输入数据,同时将具有很好表达力的光谱混合核作为高斯过程的协方差函数,有利于更准确的光谱数据分类。以琥乙红霉素及其他药品的近红外光谱为实验数据,将该方法与经过墨西哥帽小波变换的BP神经网络(wBP)、支持向量机(wSVM), SDAE结合Logistic二分类(wSDAL)、SDAE结合采用平方指数(SE)协方差核的GP二分类(wSDAG_SE),以及未采用小波变换的SDAG_SM网络等方法进行对比。实验结果表明,对光谱数据进行墨西哥帽小波变换预处理能有效提升SDAG_SM网络的分类准确率和稳定性。wSDAG_SM方法无论从分类准确率还是分类结果稳定性方面,都优于其他分类器。     

Detecting spatiotemporal irregularities in videos via a 3D convolutional autoencoder

Spatiotemporal irregularities (i.e., the uncommon appearance and motion patterns) in videos are difficult to detect, as they are usually not well defined and appear rarely in videos. We tackle this problem by learning normal patterns from regular videos, while treating irregularities as deviations from normal patterns. To this end, we introduce a 3D fully convolutional autoencoder (3D-FCAE) that is trainable in an end-to-end manner to detect both temporal and spatiotemporal irregularities in videos using limited training data. Subsequently, temporal irregularities can be detected as frames with high reconstruction errors, and irregular spatiotemporal patterns can be detected as blurry regions that are not well reconstructed. Our approach can accurately locate temporal and spatiotemporal irregularities thanks to the 3D fully convolutional autoencoder and the explored effective architecture. We evaluate the proposed autoencoder for detecting irregular patterns on benchmark video datasets with weak supervision. Comparisons with state-of-the-art approaches demonstrate the effectiveness of our approach. Moreover, the learned autoencoder shows good generalizability across multiple datasets.     

Improved hybrid layered image compression using deep learning and traditional codecs

Recently deep learning-based methods have been applied in image compression and achieved many promising results. In this paper, we propose an improved hybrid layered image compression framework by combining deep learning and the traditional image codecs. At the encoder, we first use a convolutional neural network (CNN) to obtain a compact representation of the input image, which is losslessly encoded by the FLIF codec as the base layer of the bit stream. A coarse reconstruction of the input is obtained by another CNN from the reconstructed compact representation. The residual between the input and the coarse reconstruction is then obtained and encoded by the H.265/HEVC-based BPG codec as the enhancement layer of the bit stream. Experimental results using the Kodak and Tecnick datasets show that the proposed scheme outperforms the state-of-the-art deep learning-based layered coding scheme and traditional codecs including BPG in both PSNR and MS-SSIM metrics across a wide range of bit rates, when the images are coded in the RGB444 domain.     

3D卷积自动编码网络的高光谱异常检测

高光谱图像包含丰富的地物光谱信息,在遥感图像领域有着巨大的发展前景.高光谱图像异常检测无需任何先验光谱信息,便可检测出图像中的异常目标.因此,在国防军事和民用领域都有广泛的应用,是现阶段高光谱图像处理领域的研究热点.然而,高光谱图像存在数据复杂、冗余性强、未标记以及样本数量少等特点,这给高光谱图像异常检测带来了很大的挑...     

A novel intrusion detection model for the CAN bus packet of in-vehicle network based on attention mechanism and autoencoder

The attacks on in-vehicle Controller Area Network (CAN) bus messages severely disrupt normal communication between vehicles. Therefore, researches on intrusion detection models for CAN have positive business value for vehicle security, and the intrusion detection technology for CAN bus messages can effectively protect the in-vehicle network from unlawful attacks. Previous machine learning-based models are unable to effectively identify intrusive abnormal messages due to their inherent shortcomings. Hence, to address the shortcomings of the previous machine learning-based intrusion detection technique, we propose a novel method using Attention Mechanism and AutoEncoder for Intrusion Detection (AMAEID). The AMAEID model first converts the raw hexadecimal message data into binary format to obtain better input. Then the AMAEID model encodes and decodes the binary message data using a multi-layer denoising autoencoder model to obtain a hidden feature representation that can represent the potential features behind the message data at a deeper level. Finally, the AMAEID model uses the attention mechanism and the fully connected layer network to infer whether the message is an abnormal message or not. The experimental results with three evaluation metrics on a real in-vehicle CAN bus message dataset outperform some traditional machine learning algorithms, demonstrating the effectiveness of the AMAEID model.     

基于SDAE与CART联合智能算法的通信网络用户满意度分析方法

论文提出一种基于栈式降噪自编码器(Stacked Denoising Autoencoder,SDAE)与分类和回归决策树(Classification and Regression Tree,CART)的移动互联网满意度预测方法,此模型能挖掘出用户的满意度与用户的特征和网络特征的关联规则,通过这种规则能更精准及时地预测到用户满意度的变化,以便运营商针对这种变化提前作出决策。论文所提方法能够挖掘特征间的深层关系,通过SDAE编码样本可以获得影响用户体验的隐含特征,及时发现用户对于网络贬损的真正痛点,为运营商网络建设和运行维护部门制定提升用户的网络感知策略提供依据,从而提升用户体验。