Hyperparameter on-line learning of stochastic resonance based threshold networks

Aiming at training the feed-forward threshold neural network consisting of nondifferentiable activation functions, the approach of noise injection forms a stochastic resonance based threshold network that can be optimized by various gradient-based optimizers. The introduction of injected noise extends the noise level into the parameter space of the designed threshold network, but leads to a highly non-convex optimization landscape of the loss function. Thus, the hyperparameter on-line learning procedure with respective to network weights and noise levels becomes of challenge. It is shown that the Adam optimizer, as an adaptive variant of stochastic gradient descent, manifests its superior learning ability in training the stochastic resonance based threshold network effectively. Experimental results demonstrate the significant improvement of performance of the designed threshold network trained by the Adam optimizer for function approximation and image classification.     

基于GA_XGBoost模型的大学生科研能力预测问题研究

科学评价大学生科研创新能力对我国科研水平的提高具有重要意义.采用机器学习模型来预测大学生科研能力可以起到良好的效果,提出一种GAXGBoost模型来实现对大学生的科研能力预测.此模型是以Xgboost算法为基础,然后充分利用遗传算法的全局搜索能力自动搜索Xgboost最优超参数,避免了人为经验调参不准确的缺陷,最后采用精英选择策略以此确保每一轮都是最佳的进化结果.通过分析表明,所采用的GAXGBoost模型在大学生科研能力预测的结果中具有很高的精度,将此模型与Logistic Regression、Random Forest、SVM等模型进行对比,GAXGBoost模型的预测精度最高.     

Prediction of the drag reduction effect of pulsating pipe flow based on machine learning

Prediction of drag reduction effect caused by pulsating pipe flows is examined using machine learning. First, a large set of flow field data is obtained experimentally by measuring turbulent pipe flows with various pulsation patterns. Consequently, more than 7000 waveforms are applied, obtaining a maximum drag reduction rate and maximum energy saving rate of 38.6% and 31.4%, respectively. The results indicate that the pulsating flow effect can be characterized by the pulsation period and pressure gradient during acceleration and deceleration. Subsequently, two machine learning models are tested to predict the drag reduction rate. The results confirm that the machine learning model developed for predicting the time variation of the flow velocity and differential pressure with respect to the pump voltage can accurately predict the nonlinearity of pressure gradients. Therefore, using this model, the drag reduction effect can be estimated with high accuracy.     

紫色球杆菌视紫红质光谱特性的机器学习研究

近年来，机器学习等人工智能技术被应用于蛋白质工程，其在蛋白质结构、功能预测、催化活性等研究中具有独特优势。在未知蛋白质结构的情况下，将蛋白质序列和功能特性与机器学习相结合，基于序列-活性关系（innovative sequence-activity relationship，ISAR）算法，将蛋白质氨基酸序列数字化，用快速傅里叶变换（fast four transform，FFT）进行预处理，再进行偏最小二乘回归建模，可在数据集较少情况下拟合得到最佳模型。通过机器学习对紫色球杆菌视紫红质（gloeobacter violaceus rhodopsin，GR）的突变体蛋白质氨基酸序列与光谱最大吸收波长进行建模，获得了最佳模型。用最佳索引LEVM760106建模得到的确定系数R² 为0.944，均方误差E为11.64。用小波变换进行的预处理，其R² 虽也约为0.944，但E大于11.64，不及FFT进行的预处理。方法较好地解决了蛋白质序列与功能特性之间的数学建模问题，在蛋白质工程中可为预测更优的突变体提供支持。     

A volatolomic approach using cerumen as biofluid to diagnose bovine intoxication by Stryphnodendron rotundifolium

An innovative volatolomic approach employs the detection of biomarkers present in cerumen (earwax) to identify cattle intoxication by Stryphnodendron rotundifolium Mart., Fabaceae (popularly known as barbatimão). S. rotundifolium is a poisonous plant with the toxic compound undefined and widely distributed throughout the Brazilian territory. Cerumen samples from cattle of two local Brazilian breeds (‘Curraleiro Pé-Duro’ and ‘Pantaneiro’) were collected during an experimental intoxication protocol and analyzed using headspace (HS)/GC–MS followed by multivariate analysis (genetic algorithm for a partial least squares, cluster analysis, and classification and regression trees). A total of 106 volatile organic metabolites were identified in the cerumen samples of bovines. The intoxication by S. rotundifolium influenced the cerumen volatolomic profile of the bovines throughout the intoxication protocol. In this way, it was possible to detect biomarkers for cattle intoxication. Among the biomarkers, 2-octyldecanol and 9-tetradecen-1-ol were able to discriminate all samples between intoxicated and nonintoxicated bovines. The cattle intoxication diagnosis by S. rotundifolium was accomplished by applying the cerumen analysis using HS/GC–MS, in an easy, accurate, and noninvasive way. Thus, the proposed bioanalytical chromatography protocol is a useful tool in veterinary applications to determine this kind of intoxication.     

卷积神经网络用于近红外光谱古筝面板木材分级

目前,我国乐器制作行业在古筝面板用木材等级的筛选上主要依赖于技师主观评判,但此法缺少科学理论的依据,效率低,客观性及出材率的提高等方面受到限制,无法满足乐器市场的大量需求。实现古筝面板用木材快速、智能化的分级工作是一个急需解决的课题。近红外光谱非常适用于测量含氢的有机物质。古筝面板木材主要化学成分的化学键均由含氢基团组成,不同等级板材的化学成分存在差异,这些差异反映在近红外光谱中,为判断木材等级提供了可能。同时卷积神经网络对非线性数据具有较强的特征提取能力,所以提出一种应用卷积神经网络模型对光谱数据进行分析的方法,进而判别木材的等级。应用了Savitzky Golay一阶、二阶微分两种预处理方法和核主成分分析、连续投影算法两种数据压缩方法,通过所设计的卷积神经网络模型以样本识别准确率和模型构建过程中的损失值作为判定指标选出最佳预处理和数据压缩方法。为了提高模型提取分析光谱数据的能力和避免过拟合现象,应用了多通道卷积核、批量归一化和early stopping策略,将通过两层卷积层提取的特征信息送入全连接层,从而充分提取剩余信息,通过Softmax函数获得板材的最终预测等级,从而确定了最终模型。最终Savitzky Golay一阶微分和核主成分分析为最佳数据处理方法,同时得出用于区分不同等级的古筝面板用木材的主要关键谱带,分别为1 163~1 243, 1 346~1 375和1 525~1 584 nm。将该模型应用于测试集样本,古筝面板用木材的等级识别准确率为95.5%。实验结果表明所提出的方法可以高效地处理光谱数据,有效识别区分不同等级的古筝面板用木材的关键特征,从而为广阔的乐器市场提供一定的技术支持。     

语音通信降噪研究

语音通信系统中，语音通过信道传输将不可避免地引入码间串扰和信号畸变，同时受到噪声污染。本文在分析自适应盲均衡算法CMA(constant modulus algorithm）和改进盲均衡算法的基础上，考虑到自适应盲均衡技术在语音噪声控制方面能力有限，将自适应盲均衡技术与小波包掩蔽阈值降噪算法联合使用，形成一种基带语音增强新方法。仿真试验结果显示自适应盲均衡技术可以使星座图变得清晰而紧凑，有效减小误码率。研究证实该方法在语音信号ISI和畸变严重情况下，在白噪及有色噪声不同的噪声环境中都具有稳定的降噪能力，消噪同时可获得汉语普通话良好的听觉效果。     

基于深度学习的ELM实时识别研究

基于深度学习的方法，在HL-2A装置上开发出了一套边缘局域模(ELM)实时识别算法。算法使用5200次放电数据(约24.19万数据切片)进行学习，得到一个深度为22层的卷积神经网络。为衡量算法的识别能力，识别了HL-2A装置自2009年实现稳定ELMy H模放电以来所有历史数据(约26000次放电数据)，共识别出1665次H模放电，其中误识别35次，误报率为2.10%。在实际的1634次H模放电中，漏识别4次，漏识别率为0.24%。该误报率和漏报率可以满足ELM实时识别的精度要求。识别算法在实时控制环境下，对单个时间点的平均计算时间为0.46ms，可以满足实时控制的计算速度要求。