Hyperparameter on-line learning of stochastic resonance based threshold networks

Aiming at training the feed-forward threshold neural network consisting of nondifferentiable activation functions, the approach of noise injection forms a stochastic resonance based threshold network that can be optimized by various gradient-based optimizers. The introduction of injected noise extends the noise level into the parameter space of the designed threshold network, but leads to a highly non-convex optimization landscape of the loss function. Thus, the hyperparameter on-line learning procedure with respective to network weights and noise levels becomes of challenge. It is shown that the Adam optimizer, as an adaptive variant of stochastic gradient descent, manifests its superior learning ability in training the stochastic resonance based threshold network effectively. Experimental results demonstrate the significant improvement of performance of the designed threshold network trained by the Adam optimizer for function approximation and image classification.     

考虑多种损坏构成特征的沥青路面预防性养护决策方法

由于沥青路面损坏构成的多样性, 相同的路面状况指数(pavement condition index, PCI)可能代表不同的损坏组合. 当多种损坏并存且损坏程度接近时, 用PCI和主导损坏(最严重、扣分最多的路面损坏)难以得到具有针对性的养护对策. 因此, 通过对PCI的深入分析, 明确了主导损坏代表性不足的路段, 以现行预防性养护决策方法为基础, 补充了一种考虑损坏构成特征、更具针对性的决策方法. 以上海城市道路近5年的检测、养护数据为分析基础, 首先利用有序聚类算法将路段按PCI水平分组, 分析了不同阶段路面损坏构成和差异水平; 然后, 针对多种损坏并存且损坏差异不显著的路段, 根据预防性养护的实施效果筛选了能够反映正确预防性养护经验的有效养护路段; 最后, 基于有效养护路段建立并对比分析了2个基于BP(back propagation)神经网络的养护决策模型. 结果表明: 当PCI水平介于优良(84.4~93.0分)时, 不同损坏程度接近, 主导损坏代表性不足; 考虑多种损坏构成特征的BP神经网络模型表现出更高的决策精度, 测试集决策正确率达86.20%, 优于仅考虑主导损坏的模型(58.50%). BP神经网络与传统决策树法结合能够优化沥青路面决策过程, 提高养护对策选取的针对性.     

植入式硅神经微电极的发展

 神经科学和神经工程研究需要研究大脑神经元的电活动情况，以了解大脑产生、传输和处理信息的机制。植入式神经微电极作为一种传感器件，是时间分辨率最高的神经电活动传感手段之一。介绍了国内外几种主要的植入式硅基神经微电极的结构特点、制备方法和性能特点。分析表明，未来通过不断结构优化和改性修饰，特别是在高通量的神经记录方面，通过与同样基于硅材料的电路的集成，硅神经微电极能够进一步提高生物相容性，解决大规模的电极通道体内外传输与连接问题，实现对神经元的在体大规模长时间记录。     

基于重抽样分布的一类模糊累积和控制图

过程变量在代表产品或服务过程信息时并非完美，而使用模糊数可能是另一较好途径。文章进一步完善模糊累积和控制图，其中使用中心和扩展具有重抽样分布的模糊随机变量，并给出模拟例证。     

An Improved Composite Multiscale Fuzzy Entropy for Feature Extraction of MI-EEG

Motor Imagery Electroencephalography (MI-EEG) has shown good prospects in neurorehabilitation, and the entropy-based nonlinear dynamic methods have been successfully applied to feature extraction of MI-EEG. Especially based on Multiscale Fuzzy Entropy (MFE), the fuzzy entropies of the τ coarse-grained sequences in τ scale are calculated and averaged to develop the Composite MFE (CMFE) with more feature information. However, the coarse-grained process fails to match the nonstationary characteristic of MI-EEG by a mean filtering algorithm. In this paper, CMFE is improved by assigning the different weight factors to the different sample points in the coarse-grained process, i.e., using the weighted mean filters instead of the original mean filters, which is conductive to signal filtering and feature extraction, and the resulting personalized Weighted CMFE (WCMFE) is more suitable to represent the nonstationary MI-EEG for different subjects. All the WCMFEs of multi-channel MI-EEG are fused in serial to construct the feature vector, which is evaluated by a back-propagation neural network. Based on a public dataset, extensive experiments are conducted, yielding a relatively higher classification accuracy by WCMFE, and the statistical significance is examined by two-sample t-test. The results suggest that WCMFE is superior to the other entropy-based and traditional feature extraction methods.     

梯度网络平稳点集合的Hopfield稳定性与吸引域

给出梯度神经网络模型的电路实现 ,证明了网络平稳点集合的全局 Hopfield稳定性。对各个平稳点吸引域的几何估计得到了相关结果 ,这为网络初始输入的数量与方向判定提供了基本的量度参数准则。     

Research on Tracing Evaluation System in Virtual Enterprise Based on Neural Network

The tracing evaluation index system was designed to be used in virtual enterprise and established neural network trace evaluation model. As a result, it was more simple and nicer than the traditional method, so it had wider application foreground.     

基于模糊控制的公路隧道通风控制系统

提出了一种新型的基于模糊控制的公路隧道通风控制系统,将CO浓度值和烟雾浓度值作为系统输入,风机数值作为系统输出。仿真结果显示,这种模糊通风控制系统用在隧道通风控制系统中可以缓解传统的分级式控制的风机频繁启停的问题。     

基于神经网络智能天线的一种波达方向估计方法

该文提出利用径向基函数神经网络来估计无线通信中智能天线的信号到达方向．为了减少输入，利用信号相关阵的对称性质，仅考虑相关阵中的上三角或下三角的部分元素作为网络的输入量，计算量较小．计算机模拟结果表明，该方案是有效的．     

模糊关系运算的传递性

详细讨论模糊关系一元及二元运算的传递性性质。首先给定一个模糊关系具有某种传递性性质，讨论其余关系、逆关系、对偶关系的传递性性质；然后基于两个模糊关系具有某类传递性，讨论它僮的模并、模交运算的传递性性质。