Hyperparameter on-line learning of stochastic resonance based threshold networks

Aiming at training the feed-forward threshold neural network consisting of nondifferentiable activation functions, the approach of noise injection forms a stochastic resonance based threshold network that can be optimized by various gradient-based optimizers. The introduction of injected noise extends the noise level into the parameter space of the designed threshold network, but leads to a highly non-convex optimization landscape of the loss function. Thus, the hyperparameter on-line learning procedure with respective to network weights and noise levels becomes of challenge. It is shown that the Adam optimizer, as an adaptive variant of stochastic gradient descent, manifests its superior learning ability in training the stochastic resonance based threshold network effectively. Experimental results demonstrate the significant improvement of performance of the designed threshold network trained by the Adam optimizer for function approximation and image classification.     

卷积神经网络用于近红外光谱古筝面板木材分级

目前,我国乐器制作行业在古筝面板用木材等级的筛选上主要依赖于技师主观评判,但此法缺少科学理论的依据,效率低,客观性及出材率的提高等方面受到限制,无法满足乐器市场的大量需求。实现古筝面板用木材快速、智能化的分级工作是一个急需解决的课题。近红外光谱非常适用于测量含氢的有机物质。古筝面板木材主要化学成分的化学键均由含氢基团组成,不同等级板材的化学成分存在差异,这些差异反映在近红外光谱中,为判断木材等级提供了可能。同时卷积神经网络对非线性数据具有较强的特征提取能力,所以提出一种应用卷积神经网络模型对光谱数据进行分析的方法,进而判别木材的等级。应用了Savitzky Golay一阶、二阶微分两种预处理方法和核主成分分析、连续投影算法两种数据压缩方法,通过所设计的卷积神经网络模型以样本识别准确率和模型构建过程中的损失值作为判定指标选出最佳预处理和数据压缩方法。为了提高模型提取分析光谱数据的能力和避免过拟合现象,应用了多通道卷积核、批量归一化和early stopping策略,将通过两层卷积层提取的特征信息送入全连接层,从而充分提取剩余信息,通过Softmax函数获得板材的最终预测等级,从而确定了最终模型。最终Savitzky Golay一阶微分和核主成分分析为最佳数据处理方法,同时得出用于区分不同等级的古筝面板用木材的主要关键谱带,分别为1 163~1 243, 1 346~1 375和1 525~1 584 nm。将该模型应用于测试集样本,古筝面板用木材的等级识别准确率为95.5%。实验结果表明所提出的方法可以高效地处理光谱数据,有效识别区分不同等级的古筝面板用木材的关键特征,从而为广阔的乐器市场提供一定的技术支持。     

Current air quality analytics and monitoring: A review

This review summarizes the different tools and concepts that are commonly applied in air quality monitoring. The monitoring of atmosphere is extremely important as the air quality is an important problem for large communities. Main requirements for analytical devices used for monitoring include a long period of autonomic operation and portability. These instruments, however, are often characterized by poor analytical performance. Monitoring networks are the most common tools used for monitoring, so large-scale monitoring programmes are summarized here. Biomonitoring, as a cheap and convenient alternative to traditional sample collection, is becoming more and more popular, although its main drawback is the lack of standard procedures. Telemonitoring is another approach to air monitoring, which offers some interesting opportunities, such as ease of coverage of large or remote areas, constituting a complementary approach to traditional strategies; however, it requires huge costs.     

Approximate Entropy of Brain Network in the Study of Hemispheric Differences

Human brain, a dynamic complex system, can be studied with different approaches, including linear and nonlinear ones. One of the nonlinear approaches widely used in electroencephalographic (EEG) analyses is the entropy, the measurement of disorder in a system. The present study investigates brain networks applying approximate entropy (ApEn) measure for assessing the hemispheric EEG differences; reproducibility and stability of ApEn data across separate recording sessions were evaluated. Twenty healthy adult volunteers were submitted to eyes-closed resting EEG recordings, for 80 recordings. Significant differences in the occipital region, with higher values of entropy in the left hemisphere than in the right one, show that the hemispheres become active with different intensities according to the performed function. Besides, the present methodology proved to be reproducible and stable, when carried out on relatively brief EEG epochs but also at a 1-week distance in a group of 36 subjects. Nonlinear approaches represent an interesting probe to study the dynamics of brain networks. ApEn technique might provide more insight into the pathophysiological processes underlying age-related brain disconnection as well as for monitoring the impact of pharmacological and rehabilitation treatments.     

矩阵的广义特征值及特征向量的神经网络方法

矩阵特征值及特征向量计算在实际问题中有广泛的应用.应用神经网络方法来计算广义特征值及对应的特征向量,给出了相应的算法,并对给出的算法在数学上进行了严格证明.并用实例验证了其正确性.     

Stabilizing management of fluctuating resources

We consider a resource management problem in which the management objective is to minimize fluctuations in resource stocks. Stabilizing management policies constitute the designing of memoryless state feedback control strategies for a discrete time resource model which contains unknown but bounded fluctuations. We also show that the problem of maximizing sustainable yield in an uncertain fishery can be considered as the problem of stabilizing of the stock level.The paper corresponds to an invited talk at the 14th Symposium on Operations Research, Ulm, September 6–8, 1989.The support by Yrjö Jahnsson Foundation is gratefully acknowledged.This work was supported by NSF and AFOSR under grant ECS 8602524.     

Toward Fuzzy Optimization without Mathematical Ambiguity

Fuzzy programming has been discussed widely in literature and applied in such various disciplines as operations research, economic management, business administration, and engineering. The main purpose of this paper is to present a brief review on fuzzy programming models, and classify them into three broad classes: expected value model, chance-constrained programming and dependent-chance programming. In order to solve general fuzzy programming models, a hybrid intelligent algorithm is also documented. Finally, some related topics are discussed.     

Unified Model for Generation Complex Networks with Utility Preferential Attachment

In this paper, based on the utility preferential attachment, we propose a new unified model to generate different network topologies such as scale-free, small-world and random networks. Moreover, a new network structure named super scale network is found, which has monopoly characteristic in our simulation experiments. Finally, the characteristics ofthis new network are given.