Hyperparameter on-line learning of stochastic resonance based threshold networks

Aiming at training the feed-forward threshold neural network consisting of nondifferentiable activation functions, the approach of noise injection forms a stochastic resonance based threshold network that can be optimized by various gradient-based optimizers. The introduction of injected noise extends the noise level into the parameter space of the designed threshold network, but leads to a highly non-convex optimization landscape of the loss function. Thus, the hyperparameter on-line learning procedure with respective to network weights and noise levels becomes of challenge. It is shown that the Adam optimizer, as an adaptive variant of stochastic gradient descent, manifests its superior learning ability in training the stochastic resonance based threshold network effectively. Experimental results demonstrate the significant improvement of performance of the designed threshold network trained by the Adam optimizer for function approximation and image classification.     

What is the optimal cutoff surface for ore bodies with more than one mineral?

In mine planning problems, cutoff grade optimization defines a threshold at every time period such that material above this value is processed, and the rest is considered waste. In orebodies with multiple minerals, which occur in practice, the natural extension is to consider a cutoff surface. We show that in two dimensions the optimal solution is a line, and in n dimensions it is a hyperplane.     

基于深度学习的中医古文献临床经验抽取

中医古文献蕴藏着丰富的临床经验，是古代中医在行医过程中对临床诊疗的经验性总结，体现了中医学形成和发展的理论框架和思想基础.然而这些宝贵的临床经验不仅量大，而且分散在不同的文献中，使得中医从业者手工很难快速全面地获取它们，文献检索工具也只能提供文档级别的信息筛选，无法为这种细粒度的信息获取提供支持.此外，古汉语相对于现代汉语的不同特点也限制了主流文本分析工具的使用效果.为此本文提出面向临床经验获取的中医古文献信息抽取任务，用于识别古文献中描述临床经验的文本片段，手工标注了样本数据用于这种抽取模型的训练和测试，并设计了基于深度学习的序列标注器用于完成该任务.考虑到标注数据量小可能带来的过度拟合问题，本文引入对抗训练和虚拟对抗训练来增强模型的泛化能力.一系列充分的实验验证了模型的有效性，表明利用信息抽取技术从古文献获取中医临床经验具有可行性，为这一新的信息抽取任务提供了有希望的研究基线和可复用的标注数据集.     

The Picone identity: A device to get optimal uniqueness results and global dynamics in Population Dynamics

This paper infers from a generalized Picone identity the uniqueness of the stable positive solution for a class of semilinear equations of superlinear indefinite type, as well as the uniqueness and global attractivity of the coexistence state in two generalized diffusive prototypes of the symbiotic and competing species models of Lotka–Volterra. The optimality of these uniqueness theorems reveals the tremendous strength of the Picone identity.     

Regularity of optimal sets for some functional involving eigenvalues of an operator in divergence form

In this paper we consider minimizers of the functional$\min \{{\lambda }_1(\mathrm{\Omega })+\cdots +{\lambda }_k(\mathrm{\Omega })+\mathrm{\Lambda }|\mathrm{\Omega }|,:\mathrm{\Omega }\subset D\text{ open}\}$ where $D\subset {\mathbb{R}}^d$ is a bounded open set and where $0<{\lambda }_1(\mathrm{\Omega })\le \cdots \le {\lambda }_k(\mathrm{\Omega })$ are the first k eigenvalues on Ω of an operator in divergence form with Dirichlet boundary condition and with Hölder continuous coefficients. We prove that the optimal sets ${\mathrm{\Omega }}^{⁎}$ have finite perimeter and that their free boundary $\partial {\mathrm{\Omega }}^{⁎}\cap D$ is composed of a regular part, which is locally the graph of a $C^{1,\alpha }$-regular function, and a singular part, which is empty if $d<d^{⁎}$, discrete if $d=d^{⁎}$ and of Hausdorff dimension at most $d-d^{⁎}$ if $d>d^{⁎}$, for some $d^{⁎}\in \{5,6,7\}$.     

基于GA_XGBoost模型的大学生科研能力预测问题研究

科学评价大学生科研创新能力对我国科研水平的提高具有重要意义.采用机器学习模型来预测大学生科研能力可以起到良好的效果,提出一种GAXGBoost模型来实现对大学生的科研能力预测.此模型是以Xgboost算法为基础,然后充分利用遗传算法的全局搜索能力自动搜索Xgboost最优超参数,避免了人为经验调参不准确的缺陷,最后采用精英选择策略以此确保每一轮都是最佳的进化结果.通过分析表明,所采用的GAXGBoost模型在大学生科研能力预测的结果中具有很高的精度,将此模型与Logistic Regression、Random Forest、SVM等模型进行对比,GAXGBoost模型的预测精度最高.     

Pattern transition and regulation in a subthalamopallidal network under electromagnetic effect

Although the significant roles of magnetic induction and electromagnetic radiation in the neural system have been widely studied, their influence on Parkinson's disease (PD) has yet to be well explored. By virtue of the magnetic flux variable, this paper studies the transition of firing patterns induced by magnetic induction and the regulation effect of external magnetic radiation on the firing activities of the subthalamopallidal network in basal ganglia. We find: (i) The network reproduces five typical waveforms corresponding to the severity of symptoms: weak cluster, episodic, continuous cluster, episodic, and continuous wave. (ii) Magnetic induction is a double-edged sword for the treatment of PD. Although the increase of magnetic coefficient may lead the physiological firing activity to transfer to pathological firing activity, it also can regulate the pathological intensity firing activity with excessive β-band power transferring to the physiological firing pattern with weak β-band power. (iii) External magnetic radiation could inhibit continuous tremulous firing and β-band power of subthalamic nucleus (STN), which means the severity of symptoms weakened. Especially, the bi-parameter plane of the regulation region shows that a short pulse period of magnetic radiation and a medium level of pulse percentage can well regulate pathological oscillation. This work helps to understand the firing activity of the subthalamopallidal network under electromagnetic effect. It may also provide insights into the mechanisms behind the electromagnetic therapy of PD-related firing activity.