A New Chaotic Parameters Disturbance Annealing Neural Network for Solving Global Optimization Problems

Since there were few chaotic neural networks applicable to the global optimization, in this paper, we proposea new neural network model - chaotic parameters disturbance annealing (CPDA) network, which is superior to otherexisting neural networks, genetic algorithms, and simulated annealing algorithms in global optimization. In the presentCPDA network, we add some chaotic parameters in the energy function, which make the Hopfield neural network escapefrom the attraction of a local minimal solution and with the parameter p1 annealing, our model will converge to theglobal optimal solutions quickly and steadily. The converge ability and other characters are also analyzed in this paper.The benchmark examples show the present CPDA neuralnetwork's merits in nonlinear global optimization.     

基于混沌神经网络的盲检测改进新算法

针对Hopfield神经网络的多起点问题,提出了一种新的基于混沌神经网络的盲信号检测算法,实现了二进制移相键控信号盲检测.据此进一步提出双sigmoid混沌神经网络模型,构造了新的能量函数,且证明了该模型的稳定性,并对网络参数进行配置.仿真实验表明:混沌神经网络能够避免局部极小点且具备较强的抗噪性能,双sigmoid混沌神经网络则继承了其所有的优点,且其收敛速度更快,仅需更短的接收数据即可到达全局真实平衡点,从而降低了算法的计算复杂度,减少了运行时间.     

Complex network perspective on modelling chaotic systems via machine learning

Recent advances have demonstrated that a machine learning technique known as "reservoir computing" is a significantly effective method for modelling chaotic systems. Going beyond short-term prediction, we show that long-term behaviors of an observed chaotic system are also preserved in the trained reservoir system by virtue of network measurements. Specifically, we find that a broad range of network statistics induced from the trained reservoir system is nearly identical with that of a learned chaotic system of interest. Moreover, we show that network measurements of the trained reservoir system are sensitive to distinct dynamics and can in turn detect the dynamical transitions in complex systems. Our findings further support that rather than dynamical equations, reservoir computing approach in fact provides an alternative way for modelling chaotic systems.     

基于改进教学优化算法的Hermite正交基神经网络混沌时间序列预测

针对传统预测模型对混沌时间序列预测精度低、收敛速度慢及模型结构复杂的问题, 提出了基于改进教学优化算法的Hermite正交基神经网络预测模型. 首先, 将自相关法和Cao方法相结合对混沌时间序列进行相空间重构, 以获得重构延迟时间向量; 其次, 以Hermite正交基函数为激励函数构成Hermite正交基神经网络, 作为预测模型; 最后, 将模型参数优化问题转化为多维空间上的函数优化问题, 利用改进教学优化算法对预测模型进行参数优化, 以建立预测模型并进行预测分析. 分别以Lorenz 系统和Liu系统为模型, 通过四阶Runge-Kutta法产生混沌时间序列作为仿真对象, 并进行单步及多步预测对比实验. 仿真结果表明, 与径向基函数神经网络、回声状态网络、最小二乘支持向量机及基于教学优化算法的Hermite正交基神经网络预测模型相比, 所提预测模型具有更高的预测精度、更快的收敛速度和更简单的模型结构, 验证了该模型的高效性, 便于推广和应用.     

Transversal homoclinic orbits in a transiently chaotic neural network

We study the existence of snap-back repellers, hence the existence of transversal homoclinic orbits in a discrete-time neural network. Chaotic behaviors for the network system in the sense of Li and Yorke or Marotto can then be concluded. The result is established by analyzing the structures of the system and allocating suitable parameters in constructing the fixed points and their pre-images for the system. The investigation provides a theoretical confirmation on the scenario of transient chaos for the system. All the parameter conditions for the theory can be examined numerically. The numerical ranges for the parameters which yield chaotic dynamics and convergent dynamics provide significant information in the annealing process in solving combinatorial optimization problems using this transiently chaotic neural network. (c) 2002 American Institute of Physics.     

Application of the edge of chaos in combinatorial optimization

Many problems in science, engineering and real life are related to the combinatorial optimization. However, many combinatorial optimization problems belong to a class of the NP-hard problems, and their globally optimal solutions are usually difficult to solve. Therefore, great attention has been attracted to the algorithms of searching the globally optimal solution or near-optimal solution for the combinatorial optimization problems. As a typical combinatorial optimization problem, the traveling salesman problem(TSP) often serves as a touchstone for novel approaches. It has been found that natural systems, particularly brain nervous systems, work at the critical region between order and disorder, namely,on the edge of chaos. In this work, an algorithm for the combinatorial optimization problems is proposed based on the neural networks on the edge of chaos(ECNN). The algorithm is then applied to TSPs of 10 cities, 21 cities, 48 cities and 70 cities. The results show that ECNN algorithm has strong ability to drive the networks away from local minimums.Compared with the transiently chaotic neural network(TCNN), the stochastic chaotic neural network(SCNN) algorithms and other optimization algorithms, much higher rates of globally optimal solutions and near-optimal solutions are obtained with ECNN algorithm. To conclude, our algorithm provides an effective way for solving the combinatorial optimization problems.     

Analog computation through high-dimensional physical chaotic neuro-dynamics

Conventional von Neumann computers have difficulty in solving complex and ill-posed real-world problems. However, living organisms often face such problems in real life, and must quickly obtain suitable solutions through physical, dynamical, and collective computations involving vast assemblies of neurons. These highly parallel computations through high-dimensional dynamics (computation through dynamics) are completely different from the numerical computations on von Neumann computers (computation through algorithms). In this paper, we explore a novel computational mechanism with high-dimensional physical chaotic neuro-dynamics. We physically constructed two hardware prototypes using analog chaotic-neuron integrated circuits. These systems combine analog computations with chaotic neuro-dynamics and digital computation through algorithms. We used quadratic assignment problems (QAPs) as benchmarks. The first prototype utilizes an analog chaotic neural network with 800-dimensional dynamics. An external algorithm constructs a solution for a QAP using the internal dynamics of the network. In the second system, 300-dimensional analog chaotic neuro-dynamics drive a tabu-search algorithm. We demonstrate experimentally that both systems efficiently solve QAPs through physical chaotic dynamics. We also qualitatively analyze the underlying mechanism of the highly parallel and collective analog computations by observing global and local dynamics. Furthermore, we introduce spatial and temporal mutual information to quantitatively evaluate the system dynamics. The experimental results confirm the validity and efficiency of the proposed computational paradigm with the physical analog chaotic neuro-dynamics.     

含不确定性混沌系统的模糊自适应同步

研究了含不确定性混沌系统的同步问题.基于Takagi-Sugeno(T-S)模糊动态模型，给出了一个新的自适应模糊同步控制设计方法.该方法同时适用于相同结构混沌系统的同步以及异构混沌系统的同步.为说明问题，给出了Lorenz混沌系统和Rossler混沌系统的同步控制设计和仿真结果. 关键词： 混沌系统 模糊控制 同步     

不确定混沌系统的径向基函数神经网络反馈补偿控制

对不确定混沌系统控制问题, 研究了一种基于径向基函数神经网络(radial basis function neural network, RBFNN)的反馈补偿控制方法. 该方法首先用RBFNN对混沌系统的动力学特性进行学习, 然后用训练好的RBFNN模型对混沌系统进行反馈补偿控制. 该方法的特点是不需要被控混沌系统的数学模型,可以快速跟踪任意给定的参考信号. 数值仿真试验表明了该控制方法不仅具有响应速度快、控制精度高, 而且具有较强的抑制混沌系统参数摄动能力和抗干扰能力.     

基于混合神经网络和注意力机制的混沌时间序列预测

为提高混沌时间序列的预测精度,提出一种基于混合神经网络和注意力机制的预测模型(Att-CNNLSTM),首先对混沌时间序列进行相空间重构和数据归一化,然后利用卷积神经网络(CNN)对时间序列的重构相空间进行空间特征提取,再将CNN提取的特征和原时间序列组合,用长短期记忆网络(LSTM)根据空间特征提取时间特征,最后通过注意力机制捕获时间序列的关键时空特征,给出最终预测结果.将该模型对Logistic,Lorenz和太阳黑子混沌时间序列进行预测实验,并与未引入注意力机制的CNN-LSTM模型、单一的CNN和LSTM网络模型、以及传统的机器学习算法最小二乘支持向量机(LSSVM)的预测性能进行比较.实验结果显示本文提出的预测模型预测误差低于其他模型,预测精度更高.     

不确定分数阶时滞混沌系统自适应神经网络同步控制

针对带有完全未知的非线性不确定项和外界扰动的异结构分数阶时滞混沌系统的同步问题,基于Lyapunov稳定性理论,设计了自适应径向基函数(radial basis function,RBF)神经网络控制器以及整数阶的参数自适应律.该控制器结合了RBF神经网络和自适应控制技术,RBF神经网络用来逼近未知非线性函数,自适应律用于调整控制器中相应的参数.构造平方Lyapunov函数进行稳定性分析,基于Barbalat引理证明了同步误差渐近趋于零.数值仿真结果表明了该控制器的有效性.     

Adaptive synchronization of a class of fractional-order complex-valued chaotic neural network with time-delay

This paper is concerned with the adaptive synchronization of fractional-order complex-valued chaotic neural networks (FOCVCNNs) with time-delay. The chaotic behaviors of a class of fractional-order complex-valued neural network are investigated. Meanwhile, based on the complex-valued inequalities of fractional-order derivatives and the stability theory of fractional-order complex-valued systems, a new adaptive controller and new complex-valued update laws are proposed to construct a synchronization control model for fractional-order complex-valued chaotic neural networks. Finally, the numerical simulation results are presented to illustrate the effectiveness of the developed synchronization scheme.     

非单色激光场与同位素原子体系相互作用

本文研究了多模激光场与同位素原子体系相互作用动力学问题。采用混沌模型描述多模激光场，用Ｆｏｋｋｅｒ－Ｐｌａｎｃｋ方程方法，导出了有限带宽混沌场与同位素原子体系相互作用动力学方程。分析了激光线宽对同位素原子激发电离效率和选择性因子的影响。     

基于混沌神经网络的单向Hash函数

提出了一种基于混沌神经网络的单向Hash函数，该方法通过使用以混沌分段线性函数作为输出函数的神经网络和基于时空混沌的密钥生成函数实现明文和密钥信息的混淆和扩散，并基于密码块连接模式实现对任意长度的明文序列产生128位的Hash值.理论分析和实验结果表明，提出的Hash函数可满足所要求的单向性，初值和密钥敏感性，抗碰撞性和实时性等要求. 关键词： 混沌神经网络 Hash函数 分段线性混沌映射 时空混沌     

Neural networks and chaos: construction, evaluation of chaotic networks, and prediction of chaos with multilayer feedforward networks

Many research works deal with chaotic neural networks for various fields of application. Unfortunately, up to now, these networks are usually claimed to be chaotic without any mathematical proof. The purpose of this paper is to establish, based on a rigorous theoretical framework, an equivalence between chaotic iterations according to Devaney and a particular class of neural networks. On the one hand, we show how to build such a network, on the other hand, we provide a method to check if a neural network is a chaotic one. Finally, the ability of classical feedforward multilayer perceptrons to learn sets of data obtained from a dynamical system is regarded. Various boolean functions are iterated on finite states. Iterations of some of them are proven to be chaotic as it is defined by Devaney. In that context, important differences occur in the training process, establishing with various neural networks that chaotic behaviors are far more difficult to learn.     

基于液体晃动干扰观测器的航天器混沌姿态H_∞控制

针对航天器受液体燃料晃动及内外周期性微小激励耦合影响产生混沌运动的问题,提出了基于神经网络干扰观测器的自适应H∞鲁棒控制方案,以实现充液航天器混沌姿态运动的消除与液体燃料晃动的抑制.基于神经网络的非线性逼近能力设计干扰观测器,自适应跟踪补偿液体晃动、参数不确定及外扰引起的耦合扰动,解决液体燃料晃动角速度及外扰不易直接测量的问题,提高控制器对系统不确定的自适应能力及液体晃动的抑制能力.同时考虑观测误差与模型不精确问题,利用H∞控制策略提高控制器的鲁棒性.通过与现有常用控制策略的对比仿真研究,验证了控制方案的有效性及优势.     

A Tentative Nonlinear Model for Explanation of a Perceptual Alternation Phenomenon

We present a simple three-neuron Hopfield neural network as a tentative model to illustrate the perspective alternation of Necker cube. This neural network has a chaotic attractor with two "leaves", each leaf can be regarded as a dynamic process corresponding a feature of the Necker cube. This tentative model suggests another manifestation of the role of chaos in information processing.     

基于模糊边界模块化神经网络的混沌时间序列预测

提出一种模糊边界模块化神经网络（FBMNN）的混沌时间序列预测方法,该方法先对混沌时间序列观测点重构的相空间进行模块化划分,划分点的选取由遗传算法自动寻优.然后定义一个模糊隶属度函数,在划分边界一侧按照一定的模糊隶属度设定模糊边界带,通过模糊化处理,解决了各模块划分点附近预测结果的跳跃问题.最后每一模块,及其模糊边界的样本点都对应一个递归神经网络进行训练,通过预测合成模块输出结果.该方法对三个混沌时间序列基准数据集Mackey-Glass,Lorenz,Henon进行实验,结果表明该方法有效地提高了混沌时间序列预测效果. 关键词： 模糊边界 模块化神经网络 混沌时间序列 预测     

Chaotic system optimal tracking using data-based synchronous method with unknown dynamics and disturbances

We develop an optimal tracking control method for chaotic system with unknown dynamics and disturbances. The method allows the optimal cost function and the corresponding tracking control to update synchronously. According to the tracking error and the reference dynamics, the augmented system is constructed. Then the optimal tracking control problem is defined. The policy iteration(PI) is introduced to solve the min-max optimization problem. The off-policy adaptive dynamic programming(ADP) algorithm is then proposed to find the solution of the tracking Hamilton–Jacobi–Isaacs(HJI) equation online only using measured data and without any knowledge about the system dynamics. Critic neural network(CNN), action neural network(ANN), and disturbance neural network(DNN) are used to approximate the cost function, control, and disturbance. The weights of these networks compose the augmented weight matrix, and the uniformly ultimately bounded(UUB) of which is proven. The convergence of the tracking error system is also proven. Two examples are given to show the effectiveness of the proposed synchronous solution method for the chaotic system tracking problem.     

混沌神经动力学行为在多自由度机器人上的应用研究

本文把混沌神经动力学行为应用到了一个多自由度的机器人手臂,利用一种简单的神经编码方法使高维的神经网络模式转化成了低维的运动参数。虽然只在神经网络中嵌入了三种简单的姿势动作,但是在混沌神经动力学行为出现时,机器人手臂呈现出复杂的组合运动。利用这一点,提出了一个简单的控制算法用来解决病态问题(不一定有解或者确定的解无法保证的问题)。实装实验进一步表明,尽管只有粗略甚至不确定的光源信息,利用提出的算法机器人手臂可以成功的寻找到光源。