Dynamics of map-based neuronal network with modified spike-timing-dependent plasticity

The effect of adaptive coupling is studied in a neural network of randomly-coupled Rulkov maps. As an adaptive mechanism, we propose a modified spike-timing-dependent plasticity (STDP) rule with implemented homeostatic property. The comparison of the results of classical and modified STDP shows that the implication of homeostatic property results in significant changes in the network dynamics. Moreover, the neural network with modified STPD demonstrates much more pronounced dynamical changes when internal noise and stimulus amplitudes are varied. The use of the modified rule also leads to decreasing coherence and characteristic correlation time in the system.     

Channel noise-induced temporal coherence transitions and synchronization transitions in adaptive neuronal networks with time delay

Using spike-timing-dependent plasticity (STDP), we study the effect of channel noise on temporal coherence and synchronization of adaptive scale-free Hodgkin-Huxley neuronal networks with time delay. It is found that the spiking regularity and spatial synchronization of the neurons intermittently increase and decrease as channel noise intensity is varied, exhibiting transitions of temporal coherence and synchronization. Moreover, this phenomenon depends on time delay, STDP, and network average degree. As time delay increases, the phenomenon is weakened, however, there are optimal STDP and network average degree by which the phenomenon becomes strongest. These results show that channel noise can intermittently enhance the temporal coherence and synchronization of the delayed adaptive neuronal networks. These findings provide a new insight into channel noise for the information processing and transmission in neural systems.     

Synaptic plasticity and classical conditioning mimicked in single indium-tungsten-oxide based neuromorphic transistor

Emulation of synaptic function by ionic/electronic hybrid device is crucial for brain-like computing and neuromorphic systems. Electric-double-layer(EDL) transistors with proton conducting electrolytes as the gate dielectrics provide a prospective approach for such application. Here, artificial synapses based on indium-tungsten-oxide(IWO)-based EDL transistors are proposed, and some important synaptic functions(excitatory post-synaptic current, paired-pulse facilitation,filtering) are emulated. Two types of spike-timing-dependent plasticity(Hebbian STDP and anti-Hebbian STDP) learning rules and multistore memory(sensory memory, short-term memory, and long-term memory) are also mimicked. At last, classical conditioning is successfully demonstrated. Our results indicate that IWO-based neuromorphic transistors are interesting for neuromorphic applications.     

Effect of spike-timing-dependent plasticity on coherence resonance and synchronization transitions by time delay in adaptive neuronal networks

In this paper, we numerically study how time delay induces multiple coherence resonance (MCR) and synchronization transitions (ST) in adaptive Hodgkin-Huxley neuronal networks with spike-timing dependent plasticity (STDP). It is found that MCR induced by time delay STDP can be either enhanced or suppressed as the adjusting rate A_p of STDP changes, and ST by time delay varies with the increase of A_p, and there is optimal A_p by which the ST becomes strongest. It is also found that there are optimal network randomness and network size by which ST by time delay becomes strongest, and when A_p increases, the optimal network randomness and optimal network size increase and related ST is enhanced. These results show that STDP can either enhance or suppress MCR and optimal STDP can enhance ST induced by time delay in the adaptive neuronal networks. These findings provide a new insight into STDP’s role for the information processing and transmission in neural systems.     

Improvement of signal transmission through spike-timing-dependent plasticity in neural networks

We explore the effects of spike-timing-dependent plasticity (STDP) on weak signal transmission in a noisy neural network. We first consider the network where an ensemble of independent neurons, which are subjected to a common weak signal, are connected in parallel to a single postsynaptic neuron via excitatory synapses. STDP can make the signal transmission more efficient, and this effect is more prominent when the presynaptic activities exhibit some correlations. We further consider a two-layer network where there are only couplings between two layers and find that postsynaptic neurons can fire synchronously under suitable conditions. Both the reliability and timing precision of neuronal firing in the output layer are remarkably improved with STDP. These results indicate that STDP can play crucial roles in information processing in nervous systems.Received: 23 March 2004, Published online: 12 July 2004PACS: 87.18.Sn Neural networks - 87.17.Aa Theory and modeling; computer simulation     

基于抑制性突触可塑性的神经元放电率自稳态机制

神经元放电率自稳态是指大脑神经网络的放电率维持在相对稳定的状态.大量实验研究发现神经元放电率自稳态是神经电活动的重要特征,并且放电率自稳态是实现神经信息处理及维持正常脑功能的基础,因此放电率自稳态的研究是神经科学领域的重要科学问题.脑神经网络是一个高度复杂的动态系统,存在大量输入扰动信号及由于动态链接导致的参数摄动,因此如何建立并维持神经元放电率自稳态及其鲁棒性仍有待深入研究.反馈神经回路是皮层神经网络的典型连接模式,抑制性突触可塑性对神经元放电率自稳态具有重要的调控作用.本文通过构建包含抑制性突触可塑性的反馈神经回路模型对神经元放电率自稳态及其鲁棒性进行计算研究.结果表明:在抑制性突触可塑性的作用下,神经元放电率可自适应地跟踪目标放电率,从而取得放电率自稳态;在有外部输入干扰和参数摄动的情况下,神经元放电率具有良好的抗扰动性能,表明放电率自稳态具有很强的鲁棒性;理论分析揭示了抑制性突触可塑性学习规则是神经元放电率自稳态的神经机制;仿真分析进一步揭示了学习率及目标放电率对放电率自稳态建立过程具有重要影响.     

Plasticity-induced characteristic changes of pattern dynamics and the related phase transitions in small-world neuronal networks

Phase transitions widely exist in nature and occur when some control parameters are changed. In neural systems, their macroscopic states are represented by the activity states of neuron populations, and phase transitions between different activity states are closely related to corresponding functions in the brain. In particular, phase transitions to some rhythmic synchronous firing states play significant roles on diverse brain functions and disfunctions, such as encoding rhythmical external stimuli, epileptic seizure, etc. However, in previous studies, phase transitions in neuronal networks are almost driven by network parameters （e.g., external stimuli）, and there has been no investigation about the transitions between typical activity states of neuronal networks in a self-organized way by applying plastic connection weights. In this paper, we discuss phase transitions in electrically coupled and lattice-based small-world neuronal networks （LBSW networks） under spike-timing-dependent plasticity （STDP）. By applying STDP on all electrical synapses, various known and novel phase transitions could emerge in LBSW networks, particularly, the phenomenon of self-organized phase transitions （SOPTs）： repeated transitions between synchronous and asynchronous firing states. We further explore the mechanics generating SOPTs on the basis of synaptic weight dynamics.     

Learning and structure of neuronal networks

We study the effect of learning dynamics on network topology. Firstly, a network of discrete dynamical systems is considered for this purpose and the coupling strengths are made to evolve according to a temporal learning rule that is based on the paradigm of spike-time-dependent plasticity (STDP). This incorporates necessary competition between different edges. The final network we obtain is robust and has a broad degree distribution. Then we study the dynamics of the structure of a formal neural network. For properly chosen input signals, there exists a steady state with a residual network. We compare the motif profile of such a network with that of the real neural network of C. elegans and identify robust qualitative similarities. In particular, our extensive numerical simulations show that this STDP-driven resulting network is robust under variations of model parameters.     

Equalization of synaptic efficacy by synchronous neural activity

It is commonly believed that spike timings of a postsynaptic neuron tend to follow those of the presynaptic neuron. Such orthodromic firing may, however, cause a conflict with the functional integrity of complex neuronal networks due to asymmetric temporal Hebbian plasticity. We argue that reversed spike timing in a synapse is a typical phenomenon in the cortex, which has a stabilizing effect on the neuronal network structure. We further demonstrate how the firing causality in a synapse is perturbed by synchronous neural activity and how the equilibrium property of spike-timing dependent plasticity is determined principally by the degree of synchronization. Remarkably, even noise-induced activity and synchrony of neurons can result in equalization of synaptic efficacy.     

Tomographic-probability description of solitons in Bose-Einstein condensates

The influence of a weight-dependent spike-timing dependent plasticity (STDP) rule on the temporal evolution and equilibrium state of a certain synapse is investigated. We show that under certain conditions, a spike-induced rate-learning scheme could be achieved. Through studying the situation when a single Hodgkin-Huxley neuron is driven by a large ensemble of input neurons, we find that synchronized firing of a sub population of input neurons may be important to information processing in the nervous system. Using simulations, we show that the temporal structure of the spike trains of these synchronized input neurons can be transmitted reliably; further, synapses from these neurons will increase stably due to the STDP rule and this may provide a mechanism for learning and information storage in biologically plausible network models. Received 12 September 2002 / Received in final form 12 December 2002 Published online 14 February 2003 RID="a" ID="a"e-mail: huang_yue@netease.com     

Beyond Hebb: exclusive-OR and biological learning

A learning algorithm for multilayer neural networks based on biologically plausible mechanisms is studied. Motivated by findings in experimental neurobiology, we consider synaptic averaging in the induction of plasticity changes, which happen on a slower time scale than firing dynamics. This mechanism is shown to enable learning of the exclusive-OR (XOR) problem without the aid of error backpropagation, as well as to increase robustness of learning in the presence of noise.     

Topological probability and connection strength induced activity in complex neural networks

Recent experimental evidence suggests that some brain activities can be assigned to small-world networks. In this work, we investigate how the topological probability p and connection strength C affect the activities of discrete neural networks with small-world (SW) connections. Network elements are described by two-dimensional map neurons (2DMNs) with the values of parameters at which no activity occurs. It is found that when the value of p is smaller or larger, there are no active neurons in the network, no matter what the value of connection strength is; for a given appropriate connection strength, there is an intermediate range of topological probability where the activity of 2DMN network is induced and enhanced. On the other hand, for a given intermediate topological probability level, there exists an optimal value of connection strength such that the frequency of activity reaches its maximum. The possible mechanism behind the action of topological probability and connection strength is addressed based on the bifurcation method. Furthermore, the effects of noise and transmission delay on the activity of neural network are also studied.     

Network response synchronization enhanced by synaptic plasticity

Synchronization of neural network response on spatially localized periodic stimulation was studied. The network consisted of synaptically coupled spiking neurons with spike-timing-dependent synaptic plasticity (STDP). Network connectivity was defined by time evolving matrix of synaptic weights. We found that the steady-state spatial pattern of the weights could be rearranged due to locally applied external periodic stimulation. A method for visualization of synaptic weights as vector field was introduced to monitor the evolving connectivity matrix. We demonstrated that changes in the vector field and associated weight rearrangements underlay an enhancement of synchronization range.     

STDP-driven networks and the C. elegans neuronal network

We study the dynamics of the structure of a formal neural network wherein the strengths of the synapses are governed by spike-timing-dependent plasticity (STDP). For properly chosen input signals, there exists a steady state with a residual network. We compare the motif profile of such a network with that of a real neural network of C. elegans and identify robust qualitative similarities. In particular, our extensive numerical simulations show that this STDP-driven resulting network is robust under variations of the model parameters.     

Functional holography analysis: simplifying the complexity of dynamical networks

We present a novel functional holography (FH) analysis devised to study the dynamics of task-performing dynamical networks. The latter term refers to networks composed of dynamical systems or elements, like gene networks or neural networks. The new approach is based on the realization that task-performing networks follow some underlying principles that are reflected in their activity. Therefore, the analysis is designed to decipher the existence of simple causal motives that are expected to be embedded in the observed complex activity of the networks under study. First we evaluate the matrix of similarities (correlations) between the activities of the network's components. We then perform collective normalization of the similarities (or affinity transformation) to construct a matrix of functional correlations. Using dimension reduction algorithms on the affinity matrix, the matrix is projected onto a principal three-dimensional space of the leading eigenvectors computed by the algorithm. To retrieve back information that is lost in the dimension reduction, we connect the nodes by colored lines that represent the level of the similarities to construct a holographic network in the principal space. Next we calculate the activity propagation in the network (temporal ordering) using different methods like temporal center of mass and cross correlations. The causal information is superimposed on the holographic network by coloring the nodes locations according to the temporal ordering of their activities. First, we illustrate the analysis for simple, artificially constructed examples. Then we demonstrate that by applying the FH analysis to modeled and real neural networks as well as recorded brain activity, hidden causal manifolds with simple yet characteristic geometrical and topological features are deciphered in the complex activity. The term "functional holography" is used to indicate that the goal of the analysis is to extract the maximum amount of functional information about the dynamical network as a whole unit.     

Self-sustained firing activities of the cortical network with plastic rules in weak AC electrical fields

Both external and endogenous electrical fields widely exist in the environment of cortical neurons. The effects of a weak alternating current (AC) field on a neural network model with synaptic plasticity are studied. It is found that self-sustained rhythmic firing patterns, which are closely correlated with the cognitive functions, are significantly modified due to the self-organizing of the network in the weak AC field. The activities of the neural networks are affected by the synaptic connection strength, the external stimuli, and so on. In the presence of learning rules, the synaptic connections can be modulated by the external stimuli, which will further enhance the sensitivity of the network to the external signal. The properties of the external AC stimuli can serve as control parameters in modulating the evolution of the neural network.     

Neuronal avalanches of a self-organized neural network with active-neuron-dominant structure

Neuronal avalanche is a spontaneous neuronal activity which obeys a power-law distribution of population event sizes with an exponent of -3/2. It has been observed in the superficial layers of cortex both in vivo and in vitro. In this paper, we analyze the information transmission of a novel self-organized neural network with active-neuron-dominant structure. Neuronal avalanches can be observed in this network with appropriate input intensity. We find that the process of network learning via spike-timing dependent plasticity dramatically increases the complexity of network structure, which is finally self-organized to be active-neuron-dominant connectivity. Both the entropy of activity patterns and the complexity of their resulting post-synaptic inputs are maximized when the network dynamics are propagated as neuronal avalanches. This emergent topology is beneficial for information transmission with high efficiency and also could be responsible for the large information capacity of this network compared with alternative archetypal networks with different neural connectivity.     

Synaptic behaviors of a single metal–oxide–metal resistive device

The mammalian brain is far superior to today’s electronic circuits in intelligence and efficiency. Its functions are realized by the network of neurons connected via synapses. Much effort has been extended in finding satisfactory electronic neural networks that act like brains, i.e., especially the electronic version of synapse that is capable of the weight control and is independent of the external data storage. We demonstrate experimentally that a single metal–oxide–metal structure successfully stores the biological synaptic weight variations (synaptic plasticity) without any external storage node or circuit. Our device also demonstrates the reliability of plasticity experimentally with the model considering the time dependence of spikes. All these properties are embodied by the change of resistance level corresponding to the history of injected voltage-pulse signals. Moreover, we prove the capability of second-order learning of the multi-resistive device by applying it to the circuit composed of transistors. We anticipate our demonstration will invigorate the study of electronic neural networks using non-volatile multi-resistive device, which is simpler and superior compared to other storage devices.     

Synaptic plasticity modulates autonomous transitions between waking and sleep states: insights from a Morris-Lecar model

The transitions between waking and sleep states are characterized by considerable changes in neuronal firing. During waking, neurons fire tonically at irregular intervals and a desynchronized activity is observed at the electroencephalogram. This activity becomes synchronized with slow wave sleep onset when neurons start to oscillate between periods of firing (up-states) and periods of silence (down-states). Recently, it has been proposed that the connections between neurons undergo potentiation during waking, whereas they weaken during slow wave sleep. Here, we propose a dynamical model to describe basic features of the autonomous transitions between such states. We consider a network of coupled neurons in which the strength of the interactions is modulated by synaptic long term potentiation and depression, according to the spike time-dependent plasticity rule (STDP). The model shows that the enhancement of synaptic strength between neurons occurring in waking increases the propensity of the network to synchronize and, conversely, desynchronization appears when the strength of the connections become weaker. Both transitions appear spontaneously, but the transition from sleep to waking required a slight modification of the STDP rule with the introduction of a mechanism which becomes active during sleep and changes the proportion between potentiation and depression in accordance with biological data. At the neuron level, transitions from desynchronization to synchronization and vice versa can be described as a bifurcation between two different states, whose dynamical regime is modulated by synaptic strengths, thus suggesting that transition from a state to an another can be determined by quantitative differences between potentiation and depression.     

Sparse coding for layered neural networks

We investigate storage capacity of two types of fully connected layered neural networks with sparse coding when binary patterns are embedded into the networks by a Hebbian learning rule. One of them is a layered network, in which a transfer function of even layers is different from that of odd layers. The other is a layered network with intra-layer connections, in which the transfer function of inter-layer is different from that of intra-layer, and inter-layered neurons and intra-layered neurons are updated alternately. We derive recursion relations for order parameters by means of the signal-to-noise ratio method, and then apply the self-control threshold method proposed by Dominguez and Bollé to both layered networks with monotonic transfer functions. We find that a critical value _C of storage capacity is about 0.11|a ln a|⁻¹ (a1) for both layered networks, where a is a neuronal activity. It turns out that the basin of attraction is larger for both layered networks when the self-control threshold method is applied.