Dynamically maintained spike timing sequences in networks of pulse-coupled oscillators with delays

We demonstrate the widespread occurrence of dynamically maintained spike timing sequences in recurrent networks of pulse-coupled spiking neurons with large time delays. The sequences occur in transient, quasistable phase-locking states. The system spontaneously jumps between these states. This collective dynamics enables the system to generate a large number of distinct precise spike timing sequences. Distributed time delays play a constructive role by enhancing the dominance in parameter space of the dynamics responsible for producing the large variety of spike timing sequences.     

Limits and Dynamics of Stochastic Neuronal Networks with Random Heterogeneous Delays

Realistic networks display heterogeneous transmission delays. We analyze here the limits of large stochastic multi-populations networks with stochastic coupling and random interconnection delays. We show that depending on the nature of the delays distributions, a quenched or averaged propagation of chaos takes place in these networks, and that the network equations converge towards a delayed McKean-Vlasov equation with distributed delays. Our approach is mostly fitted to neuroscience applications. We instantiate in particular a classical neuronal model, the Wilson and Cowan system, and show that the obtained limit equations have Gaussian solutions whose mean and standard deviation satisfy a closed set of coupled delay differential equations in which the distribution of delays and the noise levels appear as parameters. This allows to uncover precisely the effects of noise, delays and coupling on the dynamics of such heterogeneous networks, in particular their role in the emergence of synchronized oscillations. We show in several examples that not only the averaged delay, but also the dispersion, govern the dynamics of such networks.     

Synchronization of time-delay chaotic systems on small-world networks with delayed coupling

By using the well-known Ikeda model as the node dynamics, this paper studies synchronization of time-delay systems on small-world networks where the connections between units involve time delays. It shows that, in contrast with the undelayed case, networks with delays can actually synchronize more easily. Specifically, for randomly distributed delays, time-delayed mutual coupling suppresses the chaotic behaviour by stabilizing a fixed point that is unstable for the uncoupled dynamical system.     

Delays, connection topology, and synchronization of coupled chaotic maps

We consider networks of coupled maps where the connections between units involve time delays. We show that, similar to the undelayed case, the synchronization of the network depends on the connection topology, characterized by the spectrum of the graph Laplacian. Consequently, scale-free and random networks are capable of synchronizing despite the delayed flow of information, whereas regular networks with nearest-neighbor connections and their small-world variants generally exhibit poor synchronization. On the other hand, connection delays can actually be conducive to synchronization, so that it is possible for the delayed system to synchronize where the undelayed system does not. Furthermore, the delays determine the synchronized dynamics, leading to the emergence of a wide range of new collective behavior which the individual units are incapable of producing in isolation.     

Large Deviations, Dynamics and Phase Transitions in Large Stochastic and Disordered Neural Networks

Neuronal networks are characterized by highly heterogeneous connectivity, and this disorder was recently related experimentally to qualitative properties of the network. The motivation of this paper is to mathematically analyze the role of these disordered connectivities on the large-scale properties of neuronal networks. To this end, we analyze here large-scale limit behaviors of neural networks including, for biological relevance, multiple populations, random connectivities and interaction delays. Due to the randomness of the connectivity, usual mean-field methods (e.g. coupling) cannot be applied, but, similarly to studies developed for spin glasses, we will show that the sequences of empirical measures satisfy a large deviation principle, and converge towards a self-consistent non-Markovian process. From a mathematical viewpoint, the proof differs from previous works in that we are working in infinite-dimensional spaces (interaction delays) and consider multiple cell types. The limit obtained formally characterizes the macroscopic behavior of the network. We propose a dynamical systems approach in order to address the qualitative nature of the solutions of these very complex equations, and apply this methodology to three instances in order to show how non-centered coefficients, interaction delays and multiple populations networks are affected by disorder levels. We identify a number of phase transitions in such systems upon changes in delays, connectivity patterns and dispersion, and particularly focus on the emergence of non-equilibrium states involving synchronized oscillations.     

Design of exponential state estimators for neural networks with mixed time delays

In this Letter, the state estimation problem is dealt with for a class of recurrent neural networks (RNNs) with mixed discrete and distributed delays. The activation functions are assumed to be neither monotonic, nor differentiable, nor bounded. We aim at designing a state estimator to estimate the neuron states, through available output measurements, such that the dynamics of the estimation error is globally exponentially stable in the presence of mixed time delays. By using the Laypunov–Krasovskii functional, a linear matrix inequality (LMI) approach is developed to establish sufficient conditions to guarantee the existence of the state estimators. We show that both the existence conditions and the explicit expression of the desired estimator can be characterized in terms of the solution to an LMI. A simulation example is exploited to show the usefulness of the derived LMI-based stability conditions.     

Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks

We study the effect of delays on the dynamics of large networks of neurons. We show that delays give rise to a wealth of bifurcations and to a rich phase diagram, which includes oscillatory bumps, traveling waves, lurching waves, standing waves arising via a period-doubling bifurcation, aperiodic regimes, and regimes of multistability. We study the existence and the stability of the various dynamical patterns analytically and numerically in a simplified rate model as a function of the interaction parameters. The results derived in that framework allow us to understand the origin of the diversity of dynamical states observed in large networks of spiking neurons.     

Short-term memory in orthogonal neural networks

We study the ability of linear recurrent networks obeying discrete time dynamics to store long temporal sequences that are retrievable from the instantaneous state of the network. We calculate this temporal memory capacity for both distributed shift register and random orthogonal connectivity matrices. We show that the memory capacity of these networks scales with system size.     

Phase synchronization of bursting neural networks with electrical and delayed dynamic chemical couplings

Diffusive electrical connections in neuronal networks are instantaneous, while excitatoryor inhibitory couplings through chemical synapses contain a transmission time-delay.Moreover, chemical synapses are nonlinear dynamical systems whose behavior can bedescribed by nonlinear differential equations. In this work, neuronal networks withdiffusive electrical couplings and time-delayed dynamic chemical couplings are considered.We investigate the effects of distributed time delays on phase synchronization of burstingneurons. We observe that in both excitatory and Inhibitory chemical connections, the phasesynchronization might be enhanced when time-delay is taken into account. This distributedtime delay can induce a variety of phase-coherent dynamical behaviors. We also study thecollective dynamics of network of bursting neurons. The network model presents theso-called Small-World property, encompassing neurons whose dynamics have two time scales(fast and slow time scales). The neuron parameters in such Small-World network, aresupposed to be slightly different such that, there may be synchronization of the bursting(slow) activity if the coupling strengths are large enough. Bounds for the criticalcoupling strengths to obtain burst synchronization in terms of the network structure aregiven. Our studies show that the network synchronizability is improved, as itsheterogeneity is reduced. The roles of synaptic parameters, more precisely those of thecoupling strengths and the network size are also investigated.     

More relaxed condition for dynamics of discrete time delayed Hopfield neural networks

The dynamics of discrete time delayed Hopfield neural networks is investigated. By using a difference inequality combining with the linear matrix inequality, a sufficient condition ensuring global exponential stability of the unique equilibrium point of the networks is found. The result obtained holds not only for constant delay but also for time-varying delays.     

The effect of distributed time-delays on the synchronization of neuronal networks

Here we investigate the synchronization of networks of FitzHugh-Nagumo neurons coupled in scale-free, small-world and random topologies, in the presence of distributed time delays in the coupling of neurons. We explore how the synchronization transition is affected when the time delays in the interactions between pairs of interacting neurons are non-uniform. We find that the presence of distributed time-delays does not change the behavior of the synchronization transition significantly, vis-a-vis networks with constant time-delay, where the value of the constant time-delay is the mean of the distributed delays. We also notice that a normal distribution of delays gives rise to a transition at marginally lower coupling strengths, vis-a-vis uniformly distributed delays. These trends hold across classes of networks and for varying standard deviations of the delay distribution, indicating the generality of these results. So we conclude that distributed delays, which may be typically expected in real-world situations, do not have a notable effect on synchronization. This allows results obtained with constant delays to remain relevant even in the case of randomly distributed delays.     

Long term behavior of lithographically prepared in vitro neuronal networks

We measured the long term spontaneous electrical activity of neuronal networks with different sizes, grown on lithographically prepared substrates and recorded with multi-electrode-array technology. The time sequences of synchronized bursting events were used to characterize network dynamics. All networks exhibit scale-invariant Lévy distributions and long-range correlations. These observations suggest that different-size networks self-organize to adjust their activities over many time scales. As predictions of current models differ from our observations, this calls for revised models.     

More relaxed condition for dynamics of discrete time delayed Hopfield neural networks

The dynamics of discrete time delayed Hopfield neural networks is investigated. By using a difference inequality combining with the linear matrix inequality, a sufficient condition ensuring global exponential stability of the unique equilibrium point of the networks is found. The result obtained holds not only for constant delay but also for time-varying delays.     

From seconds to months: an overview of multi-scale dynamics of mobile telephone calls

Big Data on electronic records of social interactions allow approaching human behaviour and sociality from a quantitative point of view with unforeseen statistical power. Mobile telephone Call Detail Records (CDRs), automatically collected by telecom operators for billing purposes, have proven especially fruitful for understanding one-to-one communication patterns as well as the dynamics of social networks that are reflected in such patterns. We present an overview of empirical results on the multi-scale dynamics of social dynamics and networks inferred from mobile telephone calls. We begin with the shortest timescales and fastest dynamics, such as burstiness of call sequences between individuals, and “zoom out” towards longer temporal and larger structural scales, from temporal motifs formed by correlated calls between multiple individuals to long-term dynamics of social groups. We conclude this overview with a future outlook.     

Desynchronization by phase slip patterns in networks of pulse-coupled oscillators with delays

Coupling delays may cause drastic changes in the dynamics of oscillatory networks. In the present paper we investigate how coupling delays alter synchronization processes in networks of all-to-all coupled pulse oscillators. We derive an analytic criterion for the stability of synchrony and study the synchronization areas in the space of the delay and coupling strength. Specific attention is paid to the scenario of destabilization on the borders of the synchronization area. We show that in bifurcation points the system possesses homoclinic loops, which give rise to complex long- or quasi-periodic solutions. These newly born solutions are characterized by a synchronous group, from which an oscillator periodically escapes, laps one period, and rejoins. We call such a dynamical regime “phase slip patterns”.     

Nonlocal Mechanism for Synchronization of Time Delay Networks

We present the interplay between synchronization of networks with heterogeneous delays and the greatest common divisor (GCD) of loops composing the network. We distinguish between two types of networks; (I) chaotic networks and (II) population dynamic networks with periodic activity driven by external stimuli. For type (I), in the weak chaos region, the units of a chaotic network characterized by GCD=1 are in a chaotic zero-lag synchronization, whereas for GCD>1, the network splits into GCD-clusters in which clustered units are in zero-lag synchronization. These results are supported by simulations of chaotic systems, self-consistent and mixing arguments, as well as analytical solutions of Bernoulli maps. Type (II) is exemplified by simulations of Hodgkin Huxley population dynamic networks with unidirectional connectivity, synaptic noise and distribution of delays within neurons belonging to a node and between connecting nodes. For a stimulus to one node, the network splits into GCD-clusters in which cluster neurons are in zero-lag synchronization. For complex external stimuli, the network splits into clusters equal to the greatest common divisor of loops composing the network (spatial) and the periodicity of the external stimuli (temporal). The results suggest that neural information processing may take place in the transient to synchronization and imply a much shorter time scale for the inference of a perceptual entity.     

Synchronisation in networks of delay-coupled type-I excitable systems

We use a generic model for type-I excitability (known as the SNIPER or SNIC model) to describe the local dynamics of nodes within a network in the presence of non-zero coupling delays. Utilising the method of the Master Stability Function, we investigate the stability of the zero-lag synchronised dynamics of the network nodes and its dependence on the two coupling parameters, namely the coupling strength and delay time. Unlike in the FitzHugh-Nagumo model (a model for type-II excitability), there are parameter ranges where the stability of synchronisation depends on the coupling strength and delay time. One important implication of these results is that there exist complex networks for which the adding of inhibitory links in a small-world fashion may not only lead to a loss of stable synchronisation, but may also restabilise synchronisation or introduce multiple transitions between synchronisation and desynchronisation. To underline the scope of our results, we show using the Stuart-Landau model that such multiple transitions do not only occur in excitable systems, but also in oscillatory ones.     

How Gibbs Distributions May Naturally Arise from Synaptic Adaptation Mechanisms. A Model-Based Argumentation

This paper addresses two questions in the context of neuronal networks dynamics, using methods from dynamical systems theory and statistical physics: (i) How to characterize the statistical properties of sequences of action potentials (“spike trains”) produced by neuronal networks? and; (ii) what are the effects of synaptic plasticity on these statistics? We introduce a framework in which spike trains are associated to a coding of membrane potential trajectories, and actually, constitute a symbolic coding in important explicit examples (the so-called gIF models). On this basis, we use the thermodynamic formalism from ergodic theory to show how Gibbs distributions are natural probability measures to describe the statistics of spike trains, given the empirical averages of prescribed quantities. As a second result, we show that Gibbs distributions naturally arise when considering “slow” synaptic plasticity rules where the characteristic time for synapse adaptation is quite longer than the characteristic time for neurons dynamics.     

Agreement dynamics of finite-memory language games on networks

We propose a Finite-Memory Naming Game (FMNG) model with respect to the bounded rationality of agents or finite resources for information storage in communication systems. We study its dynamics on several kinds of complex networks, including random networks, small-world networks and scale-free networks. We focus on the dynamics of the FMNG affected by the memory restriction as well as the topological properties of the networks. Interestingly, we found that the most important quantity, the convergence time of reaching the consensus, shows some non-monotonic behaviors by varying the average degrees of the networks with the existence of the fastest convergence at some specific average degrees. We also investigate other main quantities, such as the success rate in negotiation, the total number of words in the system and the correlations between agents of full memory and the total number of words, which clearly explain the nontrivial behaviors of the convergence. We provide some analytical results which help better understand the dynamics of the FMNG. We finally report a robust scaling property of the convergence time, which is regardless of the network structure and the memory restriction.     

Novel criteria of synchronization stability in complex networks with coupling delays

Complex networks are wide spread in the real world, arising in fields as disparate as sociology, physics and biology. The information spreading through a complex network is often associated with time delays due to the finite speeds of signal transmission over a distance. Hence, complex networks with coupling delays have gained increasing attention in various fields of science and engineering today. In this paper, based on the theory of asymptotic stability of linear time-delay systems, synchronization stability in complex dynamical networks with coupling delays is investigated, and we derive novel criteria of synchronization state for both delay-independent and delay-dependent stabilities. As illustrative examples, we use the networks with coupling delays and a given coupling scheme to test the theoretical results.