Mean Field Analysis of Large-Scale Interacting Populations of Stochastic Conductance-Based Spiking Neurons Using the Klimontovich Method

We investigate the dynamics of large-scale interacting neural populations, composed of conductance based, spiking model neurons with modifiable synaptic connection strengths, which are possibly also subjected to external noisy currents. The network dynamics is controlled by a set of neural population probability distributions (PPD) which are constructed along the same lines as in the Klimontovich approach to the kinetic theory of plasmas. An exact non-closed, nonlinear, system of integro-partial differential equations is derived for the PPDs. As is customary, a closing procedure leads to a mean field limit. The equations we have obtained are of the same type as those which have been recently derived using rigorous techniques of probability theory. The numerical solutions of these so called McKean–Vlasov–Fokker–Planck equations, which are only valid in the limit of infinite size networks, actually shows that the statistical measures as obtained from PPDs are in good agreement with those obtained through direct integration of the stochastic dynamical system for large but finite size networks. Although numerical solutions have been obtained for networks of Fitzhugh–Nagumo model neurons, which are often used to approximate Hodgkin–Huxley model neurons, the theory can be readily applied to networks of general conductance-based model neurons of arbitrary dimension.     

An LMI approach to asymptotical stability of multi-delayed neural networks

In this paper, some criteria are derived for global asymptotic stability of a class of neural networks with multiple constant or time-varying delays. Based on the Lyapunov–Krasovskii stability theory for functional differential equations and the linear matrix inequality (LMI) approach, some delay-independent criteria for neural networks with multiple constant delays and delay-dependent criteria for neural networks with multiple time-varying delays are provided to guarantee global asymptotic stability of these networks. The main results are generalizations of some recent results reported in the literature.     

On the parallel dynamics of theQ-state Potts andQ-Ising neural networks

Using a probabilistic approach, the parallel dynamics of theQ-state Potts andQ-Ising neural networks are studied at zero and at nonzero temperatures. Evolution equations are derived for the first time step and arbitraryQ. These formulas constitute recursion relations for the exact parallel dynamics of the extremely diluted asymmetric versions of these networks. An explicit analysis, including dynamical capacity-temperature diagrams and the temperature dependence of the overlap, is carried out forQ=3. Both types of models are compared.On leave of absence from the Laboratory of Theoretical Physics, Joint Institute for Nuclear Research, Dubna 141980, Russia.     

A physics-constrained deep residual network for solving the sine-Gordon equation

Despite some empirical successes for solving nonlinear evolution equations using deep learning,there are several unresolved issues.First,it could not uncover the dynamical behaviors of some equations where highly nonlinear source terms are included very well.Second,the gradient exploding and vanishing problems often occur for the traditional feedforward neural networks.In this paper,we propose a new architecture that combines the deep residual neural network with some underlying physical laws.Using the sine-Gordon equation as an example,we show that the numerical result is in good agreement with the exact soliton solution.In addition,a lot of numerical experiments show that the model is robust under small perturbations to a certain extent.     

Functional holography analysis: simplifying the complexity of dynamical networks

We present a novel functional holography (FH) analysis devised to study the dynamics of task-performing dynamical networks. The latter term refers to networks composed of dynamical systems or elements, like gene networks or neural networks. The new approach is based on the realization that task-performing networks follow some underlying principles that are reflected in their activity. Therefore, the analysis is designed to decipher the existence of simple causal motives that are expected to be embedded in the observed complex activity of the networks under study. First we evaluate the matrix of similarities (correlations) between the activities of the network's components. We then perform collective normalization of the similarities (or affinity transformation) to construct a matrix of functional correlations. Using dimension reduction algorithms on the affinity matrix, the matrix is projected onto a principal three-dimensional space of the leading eigenvectors computed by the algorithm. To retrieve back information that is lost in the dimension reduction, we connect the nodes by colored lines that represent the level of the similarities to construct a holographic network in the principal space. Next we calculate the activity propagation in the network (temporal ordering) using different methods like temporal center of mass and cross correlations. The causal information is superimposed on the holographic network by coloring the nodes locations according to the temporal ordering of their activities. First, we illustrate the analysis for simple, artificially constructed examples. Then we demonstrate that by applying the FH analysis to modeled and real neural networks as well as recorded brain activity, hidden causal manifolds with simple yet characteristic geometrical and topological features are deciphered in the complex activity. The term "functional holography" is used to indicate that the goal of the analysis is to extract the maximum amount of functional information about the dynamical network as a whole unit.     

Global Lagrange stability for neutral-type inertial neural networks with discrete and distributed time delays

This paper focus on the problem of global Lagrange stability for neutral-type inertial neural networks with discrete and distributed time delays. By choosing a proper variable substitution, an inertial neural network consisting of second-order differential equations can be converted into a first-order differential model. The sufficient conditions of the inertial neural network with neutral delay are derived by constructing suitable Lyapunov-Krasovskii functional candidates, introducing new free weighting matrices, utilizing inequality techniques and analytical method. Through the LMI condition, we analyze the global exponential stability of the delayed inertial neural networks in Lagrange sense. Meanwhile, the global exponential attractive set is also given. Finally, some example is given to illustrate our theoretical results.     

Adaptive synchronization of a class of chaotic neural networks with known or unknown parameters

In this Letter, synchronization of a class of chaotic neural networks with known or unknown parameters is investigated. By combing the adaptive control and linear feedback with update law, a simple, analytical, and rigorous adaptive feedback scheme is derived to achieve synchronization of two coupled neural networks with time-varying delay based on the invariant principle of functional differential equations and parameter identification. With this method, parameter identification and synchronization can be achieved simultaneously. Simulation results are given to justify the theoretical analysis.     

Pinning synchronization of time-varying delay coupled complex networks with time-varying delayed dynamical nodes

This paper deals with the pinning synchronization of nonlinearly coupled complex networks with time-varying coupling delays and time-varying delays in the dynamical nodes.We control a part of the nodes of the complex networks by using adaptive feedback controllers and adjusting the time-varying coupling strengths.Based on the Lyapunov-Krasovskii stability theory for functional differential equations and a linear matrix inequality(LMI),some sufficient conditions for the synchronization are derived.A numerical simulation example is also provided to verify the correctness and the effectiveness of the proposed scheme.     

Research on the optimal dynamical systems of three-dimensional Navier-Stokes equations based on weighted residual

In this paper, the theory of constructing optimal dynamical systems based on weighted residual presented by Wu & Sha is applied to three-dimensional Navier-Stokes equations, and the optimal dynamical system modeling equations are derived. Then the multiscale global optimization method based on coarse graining analysis is presented, by which a set of approximate global optimal bases is directly obtained from Navier-Stokes equations and the construction of optimal dynamical systems is realized. The optimal bases show good properties, such as showing the physical properties of complex flows and the turbulent vortex structures, being intrinsic to real physical problem and dynamical systems, and having scaling symmetry in mathematics, etc.. In conclusion, using fewer terms of optimal bases will approach the exact solutions of Navier-Stokes equations, and the dynamical systems based on them show the most optimal behavior.     

Synchronization of delayed fuzzy cellular neural networks based on adaptive control

This Letter studies synchronization of delayed fuzzy cellular neural networks with all the parameters unknown. To enhance the coupled strength dynamically and be more suitable for the reality, we add fuzzy theory to the traditional cellular neural networks. By the Lyapunov-Lasall principle of functional differential equations, some new stability criteria are obtained via adaptive control. To the best of our knowledge, there has few work studying fuzzy cellular neural networks. Moreover, the approaches developed here extend the ideas and techniques derived in recent literatures. In the end, an example and its simulation were given to illustrate the simpleness and effectiveness of our main results.     

Synchronization criteria for complex dynamical networks with neutral-type coupling delay

A generalized complex dynamical networks model with neutral-type coupling delay is proposed, which is an extension for the systems without time delay and with the retarded delay. By some transformation, the synchronization problem of the complex networks is transferred equally into the asymptotical stability problem of a group of uncorrelated neutral delay functional differential equations. Furthermore, the less conservative sufficient conditions for both delay-independent and delay-dependent asymptotical synchronization stability criteria are derived in the form of linear matrix inequalities based on the free weighting matrix strategy. Numerical examples are given to illustrate the theoretical results.     

Transformation Properties of Dynamical Systems at the Quantum Level

Based on the generating functional of Green function for a dynamical system, the general equations of transformation properties at the quantum level are derived. In some cases they can be reduced to the quantum Noether theorem. In some other cases they can be reduced to momentum theorem or angular momentum theorem etc. at the quantum level. An example is presented and it shows that the classical conservation laws don’t always preserve in quantum theories. PACS: 11.10.E     

The Blume–Emery–Griffiths neural network: dynamics for arbitrary temperature

The parallel dynamics of the fully connected Blume–Emery–Griffiths neural network model is studied for arbitrary temperature. By employing a probabilistic signal-to-noise approach, a recursive scheme is found determining the time evolution of the distribution of the local fields and, hence, the evolution of the order parameters. A comparison of this approach is made with the generating functional method, allowing to calculate any physical relevant quantity as a function of time. Explicit analytic formula are given in both methods for the first few time steps of the dynamics. Up to the third time step the results are identical. Some arguments are presented why beyond the third time step the results differ for certain values of the model parameters. Furthermore, fixed-point equations are derived in the stationary limit. Numerical simulations confirm our theoretical findings.     

Stability and synchronization of fractional-order complex-valued neural networks with time delay: LMI approach

In this paper, we investigate the problem of stability and synchronization of fractional-order complex-valued neural networks with time delay. By using Lyapunov–Krasovskii functional approach, some linear matrix inequality (LMI) conditions are proposed to ensure that the equilibrium point of the addressed neural networks is globally Mittag–Leffler stable. Moreover, some sufficient conditions for projective synchronization of considered fractional-order complex-valued neural networks are derived in terms of LMIs. Finally, two numerical examples are given to demonstrate the effectiveness of our theoretical results.     

Synchronization in complex delayed dynamical networks with impulsive effects

The present paper is mainly concerned with the issues of synchronization dynamics of complex delayed dynamical networks with impulsive effects. A general model of complex delayed dynamical networks with impulsive effects is formulated, which can well describe practical architectures of more realistic complex networks related to impulsive effects. Based on impulsive stability theory on delayed dynamical systems, some simple but less conservative criterion are derived for global synchronization of such dynamical network. It is shown that synchronization of the networks is heavily dependent on impulsive effects of connecting configuration in the networks. Furthermore, the theoretical results are applied to a typical SF network composing of impulsive coupled chaotic delayed Hopfield neural network nodes, and are also illustrated by numerical simulations.     

Robust impulsive synchronization of coupled delayed neural networks with uncertainties

This paper investigates the synchronization scheme of coupled neural networks with time delays. The coupling function, which can be linear or nonlinear, is subject to uncertainties in the network. By utilizing the stability theory for impulsive functional differential equations, several new criteria are obtained to ensure the robust synchronization of coupled networks via impulsive control. Furthermore, an estimation of the predicted stable region is derived to facilitate the design of the control gain. Finally, numerical simulations are presented to demonstrate the effectiveness of our results.     

Generating Functionals in Nonequilibrium Statistical Mechanics

The main ideas and methods of calculations within the framework of the generating functional technique are considered in a systematical way. The nonequilibrium generating functionals are defined as functional mappings of the nonequilibrium statistical operator and so appear to be dependent on a certain set of macroscopic variables describing the nonequilibrium state of the system. The boundary conditions and the differential equation of motion for the generating functionals are considered which result in an explicit expression for the nonequilibrium generating functionals in terms of the so-called coarse-grained generating functional being the functional mapping of the quasiequilibrium statistical operator. Various types of integral equations are derived for the generating functionals which are convenient to develop the perturbation theories with respect to either small interaction or small density of particles. The master equation for the coarse-grained generating functionals is obtained and its connection with the generalized kinetic equations for a set of macrovariables is shown. The derivation of the generalized kinetic equations for some physical systems (classical and quantum systems of interacting particles, the Kondo system) is treated in detail, with due regard for the polarization effects as well as the energy and momentum exchange between the colliding particles and the surrounding media.     

Cosmological Models with Fractional Derivatives and FractionalAction Functional

Cosmological models of a scalar field with dynamical equations containing fractional derivatives or derived from the Einstein-Hilbert action of fractional Order, are constructed. A number of exact solutions to those equations of fractional cosmological models in both cases is given.     

Integrability and the variational formulation of non‐conservative mechanical systems

It is shown that one can obtain canonically‐defined dynamical equations for non‐conservative mechanical systems by starting with a first variation functional, instead of an action functional, and finding their zeroes. The kernel of the first variation functional, as an integral functional, is a 1‐form on the manifold of kinematical states, which then represents the dynamical state of the system. If the 1‐form is exact then the first variation functional is associated with the first variation of an action functional in the usual manner. The dynamical equations then follow from the vanishing of the dual of the Spencer operator that acts on the dynamical state. This operator, in turn, relates to the integrability of the kinematical states. The method is applied to the modeling of damped oscillators.     

Implications of causality for quantum biology – I: topology change

A framework for describing the causal, topology changing, evolution of interacting biomolecules is developed. The quantum dynamical manifold equations (QDMEs) derived from this framework can be related to the causality restrictions implied by a finite speed of light and to Planck's constant to set a transition frequency scale. The QDMEs imply conserved stress-energy, angular-momentum and Noether currents. The functional whose extremisation leads to this result provides a causal, time-dependent, non-equilibrium generalisation of the Hohenberg–Kohn theorem. The system of dynamical equations derived from this functional and the currents J derived from the QDMEs are shown to be causal and consistent with the first and second laws of thermodynamics. This has the potential of allowing living systems to be quantum mechanically distinguished from non-living ones.