Neutral Stochastic Differential Delay Equations with Markovian Switching

Abstract

Neutral stochastic differential delay equations (NSDDEs) have recently been studied intensively (see Kolmanovskii, V.B. and Nosov, V.R., Stability and Periodic Modes of Control Systems with Aftereffect; Nauka: Moscow, 1981 and Mao X., Stochastic Differential Equations and Their Applications; Horwood Pub.: Chichester, 1997). Given that many systems are often subject to component failures or repairs, changing subsystem interconnections and abrupt environmental disturbances etc., the structure and parameters of underlying NSDDEs may change abruptly. One way to model such abrupt changes is to use the continuous‐time Markov chains. As a result, the underlying NSDDEs become NSDDEs with Markovian switching which are hybrid systems. So far little is known about the NSDDEs with Markovian switching and the aim of this paper is to close this gap. In this paper we will not only establish a fundamental theory for such systems but also discuss some important properties of the solutions e.g. boundedness and stability.     

CONVERGENCE RATE OF THE TRUNCATED EULER-MARUYAMA METHOD FOR NEUTRAL STOCHASTIC DIFFERENTIAL DELAY EQUATIONS WITH MARKOVIAN SWITCHING

The key aim of this paper is to show the strong convergence of the truncated Euler-Maruyama method for neutral stochastic differential delay equations (NSDDEs) with Markovian switching (MS) without the linear growth condition. We present the truncated Euler-Maruyama method of NSDDEs-MS and consider its moment boundedness under the local Lipschitz condition plus Khasminskii-type condition. We also study its strong convergence rates at time $T$ and over a finite interval $[0, T]$. Some numerical examples are given to illustrate the theoretical results.     

STABILITY ANALYSIS OF THE SPLIT-STEP THETA METHOD FOR NONLINEAR REGIME-SWITCHING JUMP SYSTEMS

In this paper,we investigate the stability of the split-step theta(SST)method for a class of nonlinear regime-switching jump systems–neutral stochastic delay differential equations(NSDDEs)with Markov switching and jumps.As we know,there are few results on the stability of numerical solutions for NSDDEs with Markov switching and jumps.The purpose of this paper is to enrich conclusions in such respect.It first devotes to show that the trivial solution of the NSDDE with Markov switching and jumps is exponentially mean square stable and asymptotically mean square stable under some suitable conditions.If the drift coefficient also satisfies the linear growth condition,it then proves that the SST method applied to the NSDDE with Markov switching and jumps shares the same conclusions with the exact solution.Moreover,a numerical example is demonstrated to illustrate the obtained results.     

Asymptotic properties of nonlinear autoregressive Markov processes with state-dependent switching

In this paper, we consider a class of nonlinear autoregressive (AR) processes with state-dependent switching, which are two-component Markov processes. The state-dependent switching model is a nontrivial generalization of Markovian switching formulation and it includes the Markovian switching as a special case. We prove the Feller and strong Feller continuity by means of introducing auxiliary processes and making use of the Radon-Nikodym derivatives. Then, we investigate the geometric ergodicity by the Foster-Lyapunov inequality. Moreover, we establish the V-uniform ergodicity by means of introducing additional auxiliary processes and by virtue of constructing certain order-preserving couplings of the original as well as the auxiliary processes. In addition, illustrative examples are provided for demonstration.     

RAZUMIKHIN-TYPE THEOREMS OF NEUTRAL STOCHASTIC FUNCTIONAL DIFFERENTIAL EQUATIONS

The stability of stochastic functional differential equation with Markovian switching was studied by several authors,but there was almost no work on the stability of the neutral stochastic functional differential equations with Markovian switching.The aim of this article is to close this gap.The authors establish Razumikhin-type theorem of the neutral stochastic functional differential equations with Markovian switching,and those without Markovian switching.     

Stability in distribution of neutral stochastic functional differential equations with Markovian switching

Stability in distribution of stochastic differential equations with Markovian switching and stochastic differential delay equations with Markovian switching have been studied by several authors and this kind of stability is an important property for stochastic systems. There are several papers which study this stability for stochastic differential equations with Markovian switching and stochastic differential delay equations with Markovian switching technically. In our paper, we are concerned with the general neutral stochastic functional differential equations with Markovian switching and we derive the sufficient conditions for stability in distribution. At the end of our paper, one example is established to illustrate the theory of our work.     

STATIONARY SOLUTION FOR A STOCHASTIC LIENARD EQUATION WITH MARKOVIAN SWITCHING

This paper considers a stochastic Liénard equation with Markovian switching. The Feller continuity of its solution is proved by the coupling method and a truncation argument. The existence of a stationary solution for the equation is also proved under the Foster-Lyapunov drift condition.     

Synchronization of master-slave markovian switching complex dynamical networks with time-varying delays in nonlinear function via sliding mode control

In this article, a synchronization problem for master-slave Markovian switching complex dynamical networks with time-varying delays in nonlinear function via sliding mode control is investigated. On the basis of the appropriate Lyapunov-Krasovskii functional, introducing some free weighting matrices, new synchronization criteria are derived in terms of linear matrix inequalities (LMIs). Then, an integral sliding surface is designed to guarantee synchronization of master-slave Markovian switching complex dynamical networks, and the suitable controller is synthesized to ensure that the trajectory of the closed-loop error system can be driven onto the prescribed sliding mode surface. By using Dynkin's formula, we established the stochastic stablity of master-slave system. Finally, numerical example is provided to demonstrate the effectiveness of the obtained theoretical results.     

On Quadratic g-Evaluations/Expectations and Related Analysis

This work is concerned with coupling and exponential convergence rate for a class of Markovian switching jump-diffusion processes. The processes under consideration can be thought of as a number of jump-diffusion processes modulated by a Markovian switching device. For this class of processes, we construct some order-preserving couplings. Furthermore, by virtue of the coupling results, we also provide an estimate of exponential convergence rate for the Markovian switching jump-diffusion processes without Gaussian noise.     

多维马尔科夫转制随机微分方程的数值解

由于多维马尔科夫转制随机微分方程不存在解析解,利用Euler—Maruyama方法给出多维马尔科夫转制随机微分方程的渐进数值解,并证明了此数值解收敛到方程的解析解．将单一马尔科夫转制随机微分方程的数值解问题延伸到多维马尔科夫转制情形,增强了马尔科夫转制随机微分方程的适用性．     

Numerical detection of instability regions for delay models with delay-dependent parameters

In this paper we are interested in gaining local stability insights about the interior equilibria of delay models arising in biomathematics. The models share the property that the corresponding characteristic equations involve delay-dependent coefficients. The presence of such dependence requires the use of suitable criteria which usually makes the analytical work harder so that numerical techniques must be used. Most existing methods for studying stability switching of equilibria fail when applied to such a class of delay models. To this aim, an efficient criterion for stability switches was recently introduced in [E. Beretta, Y. Kuang, Geometric stability switch criteria in delay differential systems with delay dependent parameters, SIAM J. Math. Anal. 33 (2002) 1144–1165] and extended [E. Beretta, Y. Tang, Extension of a geometric stability switch criterion, Funkcial Ekvac 46(3) (2003) 337–361]. We describe how to numerically detect the instability regions of positive equilibria by using such a criterion, considering both discrete and distributed delay models.     

带马尔可夫切换的Q过程的遍历性

本文应用Foster-Lyapunov不等式和耦合方法,研究了一类带马尔可夫切换的Q过程的指数遍历性和强遍历性; 同时,也构造了一些关于这类带马尔可夫切换的Q过程的耦合,并证明某些耦合是成功的.     

带马尔可夫跳的随机Hopfield神经网络的以分布渐近稳定性

讨论了带马尔可夫跳的随机Hopfield神经网络的以分布渐近稳定性.通过构造合适的Lyapunov函数,获得了判定带马尔可夫跳的随机Hopfield神经网络的以分布渐近稳定性的充分条件.     

OPTIMAL CONTROL OF MARKOVIAN SWITCHING SYSTEMS WITH APPLICATIONS TO PORTFOLIO DECISIONS UNDER INFLATION

This article is concerned with a class of control systems with Markovian switching,in which an ltd formula for Markov-modulated processes is derived.Moreover,an optimal control law satisfying the generalized Hamilton-Jacobi-Bellman(HJB) equation with Markovian switching is characterized.Then,through the generalized HJB equation,we study an optimal consumption and portfolio problem with the financial markets of Markovian switching and inflation.Thus,we deduce the optimal policies and show that a modified Mutual Fund Theorem consisting of three funds holds.Finally,for the CRRA utility function,we explicitly give the optimal consumption and portfolio policies.Numerical examples are included to illustrate the obtained results.     

p-Moment Stability of Stochastic Nonlinear Delay Systems with Impulsive Jump and Markovian Switching

Abstract

This article is concerned with the problem of p-moment stability of stochastic differential delay equations with impulsive jump and Markovian switching. In this model, the features of stochastic systems, delay systems, impulsive systems, and Markovian switching are all taken into account, which is scarce in the literature. Based on Lyapunov–Krasovskii functional method and stochastic analysis theory, we obtain new criteria ensuring p-moment stability of trivial solution of a class of impulsive stochastic differential delay equations with Markovian switching.     

Approximate solutions of stochastic differential delay equations with Markovian switching

Recently, stochastic differential equations with Markovian switching (SDEwMS) have received a great deal of attention. In this paper, the Euler–Maruyama method is developed, one of the most powerful numerical schemes, for the stochastic differential delay equations with Markovian switching (SDDEwMS).     

Coupling for Markovian switching jump-diffusions

This work is concerned with coupling for a class of Markovian switching jump-diffusion processes. The processes under consideration can be regarded as a number of jump-diffusion processes modulated by a Markovian switching device. For this class of processes, we construct a successful coupling and an order-preserving coupling.     

Stability of Delayed Markovian Switching Stochastic Neutral-type Reaction-diffusion Neural Networks

This paper is concerned about exponential stability in mean square of Markovian switching delayed reaction-diffusion neutral-type stochastic neural networks (RNSNNs). By Lyapunov function method, several novel stability criteria on exponential mean square stability of Markovian switching RNSNNs with time-varying delays are obtained. In the end, two examples are given to verify the feasibility of our findings.     

Convergence of numerical solutions to stochastic age-dependent population equations with Markovian switching

In this paper, a class of stochastic age-dependent population equations with Markovian switching is considered. The main aim of this paper is to investigate the convergence of the numerical approximation of stochastic age-dependent population equations with Markovian switching. It is proved that the numerical approximation solutions converge to the analytic solutions of the equations under the given conditions. An example is given for illustration.     

一类具马尔科夫链中立型随机神经网络的动力学性质（英文）

A generalized neutral stochastic functional differential equation(NSFDE) with Markovian switching is studied. We will discuss some important properties of the solutions including boundedness and exponential stability by using Lyapunov-Krasovskii functional,Matrix inequality and some analysis techniques. Finally, an numerical example for neutral stochastic neural networks with Markovian switching is given to show the effectiveness of the results in this paper.