Almost surely asymptotic stability of neutral stochastic differential delay equations with Markovian switching

The main aim of this paper is to discuss the almost surely asymptotic stability of the neutral stochastic differential delay equations (NSDDEs) with Markovian switching. Linear NSDDEs with Markovian switching and nonlinear examples will be discussed to illustrate the theory.     

p-Moment Stability of Stochastic Nonlinear Delay Systems with Impulsive Jump and Markovian Switching

Abstract

This article is concerned with the problem of p-moment stability of stochastic differential delay equations with impulsive jump and Markovian switching. In this model, the features of stochastic systems, delay systems, impulsive systems, and Markovian switching are all taken into account, which is scarce in the literature. Based on Lyapunov–Krasovskii functional method and stochastic analysis theory, we obtain new criteria ensuring p-moment stability of trivial solution of a class of impulsive stochastic differential delay equations with Markovian switching.     

An analytic approximation of solutions of stochastic differential delay equations with Markovian switching

In this paper, we are concerned with the stochastic differential delay equations with Markovian switching (SDDEwMSs). As stochastic differential equations with Markovian switching (SDEwMSs), most SDDEwMSs cannot be solved explicitly. Therefore, numerical solutions, such as EM method, stochastic Theta method, Split-Step Backward Euler method and Caratheodory’s approximations, have become an important issue in the study of SDDEwMSs. The key contribution of this paper is to investigate the strong convergence between the true solutions and the numerical solutions to SDDEwMSs in the sense of the L^p-norm when the drift and diffusion coefficients are Taylor approximations.     

Razumikhin method and exponential stability of hybrid stochastic delay interval systems

This paper deals with the exponential stability of hybrid stochastic delay interval systems (also known as stochastic delay interval systems with Markovian switching). The known results in this area (see, e.g., [X., Mao, Exponential stability of stochastic delay interval systems with Markovian switching, IEEE Trans. Automat. Control 47 (10) (2002) 1604-1612]) require the time delay to be a constant or a differentiable function and the main reason for such a restriction is due to the analysis of mathematics. The main aim of this paper is to remove this restriction to allow the time delay to be a bounded variable only. The Razumikhin method is developed to cope with the difficulty arisen from the nondifferentiability of the time delay.     

Guaranteed Cost Control for a Class of Uncertain Stochastic Impulsive Systems with Markovian Switching

Abstract

This article is concerned with the problem of guaranteed cost control for a class of uncertain stochastic impulsive systems with Markovian switching. To the best of our knowledge, it is the first time that such a problem is investigated for stochastic impulsive systems with Markovian switching. For an uncontrolled system, the conditions in terms of certain linear matrix inequalities (LMIs) are obtained for robust stochastical stability and an upper bound is given for the cost function. For the controlled systems, a set of LMIs is developed to design a linear state feedback controller which can stochastically stabilize the class of systems under study and guarantee the given cost function to have an upper bound. Further, an optimization problem with LMI constraints is formulated to minimize the guaranteed cost of the closed-loop system. Finally, a numerical example is provided to show the effectiveness of the proposed method.     

CONVERGENCE RATE OF THE TRUNCATED EULER-MARUYAMA METHOD FOR NEUTRAL STOCHASTIC DIFFERENTIAL DELAY EQUATIONS WITH MARKOVIAN SWITCHING

The key aim of this paper is to show the strong convergence of the truncated Euler-Maruyama method for neutral stochastic differential delay equations (NSDDEs) with Markovian switching (MS) without the linear growth condition. We present the truncated Euler-Maruyama method of NSDDEs-MS and consider its moment boundedness under the local Lipschitz condition plus Khasminskii-type condition. We also study its strong convergence rates at time $T$ and over a finite interval $[0, T]$. Some numerical examples are given to illustrate the theoretical results.     

Near-optimal mean–variance controls under two-time-scale formulations and applications

Although the mean–variance control was initially formulated for financial portfolio management problems in which one wants to maximize the expected return and control the risk, our motivations stem from highway vehicle platoon controls that aim to maximize highway utility while ensuring zero accident. This paper develops near-optimal mean–variance controls of switching diffusion systems. To reduce the computational complexity, with motivations from earlier work on singularly perturbed Markovian systems [Sethi and Zhang, Hierarchical Decision Making in Stochastic Manufacturing Systems, Birkhäuser, Boston, MA, 1994; Yin and Zhang, Continuous-Time Markov Chains and Applications: A Singular Pertubation Approach, Springer-Verlag, New York, 1998 and Yin et al., Ann. Appl. Probab. 10 (2000), pp. 549–572], we use a two-time-scale formulation to treat the underlying system, which is represented by the use of a small parameter. As the small parameter goes to 0, we obtain a limit problem. Using the limit problem as a guide, we construct controls for the original problem, and show that the control so constructed is nearly optimal.     

STABILITY ANALYSIS OF THE SPLIT-STEP THETA METHOD FOR NONLINEAR REGIME-SWITCHING JUMP SYSTEMS

In this paper,we investigate the stability of the split-step theta(SST)method for a class of nonlinear regime-switching jump systems–neutral stochastic delay differential equations(NSDDEs)with Markov switching and jumps.As we know,there are few results on the stability of numerical solutions for NSDDEs with Markov switching and jumps.The purpose of this paper is to enrich conclusions in such respect.It first devotes to show that the trivial solution of the NSDDE with Markov switching and jumps is exponentially mean square stable and asymptotically mean square stable under some suitable conditions.If the drift coefficient also satisfies the linear growth condition,it then proves that the SST method applied to the NSDDE with Markov switching and jumps shares the same conclusions with the exact solution.Moreover,a numerical example is demonstrated to illustrate the obtained results.     

Finite-time stability and stabilization of nonlinear stochastic hybrid systems

This paper deals with the problem of finite-time stability and stabilization of nonlinear Markovian switching stochastic systems which exist impulses at the switching instants. Using multiple Lyapunov function theory, a sufficient condition is established for finite-time stability of the underlying systems. Furthermore, based on the state partition of continuous parts of systems, a feedback controller is designed such that the corresponding impulsive stochastic closed-loop systems are finite-time stochastically stable. A numerical example is presented to illustrate the effectiveness of the proposed method.     

On laws of large numbers for systems with mean-field interactions and Markovian switching

Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled by a continuous-time Markov chain. Different from the usual switching diffusions, the systems include mean-field interactions. Our effort is devoted to obtaining laws of large numbers for the underlying systems. One of the distinct features of the paper is the limit of the empirical measures is not deterministic but a random measure depending on the history of the Markovian switching process. A main difficulty is that the standard martingale approach cannot be used to characterize the limit because of the coupling due to the random switching process. In this paper, in contrast to the classical approach, the limit is characterized as the conditional distribution (given the history of the switching process) of the solution to a stochastic McKean–Vlasov differential equation with Markovian switching.     

Delay-Dependent Criteria for Robust Stabilization of Markovian Switching Networks with Time-Varying Delay

Abstract

A problem of feedback stabilization of hybrid systems with time-varying delay and Markovian switching is considered. Delay-dependent sufficient conditions for stability based on linear matrix inequalities (LMI's) for stochastic asymptotic stability is obtained. The stability result depended on the mode of the system and of delay-dependent. The robustness results of such stability concept against all admissible uncertainties are also investigated. This new delay-dependent stability criteria is less conservative than the existing delay-independent stability conditions. An example is given to demonstrate the obtained results.     

The Finite Horizon Optimal Multi-Modes Switching Problem: The Viscosity Solution Approach

In this paper we show existence and uniqueness of a solution for a system of m variational partial differential inequalities with inter-connected obstacles. This system is the deterministic version of the Verification Theorem of the Markovian optimal m-states switching problem. The switching cost functions are arbitrary. This problem is in relation with the valuation of firms in a financial market.     

Existence and uniqueness of solutions to stochastic heat equations with Markovian switching and Feller property

Abstract

In this paper, we focus on two-component Markov processes which consist of continuous dynamics and discrete events. Using the classical fixed point theorem for contractions to investigate the existence and uniqueness of solutions of stochastic heat equations with Markovian switching, then developing the corresponding Feller property of the solution.     

Stability in distribution of neutral stochastic functional differential equations with Markovian switching

Stability in distribution of stochastic differential equations with Markovian switching and stochastic differential delay equations with Markovian switching have been studied by several authors and this kind of stability is an important property for stochastic systems. There are several papers which study this stability for stochastic differential equations with Markovian switching and stochastic differential delay equations with Markovian switching technically. In our paper, we are concerned with the general neutral stochastic functional differential equations with Markovian switching and we derive the sufficient conditions for stability in distribution. At the end of our paper, one example is established to illustrate the theory of our work.     

Numerical approximation of a stochastic age-structured population model in a polluted environment with Markovian switching

In this paper, a stochastic age-structured population model with Markovian switching is investigated in a polluted environment. Both the stochastic disturbance of environment and the Markovian switching are incorporated into the model. By Itô formula and several assumptions, the boundedness in the qth moment of exact solutions of model are proved. Furthermore, making use of truncated Euler–Maruyama (EM) method, the strong convergence criterion of numerical approximation in the qth moment is established, and the rate of convergence is estimated. Numerical simulations are carried out to illustrate the theoretical results. Our results indicate that the truncated EM method can be used for stochastic age-structured population system in a polluted environment.     

Stability in Terms of Two Measures for Stochastic Differential Equations with Markovian Switching

Abstract

In this paper, we investigate the stability in terms of two measures for stochastic differential equations with Markovian switching by using the method of Lyapunov functions. Our new theory can not only be used to show a given system to be stochastically stable in the classical sense, but can also be used to deal with some situations where the classical stability theory is not applicable.     

H∞ robust control based on event‐triggered sampling for hybrid systems with singular Markovian jump

The problem of H_∞ robust control based on event‐triggered sampling for a class of singular hybrid systems with Markovian jump is considered in this paper. The primary object of this paper here is to design the event‐triggered sampling controller for a class of uncertain singular Markovian systems, and two fundamental issues on mean square exponential admissibility and H_∞ robust performance are fully addressed. By making use of a suitable Lyapunov functional, in combination with both infinitesimal operator and linear matrices inequalities(LMIs), the sufficient criteria are derived to guarantee the controlled singular hybrid system with Markovian jump is robustly exponentially mean‐square admissible and has a prescribed H_∞ performance γ. Finally, a typical RLC circuit system is given to show the effectiveness of the proposed control method.     

Threshold policies for controlled retrial queues with heterogeneous servers

Retrial queues are an important stochastic model for many telecommunication systems. In order to construct competitive networks it is necessary to investigate ways for optimal control. This paper considers K -server retrial systems with arrivals governed by Neut' Markovian arrival process, and heterogeneous service time distributions of general phase-type. We show that the optimal policy which minimizes the number of customers in the system is of a threshold type with threshold levels depending on the states of the arrival and service processes. An algorithm for the numerical evaluation of an optimal control is proposed on the basis of Howar's iteration algorithm. Finally, some numerical results will be given in order to illustrate the system dynamics. AMS subject classification: 60K25 93E20     

Game-theoretic coupled riccati equations associated to controlled linear differential systems with jump markov perturbations

In this paper we investigate several properties of the stabilizing solution of a class of systems of Riccati type differential equations with indefinite sign associated to controlled systems described by differential equations with Markovian jumping.

We show that the existence of a bounded on R ₊ and stabilizing solution for this class of systems of Riccati type differential equations is equivalent to the solvability of a control-theoretic problem, namely disturbance attenuation problem.

If the coefficients of the considered system are theta;-periodic functions then the stabilizing solution is also theta;-periodic and if the coefficients are asymptotic almost periodic functions, then the stabilizing solution is also asymptotic almost periodic and its almost periodic component is a stabilizing solution for a system of Riccati type differential equations defined on the whole real axis. One proves also that the existence of a stabilizing and bounded on R ₊ solution of a system of Riccati differential equations with indefinite sign is equivalent to the existence of a solution to a corresponding system of matrix inequalities. Finally, a minimality property of the stabilizing solution is derived.     

Finite‐dimensional Realizations of Regime‐switching HJM Models

This paper studies Heath–Jarrow–Morton‐type models with regime‐switching stochastic volatility. In this setting the forward rate volatility is allowed to depend on the current forward rate curve as well as on a continuous time Markov chain y with finitely many states. Employing the framework developed by Björk and Svensson we find necessary and sufficient conditions on the volatility guaranteeing the representation of the forward rate process by a finite‐dimensional Markovian state space model. These conditions allow us to investigate regime‐switching generalizations of some well‐known models such as those by Ho–Lee, Hull–White, and Cox–Ingersoll–Ross.