Robust Control of Markovian Switching Stochastic Systems with Noise Dependent States and Inputs

A problem of state feedback stabilization of discrete-time stochastic processes under Markovian switching and random diffusion (noise) is considered. The jump Markovian switching is modeled by a discrete-time Markov chain. The control input is simultaneously applied to both the rate vector and the diffusion term. Sufficient conditions based on linear matrix inequalities (LMI's) for stochastic stability is obtained. The robustness results of such stability concept against all admissible uncertainties are also investigated. An example is given to demonstrate the obtained results.     

Optimal Guaranteed Cost Control of Stochastic Discrete-Time Systems with States and Input Dependent Noise Under Markovian Switching

A problem of robust guaranteed cost control of stochastic discrete-time systems with parametric uncertainties under Markovian switching is considered. The control is simultaneously applied to both the random and the deterministic components of the system. The noise (the random) term depends on both the states and the control input. The jump Markovian switching is modeled by a discrete-time Markov chain and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Using linear matrix inequalities (LMIs) approach, the robust quadratic stochastic stability is obtained. The proposed control law for this quadratic stochastic stabilization result depended on the mode of the system. This control law is developed such that the closed-loop system with a cost function has an upper bound under all admissible parameter uncertainties. The upper bound for the cost function is obtained as a minimization problem. Two numerical examples are given to demonstrate the potential of the proposed techniques and obtained results.     

Stabilization of stochastic systems under Markovian switching

The problem of state feedback stabilization of discrete-time stochastic processes under Markovian switching is considered. The jump Markovian switching is modeled by a discrete-time Markov chain, and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Necessary and sufficient conditions based on linear matrix inequalities (LMI’s) for stochastic stability is obtained. The proposed control law for this stochastic stabilization result depends on the mode of the system as well as the environmental disturbances. The robustness results of such stability concepts against all admissible uncertainties are also investigated. An example is given to demonstrate the obtained results.     

Delay-Dependent Criteria for Robust Stabilization of Markovian Switching Networks with Time-Varying Delay

Abstract

A problem of feedback stabilization of hybrid systems with time-varying delay and Markovian switching is considered. Delay-dependent sufficient conditions for stability based on linear matrix inequalities (LMI's) for stochastic asymptotic stability is obtained. The stability result depended on the mode of the system and of delay-dependent. The robustness results of such stability concept against all admissible uncertainties are also investigated. This new delay-dependent stability criteria is less conservative than the existing delay-independent stability conditions. An example is given to demonstrate the obtained results.     

Quantized stabilization of stochastic systems with multiplicative noise under Markovian switching

A problem of quantized state feedback quadratic mean-square stabilization of discrete-time stochastic processes under Markovian switching and multiplicative noise is considered. A static quantizer is used in the feedback channel and the jump Markovian switching is modeled by a discrete-time Markov chain. The control input is simultaneously applied to both the rate vector and the diffusion term. It is shown that the coarsest quantization density that permits quadratic mean-square stabilization of this system is achieved with the use of a logarithmic quantizer, and the coarsest quantization density is determined by an algebraic Riccati equation, which is also the solution to a special linear stochastic Markovian switching control system. Also, sufficient conditions for exponential mean-square stabilization of such systems are also explored. An example is given to demonstrate the obtained results.     

Guaranteed Cost Control for a Class of Uncertain Stochastic Impulsive Systems with Markovian Switching

Abstract

This article is concerned with the problem of guaranteed cost control for a class of uncertain stochastic impulsive systems with Markovian switching. To the best of our knowledge, it is the first time that such a problem is investigated for stochastic impulsive systems with Markovian switching. For an uncontrolled system, the conditions in terms of certain linear matrix inequalities (LMIs) are obtained for robust stochastical stability and an upper bound is given for the cost function. For the controlled systems, a set of LMIs is developed to design a linear state feedback controller which can stochastically stabilize the class of systems under study and guarantee the given cost function to have an upper bound. Further, an optimization problem with LMI constraints is formulated to minimize the guaranteed cost of the closed-loop system. Finally, a numerical example is provided to show the effectiveness of the proposed method.     

随机混合动态系统的状态反馈控制

针对一类以有限齐次马氏链δ(k)作为切换信号的随机混合系统,首先,通过构造随机混合Lyapunov函数,得到整个随机混合系统渐近稳定的充分条件.然后,引入可调转移概率等相关概念,通过对有限齐次马氏链δ(k)及各子系统加入控制,以实现状态反馈控制.进一步,得到随机混合闭环系统渐近稳定的充分条件.     

Feedback control based on discrete-time state observations on synchronization of stochastic impulsive coupled systems

In this paper, feedback control based on discrete-time state observations is used to study the inner synchronization of stochastic impulsive coupled systems (SICSs). Therein, the coupling strength of SICSs is state-dependent switching and time-varying under each switching. Besides, by means of average impulsive interval approach, the Lyapunov method and the graph theory, a synchronization criterion of SICSs is presented. As an application, stochastic impulsive coupled Chua’s circuits with state-dependent switching coupling strength are investigated for the first time and some sufficient conditions are given. Finally, in order to illustrate the effectiveness of our main results, some numerical simulations are presented.     

Robust stability and stabilization of linear stochastic systems with Markovian switching and uncertain transition rates

This paper is concerned with the robust stabilization problem for a class of linear uncertain stochastic systems with Markovian switching. The uncertain stochastic system with Markovian switching under consideration involves parameter uncertainties both in the system matrices and in the mode transition rates matrix. New criteria for testing the robust stability of such systems are established in terms of bi-linear matrix inequalities (BLMIs), and sufficient conditions are proposed for the design of robust state-feedback controllers. A numerical example is given to illustrate the effectiveness of our results.     

Finite-time stability and stabilization of nonlinear stochastic hybrid systems

This paper deals with the problem of finite-time stability and stabilization of nonlinear Markovian switching stochastic systems which exist impulses at the switching instants. Using multiple Lyapunov function theory, a sufficient condition is established for finite-time stability of the underlying systems. Furthermore, based on the state partition of continuous parts of systems, a feedback controller is designed such that the corresponding impulsive stochastic closed-loop systems are finite-time stochastically stable. A numerical example is presented to illustrate the effectiveness of the proposed method.     

Generalized average dwell time approach to stability and input-to-state stability of hybrid impulsive stochastic differential systems

This paper is concerned with the stability properties of a class of impulsive stochastic differential systems with Markovian switching. Employing the generalized average dwell time (gADT) approach, some criteria on the global asymptotic stability in probability and the stochastic input-to-state stability of the systems under consideration are established. Two numerical examples are given to illustrate the effectiveness of the theoretical results, as well as the effects of the impulses and the Markovian switching on the systems stability.     

p-Moment Stability of Stochastic Nonlinear Delay Systems with Impulsive Jump and Markovian Switching

Abstract

This article is concerned with the problem of p-moment stability of stochastic differential delay equations with impulsive jump and Markovian switching. In this model, the features of stochastic systems, delay systems, impulsive systems, and Markovian switching are all taken into account, which is scarce in the literature. Based on Lyapunov–Krasovskii functional method and stochastic analysis theory, we obtain new criteria ensuring p-moment stability of trivial solution of a class of impulsive stochastic differential delay equations with Markovian switching.     

Stochastic stability analysis for joint process driven and networked hybrid systems

The stochastic stability and impulsive noise disturbance attenuation in a class of joint process driven and networked hybrid systems with coupling delays (JPDNHSwD) has been investigated. In particular, there are two separable processes monitoring the networked hybrid systems. One drives inherent network structures and properties, the other induces random variations in the control law. Continuous dynamics and control laws in networked subsystems and couplings among subsystems change as events occur stochastically in a spatio-temporal fashion. When an event occurs, the continuous state variables may jump from one value to another. Using the stochastic Lyapunov functional approach, sufficient conditions on the existence of a remote time-delay feedback controller which ensures stochastic stability for this class of JPDNHSwD are obtained. The derived conditions are expressed in terms of solutions of LMIs. An illustrative example of a dynamical network driven by two Markovian processes is used to demonstrate the satisfactory control performance.     

Stability of singularly perturbed nonlinear stochastic hybrid systems

The problem of exponential mean-square stability of nonlinear singularly perturbed, stochastic hybrid systems is studied in this article. Two groups of nonlinear systems are considered separately. To obtain the sufficient conditions of stability, two basic approaches of stability analysis for hybrid systems with a given Markovian switching rule and any Markovian switching rule and singularly perturbed non–hybrid systems were combined. The Lyapunov techniques were used in both approaches. The obtained results are illustrated by examples.     

Quantized stabilization of discrete-time systems in a networked environment

This paper is concerned with the problem of output feedback stabilization for a class of discrete-time systems with sector nonlinearities and imperfect measurements. A unified control law model is proposed to take the network-induced delay, random packet dropout and measurement quantization into consideration simultaneously. By choosing appropriate Lyapunov functional, a new stability condition, which is dependent on multiple network status, is established for the resulting closed-loop system. Based on the result, a design criterion for the static output feedback controller is formulated in the form of nonconvex matrix inequalities, and the cone complementary linearization (CCL) procedure is exploited to solve the nonconvex feasibility problem. Incidentally, a less conservative synthesis method is also developed for the state feedback stabilization purpose. Finally, two illustrative examples are provided to illustrate the effectiveness and applicability of the proposed design method.     

Improved results for stochastic stabilization of a class of discrete-time singular Markovian jump systems with time-varying delay

In this paper, the problem of stochastic stabilization for a class of discrete-time singular Markovian jump systems with time-varying delay is investigated. By using the Lyapunov functional method and delay decomposition approach, improved delay-dependent sufficient conditions are presented, which guarantee the considered systems to be regular, causal and stochastically stabilizable. Finally, some numerical examples are provided to illustrate the effectiveness of the obtained methods.     

Stabilization of Stochastic Hybrid Linear Systems with Noise

Abstract

This article deals with the class of uncertain stochastic hybrid linear systems with noise. The uncertainties we are considering are of norm bounded type. The stochastic stabilization and robust stabilization problems are treated. Linear matrix inequality (LMI)-based sufficient conditions are developed to design the state feedback controller with constant gain that stochastically (robust stochastically) stabilizes the studied class of systems. Our results are mode independent and require only the complete access to the state vector. Numerical examples are given to show the effectiveness of the proposed results.     

Robust stabilization for uncertain switched impulsive control systems with state delay: An LMI approach

This paper deals with the problem of robust H_∞ state feedback stabilization for uncertain switched linear systems with state delay. The system under consideration involves time delay in the state, parameter uncertainties and nonlinear uncertainties. The parameter uncertainties are norm-bounded time-varying uncertainties which enter all the state matrices. The nonlinear uncertainties meet with the linear growth condition. In addition, the impulsive behavior is introduced into the given switched system, which results a novel class of hybrid and switched systems called switched impulsive control systems. Using the switched Lyapunov function approach, some sufficient conditions are developed to ensure the globally robust asymptotic stability and robust H_∞ disturbance attenuation performance in terms of certain linear matrix inequalities (LMIs). Not only the robustly stabilizing state feedback H_∞ controller and impulsive controller, but also the stabilizing switching law can be constructed by using the corresponding feasible solution to the LMIs. Finally, the effectiveness of the algorithms is illustrated with an example.     

Stabilization for hybrid stochastic systems by aperiodically intermittent control

In this paper, the mean-square exponential stabilization for stochastic differential equations with Markovian switching is studied. Specifically, a new set of sufficient conditions is derived to obtain the aperiodically intermittent control design which exponentially stabilizes the addressed hybrid stochastic differential equations. Further, stabilization problem by periodically intermittent control can be deduced as a special case from the developed results. As an application, we consider the Hopfield neutral network model with simulations to illustrate the effectiveness of developed aperiodically intermittent control design.     

Stabilization of stochastic singular nonlinear hybrid systems

This paper deals with the control of the class of singular nonlinear stochastic hybrid systems. Under some appropriate assumptions, results on stochastic stability and stochastic stabilization are developed. Two state feedback controllers (linear and nonlinear) that stochastically stabilize the class of systems we are considering are designed. LMI sufficient conditions are developed to compute the gains of these controllers.