Optimal Guaranteed Cost Control of Stochastic Discrete-Time Systems with States and Input Dependent Noise Under Markovian Switching

A problem of robust guaranteed cost control of stochastic discrete-time systems with parametric uncertainties under Markovian switching is considered. The control is simultaneously applied to both the random and the deterministic components of the system. The noise (the random) term depends on both the states and the control input. The jump Markovian switching is modeled by a discrete-time Markov chain and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Using linear matrix inequalities (LMIs) approach, the robust quadratic stochastic stability is obtained. The proposed control law for this quadratic stochastic stabilization result depended on the mode of the system. This control law is developed such that the closed-loop system with a cost function has an upper bound under all admissible parameter uncertainties. The upper bound for the cost function is obtained as a minimization problem. Two numerical examples are given to demonstrate the potential of the proposed techniques and obtained results.     

Hybrid Impulsive Control of Stochastic Systems with Multiplicative Noise Under Markovian Switching

A problem of state output feedback stabilization of discrete-time stochastic systems with multiplicative noise under Markovian switching is considered. Under some appropriate assumptions, the stability of this system under pure impulsive control is given. Further under hybrid impulsive control, the output feedback stabilization problem is investigated. The hybrid control action is formulated as a combination of the regular control along with an impulsive control action. The jump Markovian switching is modeled by a discrete-time Markov chain. The control input is simultaneously applied to both the stochastic and the deterministic terms. Sufficient conditions based on stochastic semi-definite programming and linear matrix inequalities (LMIs) for both stochastic stability and stabilization are obtained. Such a nonconvex problem is solved using the existing optimization algorithms and the nonconvex CVX package. The robustness of the stability and stabilization concepts against all admissible uncertainties are also investigated. The parameter uncertainties we consider here are norm bounded. Two examples are given to demonstrate the obtained results.     

p-Moment Stability of Stochastic Nonlinear Delay Systems with Impulsive Jump and Markovian Switching

Abstract

This article is concerned with the problem of p-moment stability of stochastic differential delay equations with impulsive jump and Markovian switching. In this model, the features of stochastic systems, delay systems, impulsive systems, and Markovian switching are all taken into account, which is scarce in the literature. Based on Lyapunov–Krasovskii functional method and stochastic analysis theory, we obtain new criteria ensuring p-moment stability of trivial solution of a class of impulsive stochastic differential delay equations with Markovian switching.     

具时变时滞和 Markovian转换的不确定奇异随机系统的鲁棒 H_∞ 滤波(英文)

本文处理了一类具与模式有关的时变时滞和 Markovian转换的不确定奇异随机系统的鲁棒H∞滤波问题.所考虑的系统包含参数不确定性,Markovian参数,随机扰动和与模式有关的时变时滞.本文的目的是设计一个滤波器以保证滤波错误系统是正则的、无脉冲的、鲁棒指数均方稳定的和可达到一个给定的 H∞扰动衰减水平.文章首先得到所求鲁棒指数H∞滤波器存在的充分条件,然后给出所求滤波器参数的显示表示.     

Generalized average dwell time approach to stability and input-to-state stability of hybrid impulsive stochastic differential systems

This paper is concerned with the stability properties of a class of impulsive stochastic differential systems with Markovian switching. Employing the generalized average dwell time (gADT) approach, some criteria on the global asymptotic stability in probability and the stochastic input-to-state stability of the systems under consideration are established. Two numerical examples are given to illustrate the effectiveness of the theoretical results, as well as the effects of the impulses and the Markovian switching on the systems stability.     

Quantized stabilization of stochastic systems with multiplicative noise under Markovian switching

A problem of quantized state feedback quadratic mean-square stabilization of discrete-time stochastic processes under Markovian switching and multiplicative noise is considered. A static quantizer is used in the feedback channel and the jump Markovian switching is modeled by a discrete-time Markov chain. The control input is simultaneously applied to both the rate vector and the diffusion term. It is shown that the coarsest quantization density that permits quadratic mean-square stabilization of this system is achieved with the use of a logarithmic quantizer, and the coarsest quantization density is determined by an algebraic Riccati equation, which is also the solution to a special linear stochastic Markovian switching control system. Also, sufficient conditions for exponential mean-square stabilization of such systems are also explored. An example is given to demonstrate the obtained results.     

On Stochastic Stabilization of Discrete‐Time Markovian Jump Systems with Delay in State

Abstract

In this paper, we investigate the stochastic stabilization problem for a class of linear discrete time‐delay systems with Markovian jump parameters. The jump parameters considered here is modeled by a discrete‐time Markov chain. Our attention is focused on the design of linear state feedback memoryless controller such that stochastic stability of the resulting closed‐loop system is guaranteed when the system under consideration is either with or without parameter uncertainties. Sufficient conditions are proposed to solve the above problems, which are in terms of a set of solutions of coupled matrix inequalities.     

随机线性系统保成本控制的线性矩阵不等式方法

考虑具有二次成本函数的随机线性系统,研究了状态反馈控制的保证成本控制问题.依据线性矩阵不等式得到了保证成本控制器存在的充分条件,最后得到了随机线性闭环系统保证成本最小的最优保证成本控制律的表达式.     

On optimal control problems of a class of impulsive switching systems with terminal states constraints

The global optimal control problem is proposed for a special class of hybrid dynamical systems, i.e. impulsive switching systems. Then the necessary condition of the above problem, the minimum principle, is given. Ekeland’s variational principle and the matrix cost functional structure expression are utilized in the process of the proof. Based on the main result, a special linear hybrid impulsive and switching system (HISS) is illustrated and the optimal control algorithm is presented. Moreover, the cases of pure impulsive systems and pure switched systems are included in this paper.     

Passivity analysis for stochastic Markovian switching genetic regulatory networks with time-varying delays

In this paper, the passivity problem for the stochastic Markovian switching genetic regulatory networks with time-varying delays is investigated. By applying control theory and mathematical tools, a sufficient condition for this problem is obtained and presented in terms of linear matrix inequalities (LMIs), which can be easily verified by Matlab LMI toolbox. The obtained condition provides some insight into synthetic biology and systems biology. Finally, a numerical example is given to show the effectiveness of the proposed result.     

Finite-time stability and stabilization of nonlinear stochastic hybrid systems

This paper deals with the problem of finite-time stability and stabilization of nonlinear Markovian switching stochastic systems which exist impulses at the switching instants. Using multiple Lyapunov function theory, a sufficient condition is established for finite-time stability of the underlying systems. Furthermore, based on the state partition of continuous parts of systems, a feedback controller is designed such that the corresponding impulsive stochastic closed-loop systems are finite-time stochastically stable. A numerical example is presented to illustrate the effectiveness of the proposed method.     

Delay-Dependent Criteria for Robust Stabilization of Markovian Switching Networks with Time-Varying Delay

Abstract

A problem of feedback stabilization of hybrid systems with time-varying delay and Markovian switching is considered. Delay-dependent sufficient conditions for stability based on linear matrix inequalities (LMI's) for stochastic asymptotic stability is obtained. The stability result depended on the mode of the system and of delay-dependent. The robustness results of such stability concept against all admissible uncertainties are also investigated. This new delay-dependent stability criteria is less conservative than the existing delay-independent stability conditions. An example is given to demonstrate the obtained results.     

GUARANTEED COST CONTROL OF CONTINUOUS-TIME UNCERTAIN SINGULAR SYSTEM WITH BOTH STATE AND INPUT DELAYS

The guaranteed cost control problem for a continuous-time uncertain singular system with state and control delays, and a given quadratic cost function is studied in this paper. Sufficient conditions for the existence of the guaranteed cost controller are derived based on the linear inequality (LMI) approach. A parameterized characterization of the guaranteed cost laws is given in terms of the feasible solutions to a certain LMI, and the cost function of guaranteed cost controller exists an upper bound.     

Robust guaranteed cost control for uncertain linear differential systems of neutral type

In this paper, the robust guaranteed cost control problem for a class of uncertain linear differential systems of neutral type with a given quadratic cost functions is investigated. The uncertainty is assumed to be norm-bounded and time-varying nonlinear. The problem is to design a state feedback control laws such that the closed-loop system is robustly stable and the closed-loop cost function value is not more than a specified upper bound for all admissible uncertainty and time delay. A criterion for the existence of such controllers is derived based on the matrix inequality approach combined with the Lyapunov method. A parameterized characterization of the robust guaranteed cost controllers is given in terms of the feasible solutions to the certain matrix inequalities. A numerical example is given to illustrate the proposed method.     

Robust stability and stabilization of linear stochastic systems with Markovian switching and uncertain transition rates

This paper is concerned with the robust stabilization problem for a class of linear uncertain stochastic systems with Markovian switching. The uncertain stochastic system with Markovian switching under consideration involves parameter uncertainties both in the system matrices and in the mode transition rates matrix. New criteria for testing the robust stability of such systems are established in terms of bi-linear matrix inequalities (BLMIs), and sufficient conditions are proposed for the design of robust state-feedback controllers. A numerical example is given to illustrate the effectiveness of our results.     

Necessary and Sufficient Condition for Robust Stability and Stabilizability of Continuous-Time Linear Systems with Markovian Jumps

In this paper, we investigate the quadratic stability and quadratic stabilizability of the class of continuous-time linear systems with Markovian jumps and norm-bound uncertainties in the parameters. Under some appropriate assumptions, a necessary and sufficient condition is established for mean-square quadratic stability and mean-square quadratic stabilizability of this class of systems. The quadratic guaranteed cost control problem is also addressed via a LMI optimization problem.     

Guaranteed Cost Observer–Based Controls for a Class of Uncertain Neutral Time-Delay Systems

In this paper, guaranteed-cost observer-based controls for a class of uncertain neutral time-delay systems are considered. The asymptotic stabilization for the uncertain neutral systems is guaranteed with an observer-based feedback control. The linear matrix inequality (LMI) approach is used to design the observer-based feedback control system. Two classes of observer-based controls are proposed and their guaranteed costs are given. The control and observer gains are given from the LMI feasible solutions. A convex optimization problem with LMIs is formulated to design the optimal guaranteed-cost observer-based controls which minimize the guaranteed cost of the system considered. A numerical example is given to illustrate the results.The research reported here was supported by the National Science Council of Taiwan, ROC under Grant NSC 93-2213-E-214-020     

Delay-dependent nonfragile guaranteed cost control for nonlinear time-delay systems

This paper concerns the nonfragile guaranteed cost control problem for a class of nonlinear dynamic systems with multiple time delays and controller gain perturbations. Guaranteed cost control law is designed under two classes of perturbations, namely, additive form and multiplicative form. The problem is to design a memoryless state feedback control law such that the closed-loop system is asymptotically stable and the closed-loop cost function value is not more than a specified upper bound for all admissible uncertainties. Based on the linear matrix inequality (LMI) approach, some delay-dependent conditions for the existence of such controller are derived. A numerical example is given to illustrate the proposed method.     

Output feedback guaranteed cost control of uncertain linear discrete systems with interval time-varying delays

This paper deals with output feedback guaranteed cost control problem for a general class of uncertain linear discrete delay systems, where the state and the observation output are subjected to interval time-varying delay. The proposed output feedback controller uses the observation measurement to exponentially stabilize the closed-loop system and guarantee an adequate level of system performance. By constructing a set of augmented Lyapunov–Krasovskii functionals, a delay-dependent condition for the robust output feedback guaranteed cost control is established in terms of linear matrix inequalities (LMIs). Three numerical examples are provided to demonstrate the efficiency of the proposed method.     

Exponential Stability in Mean Square for a General Class of Discrete-Time Linear Stochastic Systems

Abstract

The problem of the mean square exponential stability for a class of discrete-time linear stochastic systems subject to independent random perturbations and Markovian switching is investigated. The case of the linear systems whose coefficients depend both to present state and the previous state of the Markov chain is considered. Three different definitions of the concept of exponential stability in mean square are introduced and it is shown that they are not always equivalent. One definition of the concept of mean square exponential stability is done in terms of the exponential stability of the evolution defined by a sequence of linear positive operators on an ordered Hilbert space. The other two definitions are given in terms of different types of exponential behavior of the trajectories of the considered system. In our approach the Markov chain is not prefixed. The only available information about the Markov chain is the sequence of probability transition matrices and the set of its states. In this way one obtains that if the system is affected by Markovian jumping the property of exponential stability is independent of the initial distribution of the Markov chain.

The definition expressed in terms of exponential stability of the evolution generated by a sequence of linear positive operators, allows us to characterize the mean square exponential stability based on the existence of some quadratic Lyapunov functions.

The results developed in this article may be used to derive some procedures for designing stabilizing controllers for the considered class of discrete-time linear stochastic systems in the presence of a delay in the transmission of the data.