Optimal Guaranteed Cost Control of Stochastic Discrete-Time Systems with States and Input Dependent Noise Under Markovian Switching

A problem of robust guaranteed cost control of stochastic discrete-time systems with parametric uncertainties under Markovian switching is considered. The control is simultaneously applied to both the random and the deterministic components of the system. The noise (the random) term depends on both the states and the control input. The jump Markovian switching is modeled by a discrete-time Markov chain and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Using linear matrix inequalities (LMIs) approach, the robust quadratic stochastic stability is obtained. The proposed control law for this quadratic stochastic stabilization result depended on the mode of the system. This control law is developed such that the closed-loop system with a cost function has an upper bound under all admissible parameter uncertainties. The upper bound for the cost function is obtained as a minimization problem. Two numerical examples are given to demonstrate the potential of the proposed techniques and obtained results.     

Hybrid Impulsive Control of Stochastic Systems with Multiplicative Noise Under Markovian Switching

A problem of state output feedback stabilization of discrete-time stochastic systems with multiplicative noise under Markovian switching is considered. Under some appropriate assumptions, the stability of this system under pure impulsive control is given. Further under hybrid impulsive control, the output feedback stabilization problem is investigated. The hybrid control action is formulated as a combination of the regular control along with an impulsive control action. The jump Markovian switching is modeled by a discrete-time Markov chain. The control input is simultaneously applied to both the stochastic and the deterministic terms. Sufficient conditions based on stochastic semi-definite programming and linear matrix inequalities (LMIs) for both stochastic stability and stabilization are obtained. Such a nonconvex problem is solved using the existing optimization algorithms and the nonconvex CVX package. The robustness of the stability and stabilization concepts against all admissible uncertainties are also investigated. The parameter uncertainties we consider here are norm bounded. Two examples are given to demonstrate the obtained results.     

Guaranteed Cost Control for a Class of Uncertain Stochastic Impulsive Systems with Markovian Switching

Abstract

This article is concerned with the problem of guaranteed cost control for a class of uncertain stochastic impulsive systems with Markovian switching. To the best of our knowledge, it is the first time that such a problem is investigated for stochastic impulsive systems with Markovian switching. For an uncontrolled system, the conditions in terms of certain linear matrix inequalities (LMIs) are obtained for robust stochastical stability and an upper bound is given for the cost function. For the controlled systems, a set of LMIs is developed to design a linear state feedback controller which can stochastically stabilize the class of systems under study and guarantee the given cost function to have an upper bound. Further, an optimization problem with LMI constraints is formulated to minimize the guaranteed cost of the closed-loop system. Finally, a numerical example is provided to show the effectiveness of the proposed method.     

Delay-Dependent Criteria for Robust Stabilization of Markovian Switching Networks with Time-Varying Delay

Abstract

A problem of feedback stabilization of hybrid systems with time-varying delay and Markovian switching is considered. Delay-dependent sufficient conditions for stability based on linear matrix inequalities (LMI's) for stochastic asymptotic stability is obtained. The stability result depended on the mode of the system and of delay-dependent. The robustness results of such stability concept against all admissible uncertainties are also investigated. This new delay-dependent stability criteria is less conservative than the existing delay-independent stability conditions. An example is given to demonstrate the obtained results.     

Markov切换随机双线性系统依概率渐进稳定性

本文研究随机双线性系统大范围渐进稳定性。利用数学期望不等式给出了随机双线性系统渐进稳定的新标准。设计了一种非线性状态反馈控制器,利用类Riccati不等式推出了Markov切换随机双线性系统大范围依概率渐进稳定的充分条件。数值算例表明本文提出的方法是可行的。     

p-Moment Stability of Stochastic Nonlinear Delay Systems with Impulsive Jump and Markovian Switching

Abstract

This article is concerned with the problem of p-moment stability of stochastic differential delay equations with impulsive jump and Markovian switching. In this model, the features of stochastic systems, delay systems, impulsive systems, and Markovian switching are all taken into account, which is scarce in the literature. Based on Lyapunov–Krasovskii functional method and stochastic analysis theory, we obtain new criteria ensuring p-moment stability of trivial solution of a class of impulsive stochastic differential delay equations with Markovian switching.     

����״̬������Markov�л����ʱ��ϵͳ�ľ���ָ���ȶ���

考察一类Markov切换时变时滞随机系统的均方指数稳定性. 利用基于Liapunov函数和线性矩阵不等式的方法, 给出了使状态反馈控制系统能克服不确定性和随机干扰, 在均方意义下达到指数稳定的充分条件. 当Markov链遍历所有模态时, 给出了一个独立于Markov链模态集的增益矩阵, 使得状态反馈控制系统均方指数稳定     

具有马尔可夫调制的随机微分方程数值解的收敛性

本文在无穷维Hilbert空间中研究了一类具有马尔可夫调制的随机微分方程(SDEwMSs).在一般情况下SDEwMSs没有解析解.因此合适的数值逼近法,例如欧拉法,就是在研究它们性质时所采用的重要工具.本文在较弱的条件下不仅证明了欧拉近似解收敛于SDEwMSs的精确解(分析解),而且给出了欧拉近似阶的界.     

比较原理和带马尔可夫调制的随机泛函微分方程

本文考虑带马尔可夫调制的随机泛函微分方程解的不稳定性,通过建立的新的比较原理,得到一些不稳定的判据.     

Stabilization of Stochastic Hybrid Linear Systems with Noise

Abstract

This article deals with the class of uncertain stochastic hybrid linear systems with noise. The uncertainties we are considering are of norm bounded type. The stochastic stabilization and robust stabilization problems are treated. Linear matrix inequality (LMI)-based sufficient conditions are developed to design the state feedback controller with constant gain that stochastically (robust stochastically) stabilizes the studied class of systems. Our results are mode independent and require only the complete access to the state vector. Numerical examples are given to show the effectiveness of the proposed results.     

网络化马尔可夫跳变系统的鲁棒无源控制

针对基于网络的凸多面体不确定离散时间马尔可夫跳变系统,研究其鲁棒无源控制问题.在网络诱导时滞是时变且有界的情况下,基于李雅普诺夫稳定性理论,通过构造参数依赖的随机李雅普诺夫泛函和运用广义系统变换,提出了不依赖模态的无源控制器存在的时滞依赖充分条件.所设计的鲁棒无源控制器保证了相应的闭环系统是鲁棒随机稳定且具有指定耗散率.将鲁棒无源控制器设计问题转化为一组线性矩阵不等式的可解性问题.仿真算例证明了本文方法的有效性.     

Delay Range-Dependent Stability Analysis for Markovian Jumping Stochastic Systems with Nonlinear Perturbations

This article addresses the problem of delay-dependent stability for Markovian jumping stochastic systems with interval time-varying delays and nonlinear perturbations. The delay is assumed to be time-varying and belongs to a given interval. By resorting to Lyapunov–Krasovskii functionals and stochastic stability theory, a new delay interval-dependent stability criterion for the system is obtained. It is shown that the addressed problem can be solved if a set of linear matrix inequalities (LMIs) are feasible. Finally, a numerical example is employed to illustrate the effectiveness and less conservativeness of the developed techniques.     

Stability of Delayed Markovian Switching Stochastic Neutral-type Reaction-diffusion Neural Networks

This paper is concerned about exponential stability in mean square of Markovian switching delayed reaction-diffusion neutral-type stochastic neural networks (RNSNNs). By Lyapunov function method, several novel stability criteria on exponential mean square stability of Markovian switching RNSNNs with time-varying delays are obtained. In the end, two examples are given to verify the feasibility of our findings.     

Randomized Algorithms for Robust Stability and Guaranteed Cost Control of Stochastic Jump Parameter Systems with Uncertain Switching Policies

It has been suggested recently that the uncertainty randomization approach may offer numerical advantages when applied to robust control problems. This paper investigates new possibilities which this approach may offer in relation to the robust stability and control of stochastic systems governed by uncertain discrete-state Markov processes.This work was supported by the Australian Research Council.The author thanks Professors R. Tempo and B. Polyak for discussions concerning possible applications of the results of Refs. 9--10. Also, technical discussions with Professor R. Tempo and Dr. Y. Fujisaki during the author visit to IRITI-CNR, Torino, Italy are gratefully acknowledged.     

带马尔可夫切换的Q过程的遍历性

本文应用Foster-Lyapunov不等式和耦合方法,研究了一类带马尔可夫切换的Q过程的指数遍历性和强遍历性; 同时,也构造了一些关于这类带马尔可夫切换的Q过程的耦合,并证明某些耦合是成功的.     

带Poisson跳和Markovian调制的中立型随机延迟微分方程的数值解的收敛性

本文研究带Poisson跳和Markovian调制的中立型随机微分方程的数值解的收敛性质.用数值逼近方法求此微分方程的解,并证明了Euler近似解在此线性增长条件和全局Lipschitz条件更弱的条件下仍均方收敛于此方程的解析解.     

带Markov状态转换的跳扩散方程的数值解

研究了一类带Markov状态转换的跳扩散方程的数值解的问题,为讨论这类方程精确解的数值计算问题,我们给出了一种基于Euler格式的方程解的跳适应算法,并在一定的条件下,证明了基于这种新的跳适应算法所得到的方程的数值解是收敛于它的精确解,同时还给出了数值解收敛到其精确解的收敛阶数.最后,本文通过两个例子说明了这种跳适应算法的计算有效性.     

Stochastic stability and robust control for sampled-data systems with Markovian jump parameters

In this paper, the problems of stochastic stability and robust control for a class of uncertain sampled-data systems are studied. The systems consist of random jumping parameters described by finite-state semi-Markov process. Sufficient conditions for stochastic stability or exponential mean square stability of the systems are presented. The conditions for the existence of a sampled-data feedback control and a multirate sampled-data optimal control for the continuous-time uncertain Markovian jump systems are also obtained. The design procedure for robust multirate sampled-data control is formulated as linear matrix inequalities (LMIs), which can be solved efficiently by available software toolboxes. Finally, a numerical example is given to demonstrate the feasibility and effectiveness of the proposed techniques.     

Stability with general decay rates of stochastic differential delay equations with Poisson jumps and Markovian switching

In this paper, some criteria on pth moment stability and almost sure stability with general decay rates of stochastic differential delay equations with Poisson jumps and Markovian switching are obtained. Two examples are presented to illustrate our theories.