HMM-based quantized dissipative control for 2-D Markov jump systems

In this paper, the dissipative quantized control problem is addressed for Markov jump two-dimensional systems based on Roesser model, in which both asynchronous phenomenon and signal quantization between system modes and controller modes are taken into consideration simultaneously. Moreover, the hidden Markov model (HMM) is adopted to tackle such an asynchronous phenomenon. The principal goal is to devise a state feedback controller, which guarantees that the established closed-loop system achieves asymptotic mean square stability as well as satisfies a prescribed extended dissipative property. Drawing support from Lyapunov function approach and inequality technique, some less conservative criteria ensuring the implementability of the desired controller are derived. Ultimately, the availability and practicability of the developed results are certified through a simulation example.     

Dynamic event-triggered control for discrete-time nonlinear Markov jump systems using policy iteration-based adaptive dynamic programming

This paper investigates a dynamic event-triggered optimal control problem of discrete-time (DT) nonlinear Markov jump systems (MJSs) via exploring policy iteration (PI) adaptive dynamic programming (ADP) algorithms. The performance index function (PIF) defined in each subsystem is updated by utilizing an online PI algorithm, and the corresponding control policy is derived via solving the optimal PIF. Then, we adopt neural network (NN) techniques, including an actor network and a critic network, to estimate the iterative PIF and control policy. Moreover, the designed dynamic event-triggered mechanism (DETM) is employed to avoid wasting additional resources when the estimated iterative control policy is updated. Finally, based on the Lyapunov difference method, it is proved that the system stability and the convergence of all signals can be guaranteed under the developed control scheme. A simulation example for DT nonlinear MJSs with two system modes is presented to demonstrate the feasibility of the control design scheme.     

From Markov jump systems to two species competitive Lotka-Volterra equations with diffusion

In this paper, we start at a random evolution system on biological particles, which is described by a Markov jump system. Under a suitable scaling, we perform a proper approximation procedure. Then the so-called weak convergence of Markov processes and Martingales allow us to establish a （deterministic） two species competitive Lotka-Volterra equation.     

Switching design for suboptimal guaranteed cost control of 2-D nonlinear switched systems in the Roesser model

This paper deals with the problem of switching design for guaranteed cost control of discrete-time two-dimensional (2-D) nonlinear switched systems described by the Roesser model. The switching signal, which determines the active mode of the system, is subject to a state-dependent process whose values belong to a finite index set. By using 2-D common Lyapunov function approach, a sufficient condition expressed in terms of tractable matrix inequalities is first established to design a min-projection switching rule that makes the 2-D switched system asymptotically stable. The obtained result on stability analysis is then utilized to synthesize a suboptimal state feedback controller that minimizes the upper bound of a given infinite-horizon cost function. Finally, two numerical examples are given to illustrate the effectiveness of the proposed design method.     

Set controllability of Markov jump switching Boolean control networks and its applications

In this article, a novel method is proposed for investigating the set controllability of Markov jump switching Boolean control networks (MJSBCNs). Specifically, the switching signal is described as a discrete-time homogeneous Markov chain. By resorting to the expectation and switching indicator function, an expectation system is constructed. Based on the expectation system, a novel verifiable condition is established for solving the set reachability of MJSBCNs. With the newly obtained results on set reachability, a necessary and sufficient condition is further derived for the set controllability of MJSBCNs. The obtained results are applied to Boolean control networks with Markov jump time delays. Examples are demonstrated to justify the theoretical results.     

Stochastic stability for Markovian jump linear systems associated with a finite number of jump times

This paper deals with a stochastic stability concept for discrete-time Markovian jump linear systems. The random jump parameter is associated to changes between the system operation modes due to failures or repairs, which can be well described by an underlying finite-state Markov chain. In the model studied, a fixed number of failures or repairs is allowed, after which, the system is brought to a halt for maintenance or for replacement. The usual concepts of stochastic stability are related to pure infinite horizon problems, and are not appropriate in this scenario. A new stability concept is introduced, named stochastic τ-stability that is tailored to the present setting. Necessary and sufficient conditions to ensure the stochastic τ-stability are provided, and the almost sure stability concept associated with this class of processes is also addressed. The paper also develops equivalences among second order concepts that parallels the results for infinite horizon problems.     

Impulsive Markov jump linear systems: Stability analysis and H2 control

In this work, we present an impulsive Markov jump linear system model. We show how the present model generalises previous works from the literature, and we devise necessary and sufficient conditions for stability and performance, together with mode-dependent state-feedback control design conditions for such systems. An applied example shows how the developed theory can be used to control strategies under actuator and sensor failures.     

Risk sensitive control of pure jump processes on a general state space

We study stochastic control problem for pure jump processes on a general state space with risk sensitive discounted and ergodic cost criteria. For the discounted cost criterion we prove the existence and Hamilton–Jacobi–Bellman characterization of optimal α-discounted control for bounded cost function. For the ergodic cost criterion we assume a Lyapunov type stability assumption and a small cost condition. Under these assumptions we show the existence of the optimal risk-sensitive ergodic control.     

Memory-based adaptive event-triggered asynchronous tracking control for semi-Markov jump systems with hybrid actuator faults

In this paper, the extended dissipative asynchronous tracking control problem is studied for semi-Markov jump systems with hybrid actuator faults via a memory-based adaptive event-triggered mechanism. Firstly, since the system mode and controller mode do not match exactly, an asynchronous tracking control based on hidden Markov model is designed. Secondly, compared with existing memory-based and memoryless event-triggered mechanisms, the memory-based adaptive event-triggered mechanism proposed in this paper can achieve better performance according to the historical data released and the adaptive event triggering threshold. Next, considering the unsafe operating environment of the device, an asynchronous hybrid actuator failure model is constructed. Furthermore, by designing appropriate Lyapunov–Krasovskii functional, the stochastic stability and extended dissipative performance of the closed-loop system can be guaranteed. Finally, the effectiveness of the proposed method is proved by simulation examples.     

Linear optimal control problem for discrete 2-D systems with constraints

Optimal control problem for linear two-dimensional (2-D) discrete systems with mixed constraints is investigated. The problem under consideration is reduced to a linear programming problem in appropriate Hubert space. The main duality relations for this problem is derived such that the optimality conditions for the control problem are specified by using methods of the linear operator theory. Optimality conditions are expressed in terms of solutions for conjugate system.     

Constrained MPC design of nonlinear Markov jump system with nonhomogeneous process

In this paper, a differential-inclusion-based MPC scheme is developed for the controller design for a discrete time nonlinear Markov jump system with nonhomogeneous transition probability. By adopting a differential-inclusion-based convex model predictive control mechanism, the nonlinear Markov jump system with nonhomogeneous transition probability is enclosed by a set of linear Markov jump systems. In this way, the controller design for the nonlinear Markov jump system can be solved via solving a set of linear Markov jump systems. Two numerical examples with different weighting parameters R are presented to illustrate the applicability of the results obtained.     

受控马尔可夫跳线性系统的随机鲁棒稳定性

本文讨论了受控连续和离散时间马尔可夫跳线性系统的随机鲁棒稳定性,并且给出了此时该系统发生马尔可夫跳的转移速率的一个界.     

Stochastic stability of positive Markov jump linear systems with fixed dwell time

This paper studies the stochastic stability of positive Markov jump linear systems with a fixed dwell time. By constructing an auxiliary system that originated from the initial system with state jumps, sufficient and necessary conditions of stochastic stability for positive Markov jump linear systems are obtained with both exactly known and partially known transition rates. The main idea in the latter case is applying a convex combination to convert bilinear programming into linear programming problems. On this basis, multiple piecewise linear co-positive Lyapunov functions are provided to achieve less conservative results. Then state feedback controller is designed to stabilize the positive Markov jump linear systems by solving linear programming problems. Numerical examples are presented to illustrate the viability of our conclusions.     

The use of Markov operators to constructing generalised probabilities

A new approach to constructing generalised probabilities is proposed. It is based on the models using lower and upper previsions, or equivalently, convex sets of probability measures. Our approach uses sets of Markov operators in the role of rules preserving desirability of gambles. The main motivation being the operators of conditional expectations which are usually assumed to reduce riskiness of gambles. Imprecise probability models are then obtained in the ways to be consistent with those desirability preserving rules. The consistency criteria are based on the existing interpretations of models using imprecise probabilities. The classical models based on lower and upper previsions are shown to be a special class of the generalised models. Further, we generalise some standard extension procedures, including the marginal extension and independent products, which can be defined independently of the existing procedures known for standard models.     

Memory feedback controller design for stochastic Markov jump distributed delay systems with input saturation and partially known transition rates

This paper considers the problem of stabilization for a class of stochastic Markov jump distributed delay systems with partially known transition rates subject to saturating actuators. By employing local sector conditions and an appropriate Lyapunov function, a state memory feedback controller is designed to guarantee that the resulted closed-loop constrained systems are mean-square stochastic asymptotically stable. Some sufficient conditions for the solution to this problem are derived in terms of linear matrix inequalities. Finally, a numerical example is provided to demonstrate the effectiveness of the proposed method.     

A sliding mode approach to robust stabilisation of Markovian jump linear time-delay systems with generally incomplete transition rates

This paper is devoted to investigating the problem of robust sliding mode control for a class of uncertain Markovian jump linear time-delay systems with generally uncertain transition rates (GUTRs). In this GUTR model, each transition rate can be completely unknown or only its estimate value is known. By making use of linear matrix inequalities technique, sufficient conditions are presented to derive the linear switching surface and guarantee the stochastic stability of sliding mode dynamics. A sliding mode control law is developed to drive the state trajectory of the closed-loop system to the specified linear switching surface in a finite-time interval in spite of the existing uncertainties, time delays and unknown transition rates. Finally, an example is presented to verify the validity of the proposed method.     

Observer-based finite-time control of time-delayed jump systems

This paper provides the observer-based finite-time control problem of time-delayed Markov jump systems that possess randomly jumping parameters. The transition of the jumping parameters is governed by a finite-state Markov process. The observer-based finite-time H_∞ controller via state feedback is proposed to guarantee the stochastic finite-time boundedness and stochastic finite-time stabilization of the resulting closed-loop system for all admissible disturbances and unknown time-delays. Based on stochastic finite-time stability analysis, sufficient conditions that ensure stochastic robust control performance of time-delay jump systems are derived. The control criterion is formulated in the form of linear matrix inequalities and the designed finite-time stabilization controller is described as an optimization one. The presented results are extended to time-varying delayed MJSs. Simulation results illustrate the effectiveness of the developed approaches.