Deterministic and stochastic approaches to supervisory control design for networked systems with time-varying communication delays

This paper proposes a supervisory control structure for networked systems with time-varying delays. The control structure, in which a supervisor triggers the most appropriate controller from a multi-controller unit, aims at improving the closed-loop performance relative to what can be obtained using a single robust controller. Our analysis considers average dwell-time switching and is based on a novel multiple Lyapunov–Krasovskii functional. We develop stability conditions that can be verified by semi-definite programming, and show that the associated state feedback synthesis problem also can be solved using convex optimization tools. Extensions of the analysis and synthesis procedures to the case when the evolution of the delay mode is described by a Markov chain are also developed. Simulations on small and large-scale networked control systems are used to illustrate the effectiveness of our approach.     

An exact minimum variance filter for a class of discrete time systems with random parameter perturbations

An exact, closed-form minimum variance filter is designed for a class of discrete time uncertain systems which allows for both multiplicative and additive noise sources. The multiplicative noise model includes a popular class of models (Cox-Ingersoll-Ross type models) in econometrics. The parameters of the system under consideration which describe the state transition are assumed to be subject to stochastic uncertainties. The problem addressed is the design of a filter that minimizes the trace of the estimation error variance. Sensitivity of the new filter to the size of parameter uncertainty, in terms of the variance of parameter perturbations, is also considered. We refer to the new filter as the ‘perturbed Kalman filter’ (PKF) since it reduces to the traditional (or unperturbed) Kalman filter as the size of stochastic perturbation approaches zero. We also consider a related approximate filtering heuristic for univariate time series and we refer to filter based on this heuristic as approximate perturbed Kalman filter (APKF). We test the performance of our new filters on three simulated numerical examples and compare the results with unperturbed Kalman filter that ignores the uncertainty in the transition equation. Through numerical examples, PKF and APKF are shown to outperform the traditional (or unperturbed) Kalman filter in terms of the size of the estimation error when stochastic uncertainties are present, even when the size of stochastic uncertainty is inaccurately identified.     

Optimal control for linear discrete-time systems with Markov perturbations in Hilbert spaces

Email: vio{at}utgjiu.ro Received on September 12, 2007; Accepted on December 26, 2008 In this article, we discuss a quadratic control problem forlinear discrete-time systems with Markov perturbations in Hilbertspaces, which is linked to a discrete-time Riccati equationdefined on certain infinite-dimensional ordered Banach space.We prove that under stabilizability and stochastic uniform observabilityconditions, the Riccati equation has a unique, uniformly positive,bounded on N and stabilizing solution. Based on this result,we solve the proposed optimal control problem. An example illustratesthe theory.     

Design of a fixed-interval smoother using covariance information based on the innovations approach in linear discrete-time stochastic systems

This paper describes a design for a recursive least-squares Wiener fixed-interval smoother using the covariance information in linear discrete-time stochastic systems. The estimators require information from the observation matrix, the system matrix for the state variable, related to the signal, the variance of the state variable, the cross-variance function of the state variable with the observed value and the variance of the white observation noise. It is assumed that the signal is observed with additive white noise.     

Controller design for stabilizing bilinear systems with state-based switching

Some nonlinear systems can be approximated by switching bilinear systems. In this paper, we proposed a method to design state-based stabilizing controller for switching bilinear systems. Based on the similarity between switching bilinear systems and switching linear systems, corresponding switching linear systems are obtained for switching bilinear systems by applying state-based feedback control laws. Instead, we consider asymptotically stabilizing the corresponding switching linear system through solving a number of relaxed LMI conditions. Stabilizing controllers for switching bilinear systems can be derived based on the results of the corresponding switching linear systems. The stability of the controller is proved step by step through the decreasing of the multiple Lyapunov functions along the state trajectory. The effectiveness of the method is demonstrated by both a theoretical example and an example of urban traffic network with traffic signals.     

Exponential estimates for stochastic delay hybrid systems with Markovian switching

This paper deals with the problem of norm bounds for the solutions of stochastic hybrid systems with Markovian switching and time delay.Based on Lyapunov-Krasovskii theory for functional differential equations and the linear matrix inequality(LMI)approach,mean square exponential estimates for the solutions of this class of linear stochastic hybrid systems are derived.Finally,An example is illustrated to show the applicability and effectiveness of our method.     

A universal design of Freeman's formula for the stabilization of stochastic systems

The purpose of this article is to extend Freeman’s formula for the stabilization of nonlinear deterministic systems affine in the control to nonlinear stochasticdifferential systems when both the drift and diffusion terms areaffine in the control. We prove that the knowledge of a smooth α–control Lyapunov function implies the existence of a state feedback law continuous at the origin and smooth everywhere else which can be designed explicitly andrenders the system asymptotically stable in probability.     

Stability analysis for stochastic jump systems with time-varying delay

This paper deals with the mean-square asymptotic stability of stochastic Markovian jump systems with time-varying delay. Based on a new stochastic inequality and convex analysis property, some novel stability conditions are presented. In the derivation, the information of the time-varying delay is retained and the estimation of it by the worst-case enlargement is not involved. Some special cases of the systems under consideration are also investigated. Illustrative examples are given to show the effectiveness of the proposed approach.     

Self-triggered filter design for a class of nonlinear stochastic systems with Markovian jumping parameters

This paper is concerned with the self-triggered filtering problem for a class of Markovian jumping nonlinear stochastic systems. The event-triggered mechanism (ETM) is employed between the sensor and the filter to reduce unnecessary measurement transmission. Governed by the ETM, the measurement is transmitted to the filter as long as a predefined condition is satisfied. The purpose of the addressed problem is to synthesize a filter such that the dynamics of the filtering error is bounded in probability (BIP). A sufficient condition is first given to ensure the boundedness in probability of the filtering error dynamics, and the characterization of the desired filter gains is then realized by means of the feasibility of certain matrix inequalities. Furthermore, a self-triggered mechanism is designed to guarantee the filtering error dynamics to be BSP with excluded Zeno phenomenon. In the end, numerical simulation is carried out to illustrate the usefulness of the proposed self-triggered filtering algorithm.     

Finite-time synchronization for coupled systems with time delay and stochastic disturbance under feedback control

This paper proposes a framework for finite-time synchronization of coupled systems with time delay and stochastic disturbance under feedback control. Combining Kirchhoff"s Matrix Tree Theorem with Lyapunov method as well as stochastic analysis techniques, several sufficient conditions are derived. Differing from previous references, the finite time provided by us is related to topological structure of networks. In addition, two concrete applications about stochastic coupled oscillators with time delay and stochastic Lorenz chaotic coupled systems with time delay are presented, respectively. Besides, two synchronization criteria are provided. Ultimately, two numerical examples are given to illustrate the effectiveness and feasibility of the obtained results.     

Stochastic stabilization of networked control systems with combined stochastic distributed processes

The stochastic stability problem of networked control systems (NCSs) with random time delays and packet dropouts is investigated in this paper. The mathematical NCS model is developed as a stochastic discrete‐time jump system with combined integrated stochastic parameters characterized by two identically independently distributed processes, which accommodate the abrupt variations of network uncertainties within an integrated frame. The effective instant is introduced to establish the relationship between the destabilizing transmission factors and stability of NCSs. The stabilizing state feedback controller gain that depends not only on the delay modes but also on the dropouts modes is obtained in terms of the linear matrix inequalities formulation via the Schur complement theory. A numerical example is given to demonstrate the effectiveness of the proposed method. Copyright © 2014 John Wiley & Sons, Ltd.     

Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model

In order to reduce computational burden and improve the convergence rate of identification algorithms, an auxiliary model based multi-innovation stochastic gradient (AM-MISG) algorithm is derived for the multiple-input single-output systems by means of the auxiliary model identification idea and multi-innovation identification theory. The basic idea is to replace the unknown outputs of the fictitious subsystems in the information vector with the outputs of the auxiliary models and to present an auxiliary model based stochastic gradient algorithm, and then to derive the AM-MISG algorithm by expanding the scalar innovation to innovation vector and introducing the innovation length. The simulation example shows that the proposed algorithms work quite well.     

LP-stabilization problem for linear stochastic control systems with multiplicative noise

For the deterministic case, a linear controlled system is alwayspth order stable as long as we use the control obtained as the solution of the so-called LQ-problem. For the stochastic case, however, a linear controlled system with multiplicative noise is not alwayspth mean stable for largep, even if we use the LQ-optimal control. Hence, it is meaningful to solve the LP-optimal control problem (i.e., linear system,pth order cost functional) for eachp. In this paper, we define the LP-optimal control problem and completely solve it for the scalar case. For the multidimensional case, we get some results, but the general solution of this problem seems to be impossible. So, we consider thepth mean stabilization problem more intensively and give a sufficient condition for the existence of apth mean stabilizing control by using the contraction mapping method in a Hilbert space. Some examples are also given.This research was conducted while the author was a visitor at the Forschungsschwerpunkt Dynamische Systeme, Universität Bremen, Bremen, West Germany. The author is grateful to Professor L. Arnold for providing interesting seminars and excellent working conditions during his stay. The financial assistance given by the Alexander von Humboldt Foundation during the author's stay is also gratefully acknowledged.     

Reduced-order filtering with energy-to-peak performance for discrete-time Markovian jumping systems

In this paper, the l₂–l (energy-to-peak) performanceof the discrete-time Markovian jump linear system is investigated.The jump parameters are modelled by a discrete-time Markov process.Furthermore, we study the l₂–l reduced-order filteringproblem for the Markovian jump linear system. A reduced-orderfilter with the same randomly jumping parameters is proposedwhich can make the error systems with Markovian jump parametersstochastically stable with a prescribed l₂–lperformance.Sufficient conditions in terms of linear matrix inequalities(LMIs) and a coupling non-convex rank constraint are derivedfor the existence of a solution to the reduced-order filteringproblems. A numerical example is given to illustrate the designprocedures.     

Bias compensation methods for stochastic systems with colored noise

For ARX-like systems, this paper derives a bias compensation based recursive least squares identification algorithm by means of the prefilter idea and bias compensation principle. The proposed algorithm can give the unbiased estimates of the system model parameters in the presence of colored noises, and can be on-line implemented. Finally, the advantages of the proposed bias compensation recursive least squares algorithm are shown by simulation tests.     

The guaranteed cost control for uncertain nonlinear large-scale stochastic systems via state and static output feedback

The guaranteed cost control (GCC) problem involved in decentralized robust control of a class of uncertain nonlinear large-scale stochastic systems with high-order interconnections is considered. After determining the appropriate conditions for the stochastic GCC controller, a class of decentralized local state feedback controllers is derived using the linear matrix inequality (LMI). The extension of the result of the study to the static output feedback control problem is discussed by considering the Karush-Kuhn-Tucker (KKT) conditions. The efficiency of the proposed design method is demonstrated on the basis of simulation results.     

Filtering for a class of nonlinear discrete-time stochastic systems with state delays

In this paper, the filtering problem is investigated for a class of nonlinear discrete-time stochastic systems with state delays. We aim at designing a full-order filter such that the dynamics of the estimation error is guaranteed to be stochastically, exponentially, ultimately bounded in the mean square, for all admissible nonlinearities and time delays. First, an algebraic matrix inequality approach is developed to deal with the filter analysis problem, and sufficient conditions are derived for the existence of the desired filters. Then, based on the generalized inverse theory, the filter design problem is tackled and a set of the desired filters is explicitly characterized. A simulation example is provided to demonstrate the usefulness of the proposed design method.