Stochastic stability of quasi-integrable and non-resonant Hamiltonian systems under parametric excitations of combined Gaussian and Poisson white noises

A procedure for calculating the largest Lyapunov exponent and determining the asymptotic Lyapunov stability with probability one of multi-degree-of-freedom (MDOF) quasi-integrable and non-resonant Hamiltonian systems under parametric excitations of combined Gaussian and Poisson white noises is proposed. The averaged stochastic differential equations (SDEs) of quasi-integrable and non-resonant Hamiltonian systems subject to parametric excitations of combined Gaussian and Poisson white noises are first derived by using the stochastic averaging method for quasi-Hamiltonian systems and the stochastic jump-diffusion chain rule. Then, the expression for the largest Lyapunov exponent is obtained by generalizing Khasminskii's procedure to the averaged SDEs and the stochastic stability of the original systems is determined approximately. An example is given to illustrate the application of the proposed procedure and its effectiveness is verified by comparing with the results from Monte Carlo simulation.     

Stochastic fractional optimal control of quasi-integrable Hamiltonian system with fractional derivative damping

A stochastic fractional optimal control strategy for quasi-integrable Hamiltonian systems with fractional derivative damping is proposed. First, equations of the controlled system are reduced to a set of partially averaged It $\hat{o}$ stochastic differential equations for the energy processes by applying the stochastic averaging method for quasi-integrable Hamiltonian systems and a stochastic fractional optimal control problem (FOCP) of the partially averaged system for quasi-integrable Hamiltonian system with fractional derivative damping is formulated. Then the dynamical programming equation for the ergodic control of the partially averaged system is established by using the stochastic dynamical programming principle and solved to yield the fractional optimal control law. Finally, an example is given to illustrate the application and effectiveness of the proposed control design procedure.     

Optimal bounded control of quasi-nonintegrable Hamiltonian systems using stochastic maximum principle

A new procedure for designing optimal bounded control of quasi-nonintegrable Hamiltonian systems with actuator saturation is proposed based on the stochastic averaging method for quasi-nonintegrable Hamiltonian systems and the stochastic maximum principle. First, the stochastic averaging method for controlled quasi-nonintegrable Hamiltonian systems is introduced. The original control problem is converted into one for a partially averaged equation of system energy together with a partially averaged performance index. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The bounded optimal control forces are obtained from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is stationary process, and the FBSDE is reduced to an ordinary differential equation. Finally, the stationary probability density of the Hamiltonian and other response statistics of optimally controlled system are obtained by solving the Fokker–Plank–Kolmogorov equation associated with the fully averaged Itô equation of the controlled system. For comparison, the bang–bang control is also presented. An example of two degree-of-freedom quasi-nonintegrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness. Numerical results show that the proposed control strategy has higher control efficiency and less discontinuous control force than the corresponding bang–bang control at the price of slightly less control effectiveness.     

Stochastic stability of quasi-partially integrable and non-resonant Hamiltonian systems under parametric excitations of combined Gaussian and Poisson white noises

The asymptotic Lyapunov stability with probability one of multi-degree-of freedom quasi-partially integrable and non-resonant Hamiltonian systems subject to parametric excitations of combined Gaussian and Poisson white noises is studied. First, the averaged stochastic differential equations for quasi partially integrable and non-resonant Hamiltonian systems subject to parametric excitations of combined Gaussian and Poisson white noises are derived by means of the stochastic averaging method and the stochastic jump-diffusion chain rule. Then, the expression of the largest Lyapunov exponent of the averaged system is obtained by using a procedure similar to that due to Khasminskii and the properties of stochastic integro-differential equations. Finally, the stochastic stability of the original quasi-partially integrable and non-resonant Hamiltonian systems is determined approximately by using the largest Lyapunov exponent. An example is worked out in detail to illustrate the application of the proposed method. The good agreement between the analytical results and those from digital simulation show that the proposed method is effective.     

Stochastic Hopf bifurcation of quasi-nonintegrable-Hamiltonian systems

A new procedure for analyzing the stochastic Hopf bifurcation of quasi-non-integrable-Hamiltonian systems is proposed. A quasi-non-integrable-Hamiltonian system is first reduced to an one-dimensional Itô stochastic differential equation for the averaged Hamiltonian by using the stochastic averaging method for quasi-non-integrable-Hamiltonian systems. Then the relationship between the qualitative behavior of the stationary probability density of the averaged Hamiltonian and the sample behaviors of the one-dimensional diffusion process of the averaged Hamiltonian near the two boundaries is established. Thus, the stochastic Hopf bifurcation of the original system is determined approximately by examining the sample behaviors of the averaged Hamiltonian near the two boundaries. Two examples are given to illustrate and test the proposed procedure.     

Response of quasi-integrable Hamiltonian systems with delayed feedback bang–bang control

The response of quasi-integrable Hamiltonian systems with delayed feedback bang–bang control subject to Gaussian white noise excitation is studied by using the stochastic averaging method. First, a quasi-Hamiltonian system with delayed feedback bang–bang control subjected to Gaussian white noise excitation is formulated and transformed into the Itô stochastic differential equations for quasi-integrable Hamiltonian system with feedback bang–bang control without time delay. Then the averaged Itô stochastic differential equations for the later system are derived by using the stochastic averaging method for quasi-integrable Hamiltonian systems and the stationary solution of the averaged Fokker–Plank–Kolmogorov (FPK) equation associated with the averaged Itô equations is obtained for both nonresonant and resonant cases. Finally, two examples are worked out in detail to illustrate the application and effectiveness of the proposed method and the effect of time delayed feedback bang–bang control on the response of the systems.     

First passage failure of quasi-partial integrable generalized Hamiltonian systems

The first passage failure of quasi-partial integrable generalized Hamiltonian systems is studied by using the stochastic averaging method. First, the stochastic averaging method for quasi-partial integrable generalized Hamiltonian systems is introduced briefly. Then, the backward Kolmogorov equation governing the conditional reliability function and the Pontryagin equation governing the conditional mean of first passage time are derived from the averaged Itô equations. The conditional reliability function, the conditional probability density and mean of the first passage time are obtained from solving these equations together with suitable initial condition and boundary conditions, respectively. Finally, one example is given to illustrate the proposed procedure in detail and the solutions are confirmed by using the results from Monte Carlo simulation of the original system.     

Stochastic averaging and Lyapunov exponent of quasi partially integrable Hamiltonian systems

An n degree-of-freedom Hamiltonian system with r(1<r<n) independent first integrals which are in involution is called partially integrable Hamiltonian system and a partially integrable Hamiltonian system subject to light dampings and weak stochastic excitations is called quasi partially integrable Hamiltonian system. In the present paper, the averaged Itô and Fokker-Planck-Kolmogorov (FPK) equations for quasi partially integrable Hamiltonian systems in both cases of non-resonance and resonance are derived. It is shown that the number of averaged Itô equations and the dimension of the averaged FPK equation of a quasi partially integrable Hamiltonian system is equal to the number of independent first integrals in involution plus the number of resonant relations of the associated Hamiltonian system. The technique to obtain the exact stationary solution of the averaged FPK equation is presented. The largest Lyapunov exponent of the averaged system is formulated, based on which the stochastic stability and bifurcation of original quasi partially integrable Hamiltonian systems can be determined. Examples are given to illustrate the applications of the proposed stochastic averaging method for quasi partially integrable Hamiltonian systems in response prediction and stability decision and the results are verified by using digital simulation.     

Stochastic Hopf bifurcation of quasi-integrable Hamiltonian systems with multi-time-delayed feedback control and wide-band noise excitations

The stochastic Hopf bifurcation of multi-degree-of-freedom (MDOF) quasi-integrable Hamiltonian systems with multi-time-delayed feedback control subject to wide-band noise excitations is studied. First, the time-delayed feedback control forces are expressed approximately in terms of the system state variables without time delay and the system is converted into an ordinary quasi-integrable Hamiltonian system. The averaged It? stochastic differential equations are derived by using the stochastic averaging method for quasi-integrable Hamiltonian systems. Then the expression for average bifurcation parameter of the averaged system is obtained approximately and a criterion for determining the stochastic Hopf bifurcation induced by time-delayed feedback control forces in the original system using average bifurcation parameter is proposed. An example is worked out in detail to illustrate the criterion and its validity and to show the effect of time delay in feedback control on stochastic Hopf bifurcation of the system.     

Lyapunov exponent and stochastic stability of quasi-non-integrable Hamiltonian systems

An n degree-of-freedom (DOF) non-integrable Hamiltonian system subject to light damping and weak stochastic excitation is called quasi-non-integrable Hamiltonian system. In the present paper, the stochastic averaging of quasi-non-integrable Hamiltonian systems is briefly reviewed. A new norm in terms of the square root of Hamiltonian is introduced in the definitions of stochastic stability and Lyapunov exponent and the formulas for the Lyapunov exponent are derived from the averaged Itô equations of the Hamiltonian and of the square root of Hamiltonian. It is inferred that the Lyapunov exponent so obtained is the first approximation of the largest Lyapunov exponent of the original quasi-non-integrable Hamiltonian systems and the necessary and sufficient condition for the asymptotic stability with probability one of the trivial solution of the original systems can be obtained approximately by letting the Lyapunov exponent to be negative. This inference is confirmed by comparing the stability conditions obtained from negative Lyapunov exponent and by examining the sample behaviors of averaged Hamiltonian or the square root of averaged Hamiltonian at trivial boundary for two examples. It is also verified by the largest Lyapunov exponent obtained using small noise expansion for the second example.     

Optimal bounded control for minimizing the response of quasi-integrable Hamiltonian systems

A procedure for designing optimal bounded control to minimize the response of quasi-integrable Hamiltonian systems is proposed based on the stochastic averaging method for quasi-integrable Hamiltonian systems and the stochastic dynamical programming principle. The equations of motion of a controlled quasi-integrable Hamiltonian system are first reduced to a set of partially completed averaged Itô stochastic differential equations by using the stochastic averaging method for quasi-integrable Hamiltonian systems. Then, the dynamical programming equation for the control problems of minimizing the response of the averaged system is formulated based on the dynamical programming principle. The optimal control law is derived from the dynamical programming equation and control constraints without solving the dynamical programming equation. The response of optimally controlled systems is predicted through solving the Fokker-Planck-Kolmogrov equation associated with fully completed averaged Itô equations. Finally, two examples are worked out in detail to illustrate the application and effectiveness of the proposed control strategy.     

Stochastic optimal control of quasi non-integrable Hamiltonian systems with stochastic maximum principle

A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward?Cbackward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker?CPlank equation (FPE) associated with the fully averaged It? equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.     

Optimal bounded control of stochastically excited MDOF nonlinear viscoelastic systems

A new procedure for designing optimal bounded control of stochastically excited multi-degree-of-freedom (MDOF) nonlinear viscoelastic systems is proposed based on the stochastic averaging method and the stochastic maximum principle. First, the system is formulated as a quasi-integrable Hamiltonian system with viscoelastic terms and each viscoelastic term is replaced approximately by an elastically restoring force and a visco-damping force based on the randomly periodic behavior of the motion of quasi-integrable Hamiltonian system. Thus, a stochastically excited MDOF nonlinear viscoelastic system is converted to an equivalent quasi-integrable Hamiltonian system without viscoelastic terms. Then, by applying stochastic averaging, the system is further reduced to a partially averaged system of less dimension. The adjoint equation and maximum condition for the optimal control problem of the partially averaged system are derived by using the stochastic maximum principle, and the optimal bounded control force is determined from the maximum condition. Finally, the probability and statistics of the stationary response of optimally controlled system are obtained by solving the Fokker–Plank–Kolmogorov equation (FPK) associated with the fully averaged Itô equation of the controlled system. An example is worked out to illustrate the proposed procedure and its effectiveness.     

First passage failure of quasi non-integrable generalized Hamiltonian systems

The first passage failure of quasi non-integrable generalized Hamiltonian systems is studied. First, the generalized Hamiltonian systems are reviewed briefly. Then, the stochastic averaging method for quasi non-integrable generalized Hamiltonian systems is applied to obtain averaged Itô stochastic differential equations, from which the backward Kolmogorov equation governing the conditional reliability function and the Pontryagin equation governing the conditional mean of the first passage time are established. The conditional reliability function and the conditional mean of first passage time are obtained by solving these equations together with suitable initial condition and boundary conditions. Finally, an example of power system under Gaussian white noise excitation is worked out in detail and the analytical results are confirmed by using Monte Carlo simulation of original system.     

Optimal control strategies for stochastically excited quasi partially integrable Hamiltonian systems

In this paper two different control strategies designed to alleviate the response of quasi partially integrable Hamiltonian systems subjected to stochastic excitation are proposed. First, by using the stochastic averaging method for quasi partially integrable Hamiltonian systems, an n-DOF controlled quasi partially integrable Hamiltonian system with stochastic excitation is converted into a set of partially averaged Itô stochastic differential equations. Then, the dynamical programming equation associated with the partially averaged Itô equations is formulated by applying the stochastic dynamical programming principle. In the first control strategy, the optimal control law is derived from the dynamical programming equation and the control constraints without solving the dynamical programming equation. In the second control strategy, the optimal control law is obtained by solving the dynamical programming equation. Finally, both the responses of controlled and uncontrolled systems are predicted through solving the Fokker-Plank-Kolmogorov equation associated with fully averaged Itô equations. An example is worked out to illustrate the application and effectiveness of the two proposed control strategies.     

Transient stochastic response of quasi integerable Hamiltonian systems

The approximate transient response of quasi integrable Hamiltonian systems under Gaussian white noise excitations is investigated. First, the averaged Ito equations for independent motion integrals and the associated Fokker-Planck-Kolmogorov (FPK) equation governing the transient probability density of independent motion integrals of the system are derived by applying the stochastic averaging method for quasi integrable Hamiltonian systems. Then, approximate solution of the transient probability density of independent motion integrals is obtained by applying the Galerkin method to solve the FPK equation. The approximate transient solution is expressed as a series in terms of properly selected base functions with time-dependent coefficients. The transient probability densities of displacements and velocities can be derived from that of independent motion integrals. Three examples are given to illustrate the application of the proposed procedure. It is shown that the results for the three examples obtained by using the proposed procedure agree well with those from Monte Carlo simulation of the original systems.     

Transient stochastic response of quasi-partially integrable Hamiltonian systems

The approximate transient response of multi-degree-of-freedom (MDOF) quasi-partially integrable Hamiltonian systems under Gaussian white noise excitation is investigated. First, the averaged Itô equations for first integrals and the associated Fokker–Planck–Kolmogorov (FPK) equation governing the transient probability density of first integrals of the system are derived by applying the stochastic averaging method for quasi-partially integrable Hamiltonian systems. Then, the approximate solution of the transient probability density of first integrals of the system is obtained from solving the FPK equation by applying the Galerkin method. The approximate transient solution is expressed as a series in terms of properly selected base functions with time-dependent coefficients. The transient probability densities of displacements and velocities can be derived from that of first integrals. One example is given to illustrate the application of the proposed procedure. It is shown that the results for the example obtained by using the proposed procedure agree well with those from Monte Carlo simulation of the original system.     

Stochastic averaging of quasi-integrable and non-resonant Hamiltonian systems under combined Gaussian and Poisson white noise excitations

A stochastic averaging method for predicting the response of quasi-integrable and non-resonant Hamiltonian systems to combined Gaussian and Poisson white noise excitations is proposed. First, the motion equations of a quasi-integrable and non-resonant Hamiltonian system subject to combined Gaussian and Poisson white noise excitations is transformed into stochastic integro-differential equations (SIDEs). Then $n$ -dimensional averaged SIDEs and generalized Fokker–Plank–Kolmogrov (GFPK) equations for the transition probability densities of $n$ action variables and $n$ - independent integrals of motion are derived by using stochastic jump–diffusion chain rule and stochastic averaging principle. The probability density of the stationary response is obtained by solving the averaged GFPK equation using the perturbation method. Finally, as an example, two coupled non-linear damping oscillators under both external and parametric excitations of combined Gaussian and Poisson white noises are worked out in detail to illustrate the application and validity of the proposed stochastic averaging method.     

Optimal Bounded Control for Minimizing the Response of Quasi Non-Integrable Hamiltonian Systems

A strategy for designing optimal bounded control to minimize theresponse of quasi non-integrable Hamiltonian systems is proposed basedon the stochastic averaging method for quasi non-integrable Hamiltoniansystems and the stochastic dynamical programming principle. Theequations of motion of a controlled quasi non-integrable Hamiltoniansystem are first reduced to an one-dimensional averaged Itô stochasticdifferential equation for the Hamiltonian by using the stochasticaveraging method for quasi non-integrable Hamiltonian systems. Then, thedynamical programming equation for the control problem of minimizing theresponse of the averaged system is formulated based on the dynamicalprogramming principle. The optimal control law is derived from thedynamical programming equation and control constraints without solvingthe equation. The response of optimally controlled systems is predictedthrough solving the Fokker–Planck–Kolmogrov (FPK) equation associatedwith completely averaged Itô equation. Finally, two examples are workedout in detail to illustrate the application and effectiveness of theproposed control strategy.     

Time-delayed stochastic optimal control of strongly non-linear systems with actuator saturation by using stochastic maximum principle

A time-delayed stochastic optimal bounded control strategy for strongly non-linear systems under wide-band random excitations with actuator saturation is proposed based on the stochastic averaging method and the stochastic maximum principle. First, the partially averaged Itô equation for the system amplitude is derived by using the stochastic averaging method for strongly non-linear systems. The time-delayed feedback control force is approximated by a control force without time delay based on the periodically random behavior of the displacement and velocity of the system. The partially averaged Itô equation for the system energy is derived from that for the system amplitude by using Itô formula and the relation between system amplitude and system energy. Then, the adjoint equation and maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The saturated optimal control force is determined from maximum condition and solving the forward–backward stochastic differential equations (FBSDEs). For infinite time-interval ergodic control, the adjoint variable is stationary process and the FBSDE is reduced to a ordinary differential equation. Finally, the stationary probability density of the Hamiltonian and other response statistics of optimally controlled system are obtained from solving the Fokker–Plank–Kolmogorov (FPK) equation associated with the fully averaged Itô equation of the controlled system. For comparison, the optimal control forces obtained from the time-delayed bang–bang control and the control without considering time delay are also presented. An example is worked out to illustrate the proposed procedure and its advantages.