Direct solution of a Riccati equation arising in a stochastic control problem with control and observation on the boundary

The optimal control of a class of stochastic parabolic systems is studied. This class includes systems with noise depending on spatial derivatives of the state, Neumann boundary control, and Dirichlet boundary observation, and extends a class of stochastic systems with distributed control studied by Da Prato [3] and Da Prato and Ichikawa [4]. The work is based on the direct study of the Riccati equation arising in the optimal control problem over finite time horizon. The problem over infinite time horizon and the corresponding algebraic Riccati equation are also considered.     

Algebraic Riccati equations with non-smoothing observation arising in hyperbolic and Euler-Bernoulli boundary control problems

Summary This paper considers the optimal quadratic cost problem (regulator problem) for a class of abstract differential equations with unbounded operators which, under the same unified framework, model in particular «concrete» boundary control problems for partial differential equations defined on a bounded open domain of any dimension, including: second order hyperbolic scalar equations with control in the Dirichlet or in the Neumann boundary conditions; first order hyperbolic systems with boundary control; and Euler-Bernoulli (plate) equations with (for instance) control(s) in the Dirichlet and/or Neumann boundary conditions. The observation operator in the quadratic cost functional is assumed to be non-smoothing (in particular, it may be the identity operator), a case which introduces technical difficulties due to the low regularity of the solutions. The paper studies existence and uniqueness of the resulting algebraic (operator) Riccati equation, as well as the relationship between exact controllability and the property that the Riccati operator be an isomorphism, a distinctive feature of the dynamics in question (emphatically not true for, say, parabolic boundary control problems). This isomorphism allows one to introduce a «dual» Riccati equation, corresponding to a «dual» optimal control problem. Properties between the original and the «dual» problem are also investigated.Research partially supported by the National Science Foundation under Grant NSF-DMS-8301668 and by the Air Force Office of Scientific Research under Grant AFOSR-84-0365.     

On the direct solution of Riccati equations arising in boundary control theory

Two classes of Riccati equations arising in the boundary control of parabolic systems are studied by direct methods. The new feature with respect to previous works on this subject is the low regularity of the final data. The classes considered here generalize those of [7]and [5]on one side, and of [14]on the other one. Completely new methods are used to obtain the solution of the Riccati equations, in both cases. The central theme is the dependence of the solutions on a «symmetric» norm of the final data, yielding these new results as well as a new proof of existence for the related algebraic Riccati equation under more general assumptions. The synthesis of the associated linear-quadratic-regulator problems is easily solved using these results.     

Approximations of riccati equation for abstract boundary control problems applications to hyperbolic systems

Galerkin approximations of Differential Riccati equations arising in abstract hyperbolic boundary control problems are considered. Abstract results are then applied to the first order nondissipative hyperbolic system with L₂-boundary controls.     

Numerical approximations and regularizations of Riccati equations arising in hyperbolic dynamics with unbounded control operators

This paper provides an approximation theory for numerical computations of the solutions to algebraic Riccati equations arising in hyperbolic, boundary control problems. One of the difficulties in the approximation theory for Riccati equations is that many attractive numerical methods (such as standard finite elements) do not satisfy a uniform stabilizability condition, which is necessary for the stability of the approximate Riccati solutions. To deal with these problems, a regularizationapproximation technique, based on the introduction of special artificial terms to the dynamics of the original model, is proposed. The need for this regularization appears to be a distinct feature of hyperbolic (hyperbolic-like) equations, rather than parabolic (parabolic-like) problems where the smoothing effect of the dynamics is beneficial for the convergence and stability properties of approximate solutions to the associated Riccati equations (see [14]). The ultimate result demonstrates that the regularized, finite-dimensional feedback control yields near optimal performance and that the corresponding Riccati solution satisfies all the desired convergence properties. The general theory is illustrated by an example of a boundary control problem associated with the Kirchoff plate model. Some numerical results are provided for the given example.     

Direct solution of a riccati equation arising in stochastic control theory

We study a regulator problem for a system governed by a linear stochastic differential equation with unbounded coefficients in Hilbert spaces.     

On a hyperbolic equation arising in electrostatic MEMS

We consider the initial–boundary value problem of a damped wave equation with singular nonlinearity, which describes an electrostatic micro-electro-mechanical system (MEMS) device. The results of the pull-in voltage λ^?${\lambda }^{?}$ being the critical threshold for global existence and quenching are obtained: if the applied voltage λ<λ^?$\lambda <{\lambda }^{?}$, then the equation admits a unique global small solution that exponentially converges to the minimal steady state, while large solution may quench in finite time; if λ>λ^?$\lambda >{\lambda }^{?}$, then any solution quenches in finite time. Finally, in the sense of the viscosity dominated limit, the asymptotic relation of solutions between the hyperbolic equation and the parabolic one is investigated. Also the related error estimates in arbitrary order are derived.     

On a stochastic hyperbolic integro-differential equation

In this paper we study an initial-boundary-value problem for a hyperbolic integro-differential equation with random memory and a random noise. We establish the existence, uniqueness and exponential stability of solutions. Our method consists of finite-dimensional approximation and energy estimates.     

The Kalman-Yakubovich-Popov theorem for stabilizable hyperbolic boundary control systems

In this paper we present a version of the Kalman-Yakubovich-Popov theorem for a class of boundary control systems of hyperbolic type. Unstable, controllable systems are considered and stabilizability withunbounded feedbacks is permitted.Paper partially supported by the Italian MINISTERO DELLA RICERCA SCIENTIFICA E TECNOLOGICA within the program of GNAFA-CNR and by NATO CRG program SA.5-2-05 (CRG940161).     

A new Riccati equation arising in the theory of classical orthogonal polynomials

In seeking a generalized Rodrigues' formula solution to second-order linear ordinary differential equations a new Riccati equation is encountered and solved, leading to a novel development of the theory of orthogonal polynomials. Additional benefits of this approach are the automatic attainment of second solutions, the solution of the inhomogeneous form, and a means of determining the eigenvalues of fundamental classes of second-order linear differential equations. The results of this analysis will be of interest to a broad spectrum of readers and should be of pedagogic as well as theoretical value.     

OSCILLATION OF SOLUTIONS OF THE SYSTEMS OF QUASILINEAR HYPERBOLIC EQUATION UNDER NONLINEAR BOUNDARY CONDITION

Sufficient conditions are obtained for the oscillation of solutions of the systems of quasilinear hyperbolic differential equation with deviating arguments under nonlinear boundary condition.     

Optimal control of backward stochastic heat equation with Neumann boundary control and noise

This paper considers a stochastic control problem in which the dynamic system is a controlled backward stochastic heat equation with Neumann boundary control and boundary noise and the state must coincide with a given random vector at terminal time. Through defining a proper form of the mild solution for the state equation, the existence and uniqueness of the mild solution is given. As a main result, a global maximum principle for our control problem is presented. The main result is also applied to a backward linear-quadratic control problem in which an optimal control is obtained explicitly as a feedback of the solution to a forward–backward stochastic partial differential equation.     

Riccati equation for infinite-dimensional discrete bilinear systems

The problem of quadratic optimal feedback control for infinite-dimensionaldiscrete bilinear systems is associated with an algebraic Riccati-likeoperator equation. The existence and uniqueness of a nonnegativesolution to such a Riccati-like operator equation is establishedas the strong limit of a sequence of solutions to Lyapunov-likeoperator equations. This research was supported in part by CNPq (Brazilian NationalResearch Council) and FAPESP (Research Council of the Stateof sào Paulo).