Bounded-from-below solutions of the Hamilton-Jacobi equation for optimal control problems with exit times: vanishing lagrangians,eikonal equations,and shape-from-shading

We study the Hamilton-Jacobi equation for undiscounted exit time control problems with general nonnegative Lagrangians using the dynamic programming approach. We prove theorems characterizing the value function as the unique bounded-from-below viscosity solution of the Hamilton-Jacobi equation that is null on the target. The result applies to problems with the property that all trajectories satisfying a certain integral condition must stay in a bounded set. We allow problems for which the Lagrangian is not uniformly bounded below by positive constants, in which the hypotheses of the known uniqueness results for Hamilton-Jacobi equations are not satisfied. We apply our theorems to eikonal equations from geometric optics, shape-from-shading equations from image processing, and variants of the Fuller Problem.     

Analysis of a multistate control problem related to food technology

This paper is concerned with an optimal control problem related to the determination of an optimal profile for the steam temperature into the autoclave along the processing of canned foods. The problem studies a system coupling the evolution Navier-Stokes equations with the heat transfer equation by natural convection (the so-called Boussinesq equations), and with the microorganisms removal equation. The essential difficulties in the study of this multistate control problem arise from the lack of uniqueness for the solution of the state system. Here we obtain—after a careful analysis of the problem mathematical formulation—the uniqueness of part of the state, and the existence of optimal solutions.     

A singular control model with application to the goodwill problem

We consider a stochastic system whose uncontrolled state dynamics are modelled by a general one-dimensional Itô diffusion. The control effort that can be applied to this system takes the form that is associated with the so-called monotone follower problem of singular stochastic control. The control problem that we address aims at maximising a performance criterion that rewards high values of the utility derived from the system’s controlled state but penalises any expenditure of control effort. This problem has been motivated by applications such as the so-called goodwill problem in which the system’s state is used to represent the image that a product has in a market, while control expenditure is associated with raising the product’s image, e.g., through advertising. We obtain the solution to the optimisation problem that we consider in a closed analytic form under rather general assumptions. Also, our analysis establishes a number of results that are concerned with analytic as well as probabilistic expressions for the first derivative of the solution to a second-order linear non-homogeneous ordinary differential equation. These results have independent interest and can potentially be of use to the solution of other one-dimensional stochastic control problems.     

Second order Hamilton–Jacobi–Bellman equations with an unbounded operator

This work is devoted to the study of a class of Hamilton–Jacobi–Bellman equations associated to an optimal control problem where the state equation is a stochastic differential inclusion with a maximal monotone operator. We show that the value function minimizing a Bolza-type cost functional is a viscosity solution of the HJB equation. The proof is based on the perturbation of the initial problem by approximating the unbounded operator. Finally, by providing a comparison principle we are able to show that the solution of the equation is unique.     

On the Hamilton-Jacobi-Bellman equations in Banach spaces

This paper is concerned with a certain class of distributed parameter control problems. The value function of these problems is shown to be the unique viscosity solution of the corresponding Hamiltonian-Jacobi-Bellman equation. The main assumption is the existence of an increasing sequence of compact invariant subsets of the state space. In particular, this assumption is satisfied by a class of controlled delay equations. This research was partly supported by the Institute for Mathematics and Its Applications with funds provided by the National Science Foundation and the Office of Naval Research. The author is indebted to Professor P. L. Lions for stimulating discussions and helpful suggestions.     

A class of quasilinear degenerate elliptic problems

We establish the existence of solutions for a class of quasilinear degenerate elliptic equations. The equations in this class satisfy a structure condition which provides ellipticity in the interior of the domain, and degeneracy only on the boundary. Equations of transonic gas dynamics, for example, satisfy this property in the region of subsonic flow and are degenerate across the sonic surface. We prove that the solution is smooth in the interior of the domain but may exhibit singular behavior at the degenerate boundary. The maximal rate of blow-up at the degenerate boundary is bounded by the “degree of degeneracy” in the principal coefficients of the quasilinear elliptic operator. Our methods and results apply to the problems recently studied by several authors which include the unsteady transonic small disturbance equation, the pressure-gradient equations of the compressible Euler equations, and the singular quasilinear anisotropic elliptic problems, and extend to the class of equations which satisfy the structure condition, such as the shallow water equation, compressible isentropic two-dimensional Euler equations, and general two-dimensional nonlinear wave equations. Our study provides a general framework to analyze degenerate elliptic problems arising in the self-similar reduction of a broad class of two-dimensional Cauchy problems.     

Existence and uniqueness for a nonlinear parabolic/Hamilton–Jacobi coupled system describing the dynamics of dislocation densities

We study a mathematical model describing the dynamics of dislocation densities in crystals. This model is expressed as a 1D system of a parabolic equation and a first order Hamilton–Jacobi equation that are coupled together. We examine an associated Dirichlet boundary value problem. We prove the existence and uniqueness of a viscosity solution among those assuming a lower-bound on their gradient for all time including the initial time. Moreover, we show the existence of a viscosity solution when we have no such restriction on the initial data. We also state a result of existence and uniqueness of entropy solution for the initial value problem of the system obtained by spatial derivation. The uniqueness of this entropy solution holds in the class of bounded-from-below solutions. In order to prove our results on the bounded domain, we use an “extension and restriction” method, and we exploit a relation between scalar conservation laws and Hamilton–Jacobi equations, mainly to get our gradient estimates.     

Optimization problems on general classes of rearrangements

This paper is concerned with maximization and minimization problems of the energy integral associated to p-Laplace equations depending on functions that belong to a class of rearrangements. We prove existence and uniqueness results, and present some features of optimal solutions. The radial case is discussed in detail. We also prove a result of uniqueness for a class of p-Laplace equations under non-standard assumptions.     

An inverse problem of identifying the coefficient of first-order in a degenerate parabolic equation

This work studies an inverse problem of determining the first-order coefficient of degenerate parabolic equations using the measurement data specified at a fixed internal point. Being different from other ordinary parameter identification problems in parabolic equations, in our mathematical model there exists degeneracy on the lateral boundaries of the domain, which may cause the corresponding boundary conditions to go missing. By the contraction mapping principle, the uniqueness of the solution for the inverse problem is proved. A numerical algorithm on the basis of the predictor-corrector method is designed to obtain the numerical solution and some typical numerical experiments are also performed in the paper. The numerical results show that the proposed method is stable and the unknown function is recovered very well. The results obtained in the paper are interesting and useful, and can be extended to other more general inverse coefficient problems of degenerate PDEs.     

Quasilinear parabolic and elliptic equations with nonlinear boundary conditions

This paper is concerned with a class of quasilinear parabolic and elliptic equations in a bounded domain with both Dirichlet and nonlinear Neumann boundary conditions. The equation under consideration may be degenerate or singular depending on the property of the diffusion coefficient. The consideration of the class of equations is motivated by some heat-transfer problems where the heat capacity and thermal conductivity are both temperature dependent. The aim of the paper is to show the existence and uniqueness of a global time-dependent solution of the parabolic problem, existence of maximal and minimal steady-state solutions of the elliptic problem, including conditions for the uniqueness of a solution, and the asymptotic behavior of the time-dependent solution in relation to the steady-state solutions. Applications are given to some heat-transfer problems and an extended logistic reaction–diffusion equation.     

Approximations of thermoelastic and viscoelastic control systems

This paper deals with the development and analysis of well-posed models and computational algorithms for control of a class of partial differential equations that descrive the motions of thermo-viscoelastic structures. We first present an abstract “state space” framework and general well-posedness result that can be applied to a large class of thermo-elastic and thermo-viscoelastic models. This state space framework is used in the development of a computational scheme to be used in the solution of an LQR control problem. A detailed convergence proof is provided for the viscoelastic model, and several numerical results are presented to illustrate the theory and to analyze problems for which the theory is incomplete.     

The turnpike property in finite-dimensional nonlinear optimal control

Turnpike properties have been established long time ago in finite-dimensional optimal control problems arising in econometry. They refer to the fact that, under quite general assumptions, the optimal solutions of a given optimal control problem settled in large time consist approximately of three pieces, the first and the last of which being transient short-time arcs, and the middle piece being a long-time arc staying exponentially close to the optimal steady-state solution of an associated static optimal control problem. We provide in this paper a general version of a turnpike theorem, valuable for nonlinear dynamics without any specific assumption, and for very general terminal conditions. Not only the optimal trajectory is shown to remain exponentially close to a steady-state, but also the corresponding adjoint vector of the Pontryagin maximum principle. The exponential closedness is quantified with the use of appropriate normal forms of Riccati equations. We show then how the property on the adjoint vector can be adequately used in order to initialize successfully a numerical direct method, or a shooting method. In particular, we provide an appropriate variant of the usual shooting method in which we initialize the adjoint vector, not at the initial time, but at the middle of the trajectory.     

Optimal control of stochastic functional differential equations with a bounded memory

This paper treats a finite time horizon optimal control problem in which the controlled state dynamics are governed by a general system of stochastic functional differential equations with a bounded memory. An infinite dimensional Hamilton–Jacobi–Bellman (HJB) equation is derived using a Bellman-type dynamic programming principle. It is shown that the value function is the unique viscosity solution of the HJB equation.     

Externality and Hamilton-Jacobi equations

The relationship between optimal control problems and Hamilton-Jacobi-Bellman equations is well known [9]. In fact the value function, defined as the infimum of the cost functional, satisfies in the viscosity sense an appropriate Hamilton-Jacobi-Bellman equation. In this paper we consider several control problems such that the cost functional associated to each problem depends explicitly on the value functions of the other problems. This leads to a system of Hamilton-Jacobi-Bellman equations. This is known, in economic context [14] cap XI, as an externality problem. In these problems may occur a lack of uniqueness of the value functions. We give conditions to ensure existence, uniqueness of the value functions and an implicit integral representation formula. Moreover, under uniqueness assumption, we prove that the variational solutions of the associated Hamilton-Jacobi system converge asymptotically to the value functions. We prove also an uniqueness theorem in the case of viscosity solutions of Hamilton-Jacobi-Bellman system.     

An inverse problem of identifying the coefficient of parabolic equation

This paper studies an inverse problem of identifying the coefficient of parabolic equation when the final observation is given, which has important application in a large fields of applied science. Based on the optimal control framework, the existence and necessary condition of the minimum for the control functional are established. Since the optimal control problem is nonconvex, one may not expect a unique solution. However, in this paper the solution is proved to be locally unique. After the necessary condition is transformed into an elliptic bilateral variational inequality, an algorithm and some numerical experiments are proposed in the paper. The numerical results show that the algorithm designed in this paper is stable and that the coefficient is recovered very well.     

Viscosity solutions of a class of degenerate quasilinear parabolic equations with Dirichlet boundary condition

This paper is concerned with viscosity solutions for a class of degenerate quasilinear parabolic equations in a bounded domain with homogeneous Dirichlet boundary condition. The equation under consideration arises from a number of practical model problems including reaction–diffusion processes in a porous medium. The degeneracy of the problem appears on the boundary and possibly in the interior of the domain. The goal of this paper is to establish some comparison properties between viscosity upper and lower solutions and to show the existence of a continuous viscosity solution between them. An application of the above results is given to a porous-medium type of reaction–diffusion model which demonstrates some distinctive properties of the solution when compared with the corresponding semilinear problem.     

Limit Theorem for Controlled Backward SDEs and Homogenization of Hamilton–Jacobi–Bellman Equations

We prove a convergence theorem for a family of value functions associated with stochastic control problems whose cost functions are defined by backward stochastic differential equations. The limit function is characterized as a viscosity solution to a fully nonlinear partial differential equation of second order. The key assumption we use in our approach is shown to be a necessary and sufficient assumption for the homogenizability of the control problem. The results generalize partially homogenization problems for Hamilton–Jacobi–Bellman equations treated recently by Alvarez and Bardi by viscosity solution methods. In contrast to their approach, we use mainly probabilistic arguments, and discuss a stochastic control interpretation for the limit equation.     

Weighted quasi-equilibrium problems with lower and upper bounds

This paper is devoted to studying the solution existence of weighted quasi-equilibrium problems with lower and upper bounds by using maximal element theorems, a fixed point theorem of set-valued mappings and Fan–KKM theorem, respectively. Some new results are obtained.     

Regularity properties of optimal controls for problems with time-varying state and control constraints

In this paper we report new results on the regularity of optimal controls for dynamic optimization problems with functional inequality state constraints, a convex time-dependent control constraint and a coercive cost function. Recently, it has been shown that the linear independence condition on active state constraints, present in the earlier literature, can be replaced by a less restrictive, positive linear independence condition, that requires linear independence merely with respect to non-negative weighting parameters, provided the control constraint set is independent of the time variable. We show that, if the control constraint set, regarded as a time-dependent multifunction, is merely Lipschitz continuous with respect to the time variable, then optimal controls can fail to be Lipschitz continuous. In these circumstances, however, a weaker Hölder continuity-like regularity property can be established. On the other hand, Lipschitz continuity of optimal controls is guaranteed for time-varying control sets under a positive linear independence hypothesis, when the control constraint sets are described, at each time, by a finite collection of functional inequalities.     

Stability of subdifferentials of nonconvex functions in Banach spaces

We investigate various notions of subdifferentials and superdifferentials of nonconvex functions in Banach spaces. We prove stability results of these subdifferentials and superdifferentials under various kind of convergences. Our proofs rely on a recent variational principle of Deville, Godefroy and Zizler. Connections between our results, the geometry of Banach spaces and existence theorems of viscosity solutions for first and second-order Hamilton-Jacobi equations in infinite-dimensional Banach spaces will be explained.