Closed-form solutions of a general inequality-constrained lq optimal control problem

A general linear quadratic (LQ) optimal control problem, with the dynamic system being governed by a higher-order vector-valued ordinary differential equation and with inequality-constraints on the state vector and/or the control input, is studied. Based on an explicit characterization result, optimal solutions are obtained in closed-form. A constructive method for finding the closed-form optimal solutions is proposed, and two illustrative examples are included     

On theoretical and numerical aspects of the bang-bang-principle

Summary In the first part of this paper we are dealing with theoretical statements and conditions which finally lead to bang-bang-principles. A careful analysis of these theorems is used for the development of a numerical method. This method consists of two stages: During the first iterations the number and approximate location of the switching points of the optimal control are determined. In the second phase a rapidly convergent algorithm determines the exact location. We apply this method successfully to a parabolic boundary control problem and give an extensive discussion of numerical results.The work of the second author on this paper was partially done during his stay at North Carolina State University, Graduate Program in Operations Research and Department of Mathematics, Raleigh, USA     

Hamilton-Jacobi theory over time scales and applications to linear-quadratic problems

In this paper we first derive the verification theorem for nonlinear optimal control problems over time scales. That is, we show that the value function is the only solution of the Hamilton-Jacobi equation, in which the minimum is attained at an optimal feedback controller. Applications to the linear-quadratic regulator problem (LQR problem) gives a feedback optimal controller form in terms of the solution of a generalized time scale Riccati equation, and that every optimal solution of the LQR problem must take that form. A connection of the newly obtained Riccati equation with the traditional one is established. Problems with shift in the state variable are also considered. As an important tool for the latter theory we obtain a new formula for the chain rule on time scales. Finally, the corresponding LQR problem with shift in the state variable is analyzed and the results are related to previous ones.     

On the Bellman Equation for Infinite Horizon Problems with Unbounded Cost Functional

We study a class of infinite horizon control problems for nonlinear systems, which includes the Linear Quadratic (LQ) problem, using the Dynamic Programming approach. Sufficient conditions for the regularity of the value function are given. The value function is compared with sub- and supersolutions of the Bellman equation and a uniqueness theorem is proved for this equation among locally Lipschitz functions bounded below. As an application it is shown that an optimal control for the LQ problem is nearly optimal for a large class of small unbounded nonlinear and nonquadratic pertubations of the same problem. Accepted 8 October 1998     

The derivation of cubic splines with obstacles by methods of optimization and optimal control

Summary Interpolating splines which are restricted in their movement by the presence of obstacles are investigated. For simplicity we mainly treat cubic splines which are required to be non-negative. The extension to splines of higher order and to certain other forms of obstacles is straightforward. Methods of optimization and of optimal control are used to obtain necessary optimality criteria. These criteria are applied to derive an algorithm to compute splines which are restricted to constant lower or upper bounds. There is a numerical example which illustrates the method presented.Dedicated to Günter Meinardus on the occasion of his 60th birthday     

Vertical slot fishways: Mathematical modeling and optimal management

Fishways are the main type of hydraulic devices currently used to facilitate migration of fish past obstructions (dams, waterfalls, rapids,…$\mathrm{rapids},\dots$) in rivers. In this paper we present a mathematical formulation of an optimal control problem related to the optimal management of a vertical slot fishway, where the state system is given by the shallow water equations, the control is the flux of inflow water, and the cost function reflects the need of rest areas for fish and of a water velocity suitable for fish leaping and swimming capabilities. We give a first-order optimality condition for characterizing the optimal solutions of this problem. From a numerical point of view, we use a characteristic-Galerkin method for solving the shallow water equations, and we use an optimization algorithm for the computation of the optimal control. Finally, we present numerical results obtained for the realistic case of a standard nine pools fishway.     

On the approximate solution of nonlinear variational inequalities

Summary Nonlinear locally coercive variational inequalities are considered and especially the minimal surface over an obstacle. Optimal or nearly optimal error estimates are proved for a direct discretization of the problem with linear finite elements on a regular triangulation of the not necessarily convex domain. It is shown that the solution may be computed by a globally convergent relaxation method. Some numerical results are presented.     

Optimal control for N-Person stochastic inclusions. II

The existence of a solution of a large class of nonlinear stochastic inclusions is shown. The existence of an open loop problem for those stochastic inclusions, is established. Application to an optimal strategy problem arising in the fight against drugs is given.     

Computing ODE symmetries as abnormal variational symmetries

We give a new computational method to obtain symmetries of ordinary differential equations. The proposed approach appears as an extension of a recent algorithm to compute variational symmetries of optimal control problems [P.D.F. Gouveia, D.F.M. Torres, Automatic computation of conservation laws in the calculus of variations and optimal control, Comput. Methods Appl. Math. 5 (4) (2005) 387-409], and is based on the resolution of a first order linear PDE that arises as a necessary and sufficient condition of invariance for abnormal optimal control problems. A computer algebra procedure is developed, which permits one to obtain ODE symmetries by the proposed method. Examples are given, and results compared with those obtained by previous available methods.     

The lagrange-newton method for infinite-dimensional optimization problems

This paper investigates local convergence properties of the Lagrange-Newton method for optimization problems in reflexive Banach spaces. Sufficient conditions for quadratic convergence of optimal solutions and Lagrange multipliers are given. The results are applied to optimal control problems.     

The turnpike property in finite-dimensional nonlinear optimal control

Turnpike properties have been established long time ago in finite-dimensional optimal control problems arising in econometry. They refer to the fact that, under quite general assumptions, the optimal solutions of a given optimal control problem settled in large time consist approximately of three pieces, the first and the last of which being transient short-time arcs, and the middle piece being a long-time arc staying exponentially close to the optimal steady-state solution of an associated static optimal control problem. We provide in this paper a general version of a turnpike theorem, valuable for nonlinear dynamics without any specific assumption, and for very general terminal conditions. Not only the optimal trajectory is shown to remain exponentially close to a steady-state, but also the corresponding adjoint vector of the Pontryagin maximum principle. The exponential closedness is quantified with the use of appropriate normal forms of Riccati equations. We show then how the property on the adjoint vector can be adequately used in order to initialize successfully a numerical direct method, or a shooting method. In particular, we provide an appropriate variant of the usual shooting method in which we initialize the adjoint vector, not at the initial time, but at the middle of the trajectory.     

A Schwarz domain decomposition method with gradient projection for optimal control governed by elliptic partial differential equations

A domain decomposition method (DDM) is presented to solve the distributed optimal control problem. The optimal control problem essentially couples an elliptic partial differential equation with respect to the state variable and a variational inequality with respect to the constrained control variable. The proposed algorithm, called SA-GP algorithm, consists of two iterative stages. In the inner loops, the Schwarz alternating method (SA) is applied to solve the state and co-state variables, and in the outer loops the gradient projection algorithm (GP) is adopted to obtain the control variable. Convergence of iterations depends on both the outer and the inner loops, which are coupled and affected by each other. In the classical iteration algorithms, a given tolerance would be reached after sufficiently many iteration steps, but more iterations lead to huge computational cost. For solving constrained optimal control problems, most of the computational cost is used to solve PDEs. In this paper, a proposed iterative number independent of the tolerance is used in the inner loops so as to save a lot of computational cost. The convergence rate of L²-error of control variable is derived. Also the analysis on how to choose the proposed iteration number in the inner loops is given. Some numerical experiments are performed to verify the theoretical results.     

On Martos' and Chaehes-Coopeb's approach vis-a-vis

In this paper a linear fractional programming problem is studied in presence of “singular-points”. It is proved that “singular points”, if present, exist at an extreme point of S: = {x ? R ⁿ | Ax = b, x ≧0}

It is also shown that a “singular point” is adjacent to an optimal point of S and a characterization of a non-basic vector is obtained, whose entry into the optimal basis in Martos' approach yields the “singular point”.     

Flow regulation for water quality restoration in a river section: Modeling and control

This work is devoted to the numerical resolution of an optimal control problem that arises in the management of a reservoir for the remediation of a polluted river section. By using mathematical modeling and optimal control techniques we set the mathematical formulation of the problem (as a hyperbolic optimal control problem with control constraints), and obtain a fully discretized problem. Finally, we propose a gradient-free method to solve it, and present realistic numerical results.     

Formulation and numerical solution of finite-level quantum optimal control problems

Optimal control of finite-level quantum systems is investigated, and iterative solution schemes for the optimization of a control representing laser pulses are developed. The purpose of this external field is to channel the system's wavefunction between given states in its most efficient way. Physically motivated constraints, such as limited laser resources or population suppression of certain states, are accounted for through an appropriately chosen cost functional. First-order necessary optimality conditions and second-order sufficient optimality conditions are investigated. For solving the optimal control problems, a cascadic non-linear conjugate gradient scheme and a monotonic scheme are discussed. Results of numerical experiments with a representative finite-level quantum system demonstrate the effectiveness of the optimal control formulation and efficiency and robustness of the proposed approaches.     

Boundary optimal control for nonlinear antiplane problems

We consider a nonlinear antiplane problem which models the deformation of an elastic cylindrical body in frictional contact with a rigid foundation. The contact is modelled with Tresca’s law of dry friction in which the friction bound is slip dependent.The aim of this article is to study an optimal control problem which consists of leading the stress tensor as close as possible to a given target, by acting with a control on the boundary of the body. The existence of at least one optimal control is proved. Next we introduce a regularized problem, depending on a small parameter ρ, and we study the convergence of the optimal controls when ρ tends to zero. An optimality condition is delivered for the regularized problem.     

Analysis and finite element approximation of an optimal control problem in electrochemistry with current density controls

Summary. An optimal control problem for impressed cathodic systems in electrochemistry is studied. The control in this problem is the current density on the anode. A matching objective functional is considered. We first demonstrate the existence and uniqueness of solutions for the governing partial differential equation with a nonlinear boundary condition. We then prove the existence of an optimal solution. Next, we derive a necessary condition of optimality and establish an optimality system of equations. Finally, we define a finite element algorithm and derive optimal error estimates. Received March 10, 1993 / Revised version received July 4, 1994     

Approximate Optimal Control of Nonlinear Fredholm Integral Equations

In this article, a numerical scheme on the basis of the measure theoretical approach for extracting approximate solutions of optimal control problems governed by nonlinear Fredholm integral equations is presented. The problem is converted to a linear programming in which its solution leads to construction of approximate solutions of the original problem. Finally, some numerical examples are given to demonstrate the efficiency of the approach.     

The problem of optimal control with reflection studied through a linear optimization problem stated on occupational measures

We obtain a linear programming characterization for the minimum cost associated with finite dimensional reflected optimal control problems. In order to describe the value functions, we employ an infinite dimensional dual formulation instead of using the characterization via Hamilton-Jacobi partial differential equations. In this paper we consider control problems with both infinite and finite horizons. The reflection is given by the normal cone to a proximal retract set.