Computational algorithm for a distributed optimal control problem of parabolic type with terminal inequality constraints

A computational algorithm for optimal control problems with control and terminal inequality constraints involving first boundary-value problems of parabolic type is presented. The convergence properties are also studied.This work, which was partly supported by the Australian Research Grants Committee, was done during the period when Z. S. Wu was an Honorary Visiting Fellow in the School of Mathematics at the University of New South Wales, Australia.     

Convergence of a feasible directions algorithm for a distributed optimal control problem of parabolic type with terminal inequality constraints

In this paper, we consider a class of optimal control problems with control and terminal inequality constraints, where the system dynamics is governed by a linear second-order parabolic partial differential equation with first boundary condition. A feasible direction algorithm for solving this class of optimal control problems has already been obtained in the literature. The aim of this paper is to improve the convergence result by using a topology arising in the study of relaxed controls.     

A feasible directions algorithm for time-lag optimal control problems with control and terminal inequality constraints

A computational algorithm for a class of time-lag optimal control problems involving control and terminal inequality constraints is presented. The convergence properties of the algorithm is also investigated. To test the algorithm, an example is solved.This work was partially supported by the Australian Research Grant Committee.     

Modified quasilinearization algorithm for optimal control problems with nondifferential constraints and general boundary conditions

This paper considers the numerical solution of the problem of minimizing a functionalI, subject to differential constraints, nondifferential constraints, and general boundary conditions. It consists of finding the statex(t), the controlu(t), and the parameter so that the functionalI is minimized while the constraints are satisfied to a predetermined accuracy.The modified quasilinearization algorithm (MQA) is extended, so that it can be applied to the solution of optimal control problems with general boundary conditions, where the state is not explicitly given at the initial point.The algorithm presented here preserves the MQA descent property on the cumulative error. This error consists of the error in the optimality conditions and the error in the constraints.Three numerical examples are presented in order to illustrate the performance of the algorithm. The numerical results are discussed to show the feasibility as well as the convergence characteristics of the algorithm.This work was supported by the Electrical Research Institute of Mexico and by CONACYT, Consejo Nacional de Ciencia y Tecnologia, Mexico City, Mexico.     

An exact penalty function algorithm for optimal control problems with control and terminal equality constraints,part 1

The presence of control constraints, because they are nondifferentiable in the space of control functions, makes it difficult to cope with terminal equality constraints in optimal control problems. Gradient-projection algorithms, for example, cannot be employed easily. These difficulties are overcome in this paper by employing an exact penalty function to handle the cost and terminal equality constraints and using the control constraints to define the space of permissible search directions in the search-direction subalgorithm. The search-direction subalgorithm is, therefore, more complex than the usual linear program employed in feasible-directions algorithms. The subalgorithm approximately solves a convex optimal control problem to determine the search direction; in the implementable version of the algorithm, the accuracy of the approximation is automatically increased to ensure convergence.This work was supported by the United Kingdom Science Research Council, by the US Army Research Office, Contract No. DAAG-29-73-C-0025, and by the National Science Foundation, Grant No. ENG-73-08214-A01.     

Optimal control computation for parabolic systems with boundary conditions involving time delays

In this paper, we consider a class of optimal control problems involving a second-order, linear parabolic partial differential equation with Neumann boundary conditions. The time-delayed arguments are assumed to appear in the boundary conditions. A necessary and sufficient condition for optimality is derived, and an iterative method for solving this optimal control problem is proposed. The convergence property of this iterative method is also investigated.On the basis of a finite-element Galerkin's scheme, we convert the original distributed optimal control problem into a sequence of approximate problems involving only lumped-parameter systems. A computational algorithm is then developed for each of these approximate problems. For illustration, a one-dimensional example is solved.     

An exact penalty function algorithm for optimal control problems with control and terminal equality constraints,part 2

In Part 1 of this paper, implementable and conceptual versions of an algorithm for optimal control problems with control constraints and terminal equality constraints were presented. It was shown that anyL accumulation points of control sequences generated by the algorithms satisfy necessary conditions of optimality. Since such accumulation points need not exist, it is shown in this paper that control sequences generated by the algorithms always have accumulation points in the sense of control measure, and these accumulation points satisfy optimality conditions for the corresponding relaxed control problem.This work was supported by the United Kingdom Science Research Council, by the US Army Research Office, Contract No. DAA-29-73-C-0025, and by the National Science Foundation, Grant No. ENG-73-08214-A01.     

A maximum principle for optimal control problems with mixed constraints

Necessary conditions in the form of maximum principles are derivedfor optimal control problems with mixed control and state constraints.Traditionally, necessary condtions for problems with mixed constraintshave been proved under hypothesis which include the requirementthat the Jacobian of the mixed constraint functional, with respectto the control variable, have full rank. We show that it canbe replaced by a weaker ‘interiority’ hypothesis.This refinement broadens the scope of the optimality conditions,to cover some optimal control problems involving differentialalgebraic constraints, with index greater than unity.     

Pontryagin's principle for problems with isoperimetric constraints and problems with inequality terminal constraints: Reply

A reply is made to the comment of Forster and Long.     

Pontryagin's principle for problems with isoperimetric constraints and problems with inequality terminal constraints: Comment

Schmitendorf's formulation of the terminal conditions is shown to be a special case of Hestenes' formulation, despite his claim to the contrary. Imaginative use of Hestenes' control parameters enables the application of Hestenes' theorem to a wide variety of problems. Schmitendorf's rank condition on the terminal constraints can be dispensed with.The authors acknowledge with thanks comments by N. Vousden and W. Schmitendorf.     

Junction phenomena for optimal control with state-variable inequality constraints of third order

It is known that extremal arcs governed by inequality constraints of third order (constraint relations that must be differentiated three times to generate a control equation) cannot join an unconstrained arc, except in special cases. But a control problem is exhibited, for which every extremal includes a constrained arc of third order. The constrained arc joins the end of an infinite sequence of consecutive unconstrained arcs of finite total duration. Evidence (but not proof) is given that this phenomenon is typical, rather than exceptional. An analogous phenomenon is well known for optimal control problems with singular arcs of second order.     

Optimal feedback control for a linear-quadratic control problem with a state inequality constraint

In this paper, we consider the linear-quadratic control problem (LQCP) for systems defined by evolution operators with an inequality constraint on the state. It is shown that, under suitable assumptions, the optimal control exists, is unique, and has a closedloop structure. The synthesis of the feedback control requires one to solve two Riccati integral equations.     

A time-decomposition algorithm for a stiff linear two-point boundary-value problem and its application to a nonlinear optimal control problem

An algorithm is proposed to solve a stiff linear two-point boundary-value problem (TPBVP). In a stiff problem, since some particular solutions of the system equation increase and others decrease rapidly as the independent variable changes, the integration of the system equation suffers from numerical errors. In the proposed algorithm, first, the overall interval of integration is divided into several subintervals; then, in each subinterval a sub-TPBVP with arbitrarily chosen boundary values is solved. Second, the exact boundary values which guarantee the continuity of the solution are determined algebraically. Owing to the division of the integration interval, the numerical error is effectively reduced in spite of the stiffness of the system equation. It is also shown that the algorithm is successfully imbedded into an interaction-coordination algorithm for solving a nonlinear optimal control problem.The authors would like to thank Mr. T. Sera and Mr. H. Miyake for their help with the calculations.     

Numerical solution of singular perturbation problems by a terminal boundary-value technique

In this paper, we present a new approach for numerically solving linear singularly perturbed two-point boundary-value problems in ordinary differential equations with a boundary layer on the left end of the interval. The original problem is divided into outer and inner region problems. A terminal boundary condition in implicit form is introduced. Then, the outer region problem is solved as a two-point boundary-value problem (TPBVP), and an explicit terminal boundary condition is obtained. In turn, the inner region problem is modified and solved as a TPBVP using the explicit terminal boundary condition. The proposed method is iterative on the terminal point of the inner region. Three numerical examples have been solved to demonstrate the applicability of the method.     

A unified framework for linear control problems with state-variable inequality constraints

This paper briefly reviews the literature on necessary optimality conditions for optimal control problems with state-variable inequality constraints. Then, it attempts to unify the treatment of linear optimal control problems with state-variable inequality constraints in the framework of continuous linear programming. The duality theory in this framework makes it possible to relate the adjoint variables arising in different formulations of a problem; these relationships are illustrated by the use of a simple example. This framework also allows more general problems and admits a simplex-like algorithm to solve these problems.This research was partially supported by Grant No. A4619 from the National Research Council of Canada to the first author. The first author also acknowledges the support provided by the Brookhaven National Laboratory, where he conducted his research.     

A transformation technique for optimal control problems with partially linear state inequality constraints

This paper considers optimal control problems involving the minimization of a functional subject to differential constraints, terminal constraints, and a state inequality constraint. The state inequality constraint is of a special type, namely, it is linear in some or all of the components of the state vector.A transformation technique is introduced, by means of which the inequality-constrained problem is converted into an equality-constrained problem involving differential constraints, terminal constraints, and a control equality constraint. The transformation technique takes advantage of the partial linearity of the state inequality constraint so as to yield a transformed problem characterized by a new state vector of minimal size. This concept is important computationally, in that the computer time per iteration increases with the square of the dimension of the state vector.In order to illustrate the advantages of the new transformation technique, several numerical examples are solved by means of the sequential gradient-restoration algorithm for optimal control problems involving nondifferential constraints. The examples show the substantial savings in computer time for convergence, which are associated with the new transformation technique.This research was supported by the Office of Scientific Research, Office of Aerospace Research, United States Air Force, Grant No. AF-AFOSR-76-3075, and by the National Science Foundation, Grant No. MCS-76-21657.     

Time-optimal control problem for parabolic equations with control constraints and infinite number of variables

A time optimal control problem for parabolic equations withan infinite number of variables is considered. A time optimalcontrol problem is replaced by an equivalent one with a performanceindex in the form of integral form. Constraints on controlsare assumed. To obtain the optimality conditions for the Neumannproblem, the generalization of the Dubovitskii–Milyutintheorem given by Walczak (1984, Acta Universitatis LodziensisFolia Mathematica, 187–196; 1984, J. Optim. Theor. Appl.,42, 561–582) was applied.