A control parametrization algorithm for optimal control problems involving linear systems and linear 1

Computational schemes based on control parametrization techniques are known to be very efficient for solving optimal control problems. However, the convergence result is only available for the case in which the dynamic system is linear and without the terminal equality and inequality constraints. This paper is to improve this convergence result by allowing the presence of the linear terminal inequality. For illustration, an example arising in the study of optimally one-sided heating of a metal slab in a furnace is considered.     

Semiconcavity results for constrained optimal control problems in a half-space

In this paper we give semiconcavity results for the value function of some constrained optimal control problems with infinite horizon in a half-space. In particular, we assume that the control space is the l¹-ball or the l^∞-ball in Rn.     

A solution method for regular optimal control problems with state constraints

A method of region analysis is developed for solving a class of optimal control problems with one state and one control variable, including state and control constraints. The performance index is strictly convex with respect to the control variable, while this variable appears only linearly in the state equation. The convexity or linearity assumption of the performance index or the state equation with respect to the state variable is not required.The author would like to express his sincere gratitude to Prof. R. Klötzler, Prof. E. Zeidler, Prof. H. Schumann, Prof. J. Focke, and other colleagues of the Department of Mathematics, Karl Marx University, Leipzig, GDR, for their support during his stay in Leipzig.     

A virtual control concept for state constrained optimal control problems

A linear elliptic control problem with pointwise state constraints is considered. These constraints are given in the domain. In contrast to this, the control acts only at the boundary. We propose a general concept using virtual control in this paper. The virtual control is introduced in objective, state equation, and constraints. Moreover, additional control constraints for the virtual control are investigated. An error estimate for the regularization error is derived as main result of the paper. The theory is illustrated by numerical tests.     

Shooting method for the numerical solution of optimal control problems with bounded state variables

Abtract Various methods have been proposed for the numerical solution of optimal control problems with bounded state variables. In this paper, a new method is put forward and compared with two other methods, one of which makes use of adjoint variables whereas the other does not. Some conclusions are drawn on the usefulness of the three methods involved.     

Local convergence of an algorithm for solving optimal control problems

In this paper, a method is proposed for the numerical solution of optimal control problems with terminal equality constraints. The multiplier method is employed to deal with the terminal equality constraints. It is shown that a sequence of control functions, which converges to the optimal control, is obtained by the alternate update of control functions and multipliers.The authors wish to thank Dr. N. Fujii for his most valuable comments and suggestions.     

An exact penalty function algorithm for optimal control problems with control and terminal equality constraints,part 1

The presence of control constraints, because they are nondifferentiable in the space of control functions, makes it difficult to cope with terminal equality constraints in optimal control problems. Gradient-projection algorithms, for example, cannot be employed easily. These difficulties are overcome in this paper by employing an exact penalty function to handle the cost and terminal equality constraints and using the control constraints to define the space of permissible search directions in the search-direction subalgorithm. The search-direction subalgorithm is, therefore, more complex than the usual linear program employed in feasible-directions algorithms. The subalgorithm approximately solves a convex optimal control problem to determine the search direction; in the implementable version of the algorithm, the accuracy of the approximation is automatically increased to ensure convergence.This work was supported by the United Kingdom Science Research Council, by the US Army Research Office, Contract No. DAAG-29-73-C-0025, and by the National Science Foundation, Grant No. ENG-73-08214-A01.     

A priori error estimates for elliptic optimal control problems with a bilinear state equation

In this paper a priori error analysis for the finite element discretization of an optimal control problem governed by an elliptic state equation is considered. The control variable enters the state equation as a coefficient and is subject to pointwise inequality constraints. We derive a priori error estimates for the discretization error in the control variable and confirm our theoretical results by numerical examples.     

SEQUENTIAL QUADRATIC PROGRAMMING METHODS FOR OPTIMAL CONTROL PROBLEMS WITH STATE CONSTRAINTS

A Kind of direct methods is presented for the solution of optimal control problems with state constraints.These methods are sequential quadratic programming methods.At every iteration a quadratic programming which is obtained by quadratic approximation to Lagrangian function and Linear approximations to constraints is solved to get a search direction for a merit function.The merit function is formulated by augmenting the Lagrangian funetion with a penalty term.A line search is carried out along the search direction to determine a step length such that the merit function is decreased.The methods presented in this paper include continuous sequential quadratic programming methods and discreate sequential quadrade programming methods.     

An exact penalty function algorithm for optimal control problems with control and terminal equality constraints,part 2

In Part 1 of this paper, implementable and conceptual versions of an algorithm for optimal control problems with control constraints and terminal equality constraints were presented. It was shown that anyL accumulation points of control sequences generated by the algorithms satisfy necessary conditions of optimality. Since such accumulation points need not exist, it is shown in this paper that control sequences generated by the algorithms always have accumulation points in the sense of control measure, and these accumulation points satisfy optimality conditions for the corresponding relaxed control problem.This work was supported by the United Kingdom Science Research Council, by the US Army Research Office, Contract No. DAA-29-73-C-0025, and by the National Science Foundation, Grant No. ENG-73-08214-A01.     

Numerical solution of minimax optimal control problems by multiple shooting technique

This paper presents the application of the multiple shooting technique to minimax optimal control problems (optimal control problems with Chebyshev performance index). A standard transformation is used to convert the minimax problem into an equivalent optimal control problem with state variable inequality constraints. Using this technique, the highly developed theory on the necessary conditions for state-restricted optimal control problems can be applied advantageously. It is shown that, in general, these necessary conditions lead to a boundary-value problem with switching conditions, which can be treated numerically by a special version of the multiple shooting algorithm. The method is tested on the problem of the optimal heating and cooling of a house. This application shows some typical difficulties arising with minimax optimal control problems, i.e., the estimation of the switching structure which is dependent on the parameters of the problem. This difficulty can be overcome by a careful application of a continuity method. Numerical solutions for the example are presented which demonstrate the efficiency of the method proposed.     

An alternative approach for non-linear optimal control problems based on the method of moments

We propose an alternative method for computing effectively the solution of non-linear, fixed-terminal-time, optimal control problems when they are given in Lagrange, Bolza or Mayer forms. This method works well when the nonlinearities in the control variable can be expressed as polynomials. The essential of this proposal is the transformation of a non-linear, non-convex optimal control problem into an equivalent optimal control problem with linear and convex structure. The method is based on global optimization of polynomials by the method of moments. With this method we can determine either the existence or lacking of minimizers. In addition, we can calculate generalized solutions when the original problem lacks of minimizers. We also present the numerical schemes to solve several examples arising in science and technology.     

An SQP method for optimal control of weakly singular Hammerstein integral equations

We investigate local convergence of an SQP method for nonlinear optimal control of weakly singular Hammerstein integral equations. Sufficient conditions for local quadratic convergence of the method are discussed.     

An approach for an algorithmic solution of discrete optimal control problems and their game-theoretical extension

We consider time discrete systems which are described by a system of difference equations. The related discrete optimal control problems are introduced. Additionally, a gametheoretic extension is derived, which leads to general multicriteria decision problems. The characterization of their optimal behavior is studied. Given starting and final states define the decision process; applying dynamic programming techniques suitable optimal solutions can be gained. We generalize that approach to a special gametheoretic decision procedure on networks. We characterize Nash equilibria and present sufficient conditions for their existence. A constructive algorithm is derived. The sufficient conditions are exploited to get the algorithmic solution. Its complexity analysis is presented and at the end we conclude with an extension to the complementary case of Pareto optima.Dmitrii Lozovanu was Supported by BGP CRDF-MRDA MOM2-3049-CS-03.     

Conjugate gradient-boundary element solution for distributed elliptic optimal control problems

An optimality system of equations for the optimal control problem governed by Helmholtz-type equations is derived. By the associated first-order necessary optimality condition, we obtain the conjugate gradient method (CGM) in the continuous case. Introducing the sequence of higher-order fundamental solutions, we propose an iterative algorithm based on the conjugate gradient-boundary element method using the multiple reciprocity method (CGM+MRBEM) for solving the discrete control input. This algorithm has an advantage over that of the existing literatures because the main attribute (the reduced dimensionality) of the boundary element method is fully utilized. Finally, the local error estimates for this scheme are obtained, and a test problem is given to illustrate the efficiency of the proposed method.     

Optimal control of a singular PDE modeling transient MEMS with control or state constraints

A particular feature of certain microelectromechanical systems (MEMS) is the appearance of a so-called “pull-in” instability, corresponding to a singularity in the underlying PDE model. We here consider a transient MEMS model and its optimal control via the dielectric properties of the membrane and/or the applied voltage. In contrast to the static case, the control problem suffers from low dimensionality of the control compared to the state and hence requires different techniques for establishing first order optimality conditions. For this purpose, we here use a relaxation approach combined with a localization technique.     

On unbounded solutions of Bellman's equation associated with optimal switching control problems with state constraints

We study a quasi-variational inequality system with unbounded solutions. It represents the Bellman equation associated with an optimal switching control problem with state constraints arising from production engineering. We show that the optimal cost is the unique viscosity solution of the system.This work was supported by the National Research Council of Argentina, Grant No. PID-BID 213.     

Numerical solution of optimal control problems for loaded lumped parameter systems

An optimal control problem for the system of linear (with respect to phase variables) loaded ordinary differential equations with initial (local) and nonseparated multipoint (nonlocal) conditions is investigated. Necessary optimality conditions are obtained, numerical schemes of their solution are proposed, and results of numerical experiments are presented.     

On an optimal control problem involving first order hyperbolic systems with boundary controls

In this paper, we consider an optimal control problem involving a class of first order hyperbolic systems with boundary controls. A computational algorithm which generates minimizing sequences of controls is devised and the convergence properties of the algorithm are investigated. Moreover, a necessary and sufficient condition for optimality is derived and a result on the existence of optimal controls is obtained.