A maximum principle for optimal control problems with mixed constraints

Necessary conditions in the form of maximum principles are derivedfor optimal control problems with mixed control and state constraints.Traditionally, necessary condtions for problems with mixed constraintshave been proved under hypothesis which include the requirementthat the Jacobian of the mixed constraint functional, with respectto the control variable, have full rank. We show that it canbe replaced by a weaker ‘interiority’ hypothesis.This refinement broadens the scope of the optimality conditions,to cover some optimal control problems involving differentialalgebraic constraints, with index greater than unity.     

Sufficient optimality conditions for nonconvex control problems with state constraints

The sufficient optimality conditions of Zeidan for optimal control problems (Refs. 1 and 2) are generalized such that they are applicable to problems with pure state-variable inequality constraints. We derive conditions which neither assume the concavity of the Hamiltonian nor the quasiconcavity of the constraints. Global as well as local optimality conditions are presented.     

Sufficient optimality conditions for multidimensional optimal control problems with mixed constraints governed by an elliptic PDE

In this article, the idea of a dual dynamic programming is applied to the optimal control problems with multiple integrals governed by a semi-linear elliptic PDE and mixed state-control constraints. The main result called a verification theorem provides the new sufficient conditions for optimality in terms of a solution to the dual equation of a multidimensional dynamic programming. The optimality conditions are also obtained by using the concept of an optimal dual feedback control. Besides seeking the exact minimizers of problems considered some kind of an approximation is given and the sufficient conditions for an approximated optimal pair are derived.     

Maximum principle for optimal control problems with intermediate constraints

We consider optimal control problems with constraints at intermediate points of the trajectory. A natural technique (propagation of phase and control variables) is applied to reduce these problems to a standard optimal control problem of Pontryagin type with equality and inequality constraints at the trajectory endpoints. In this way we derive necessary optimality conditions that generalize the Pontryagin classical maximum principle. The same technique is applied to so-called variable structure problems and to some hybrid problems. The new optimality conditions are compared with the results of other authors and five examples illustrating their application are presented.     

Regularity of solutions for an optimal control problem with mixed control-state constraints

A class of optimal control problems for a semilinear elliptic partial differential equation with mixed control-state constraints is considered. Existence results of an optimal control and necessary optimality conditions are stated. Moreover, a projection formula is derived that is equivalent to the necessary optimality conditions. As main result, the Lipschitz continuity of the optimal control is obtained.     

Regularization for semilinear elliptic optimal control problems with pointwise state and control constraints

In this paper a class of semilinear elliptic optimal control problem with pointwise state and control constraints is studied. We show that sufficient second order optimality conditions for regularized problems with small regularization parameter can be obtained from a second order sufficient condition assumed for the unregularized problem. Moreover, error estimates with respect to the regularization parameter are derived.     

A unified framework for linear control problems with state-variable inequality constraints

This paper briefly reviews the literature on necessary optimality conditions for optimal control problems with state-variable inequality constraints. Then, it attempts to unify the treatment of linear optimal control problems with state-variable inequality constraints in the framework of continuous linear programming. The duality theory in this framework makes it possible to relate the adjoint variables arising in different formulations of a problem; these relationships are illustrated by the use of a simple example. This framework also allows more general problems and admits a simplex-like algorithm to solve these problems.This research was partially supported by Grant No. A4619 from the National Research Council of Canada to the first author. The first author also acknowledges the support provided by the Brookhaven National Laboratory, where he conducted his research.     

Maximum principle in problems with mixed constraints under weak assumptions of regularity

In the present work, optimal control problems with mixed constraints are investigated. A novel weakening of the conventional regularity assumptions on mixed constraints is introduced. A maximum principle is derived in which the maximum condition is of nonstandard type: the maximum is taken over the closure of the set of regular points, but not over the whole feasible set.     

Investigation of regularity conditions in optimal control problems with geometric mixed constraints

We investigate regularity conditions in optimal control problems with mixed constraints of a general geometric type, in which a closed non-convex constraint set appears. A closely related question to this issue concerns the derivation of necessary optimality conditions under some regularity conditions on the constraints. By imposing strong and weak regularity condition on the constraints, we provide necessary optimality conditions in the form of Pontryagin maximum principle for the control problem with mixed constraints. The optimality conditions obtained here turn out to be more general than earlier results even in the case when the constraint set is convex. The proofs of our main results are based on a series of technical lemmas which are gathered in the Appendix.     

Necessary conditions of Pareto optimality for multiobjective optimal control problems under constraints

This paper studies multiobjective optimal control problems in presence of constraints in the discrete time framework. Both the finite- and infinite-horizon settings are considered. The paper provides necessary conditions of Pareto optimality under lighter smoothness assumptions compared to the previously obtained results. These conditions are given in the form of weak and strong Pontryagin principles which generalize the existing ones. To obtain some of these results, we provide new multiplier rules for multiobjective static optimization problems and new Pontryagin principles for the finite horizon multiobjective optimal control problems.     

A maximum principle for nonsmooth optimal-control problems with state constraints

Optimality conditions are derived in the form of a maximum principle governing solutions to an optimal control problem which involves state constraints. The conditions, which apply in the absence of differentiability assumptions on the data, are stated in terms of Clarke's generalized Jacobians. Although not the most general available, the conditions are derived by a novel method: this involves removal of the state constraints by introduction of a penalty term and application of Ekeland's variational principle.     

Quadratic weak-minimum conditions for optimal control problems with intermediate constraints

Optimal control problems with constraints at intermediate trajectory points are considered. By using a certain natural method (of reproduction of state and control variables), these problems reduce to the standard optimal control problem of Pontryagin type, which allows one to obtain quadratic weak-minimum conditions for them.     

Necessary conditions for optimal control problems with state constraints

Necessary conditions of optimality are derived for optimal control problems with pathwise state constraints, in which the dynamic constraint is modelled as a differential inclusion. The novel feature of the conditions is the unrestrictive nature of the hypotheses under which these conditions are shown to be valid. An Euler Lagrange type condition is obtained for problems where the multifunction associated with the dynamic constraint has values possibly unbounded, nonconvex sets and satisfies a mild `one-sided' Lipschitz continuity hypothesis. We recover as a special case the sharpest available necessary conditions for state constraint free problems proved in a recent paper by Ioffe. For problems where the multifunction is convex valued it is shown that the necessary conditions are still valid when the one-sided Lipschitz hypothesis is replaced by a milder, local hypothesis. A recent `dualization' theorem permits us to infer a strengthened form of the Hamiltonian inclusion from the Euler Lagrange condition. The necessary conditions for state constrained problems with convex valued multifunctions are derived under hypotheses on the dynamics which are significantly weaker than those invoked by Loewen and Rockafellar to achieve related necessary conditions for state constrained problems, and improve on available results in certain respects even when specialized to the state constraint free case.

Proofs make use of recent `decoupling' ideas of the authors, which reduce the optimization problem to one to which Pontryagin's maximum principle is applicable, and a refined penalization technique to deal with the dynamic constraint.

     

Control problems with state constraints for shape memory alloys

In this paper, two different control problems with state constraints for shape memory alloys are considered: in the non-isothermal case, we study boundary control problems, and in the isothermal situation, a dynamical shape optimization problem is considered. In both cases, the transverse displacement is the constrained state variable. The first-order conditions of optimality are derived.     

Second-order sufficient conditions for control problems with mixed control-state constraints

References 1–4 develop second-order sufficient conditions for local minima of optimal control problems with state and control constraints. These second-order conditions tighten the gap between necessary and sufficient conditions by evaluating a positive-definiteness criterion on the tangent space of the active constraints. The purpose of this paper is twofold. First, we extend the methods in Refs. 3, 4 and include general boundary conditions. Then, we relate the approach to the two-norm approach developed in Ref. 5. A direct sufficiency criterion is based on a quadratic function that satisfies a Hamilton-Jacobi inequality. A specific form of such a function is obtained by applying the second-order sufficient conditions to a parametric optimization problem. The resulting second-order positive-definiteness conditions can be verified by solving Riccati equations.The authors wish to thank K. Malanowski for helpful discussions.     

Solving elliptic control problems with interior point and SQP methods: control and state constraints

We study optimal control problems for semilinear elliptic equations subject to control and state inequality constraints. Both boundary control and distributed control problems are considered with boundary conditions of Dirichlet or Neumann type. By introducing suitable discretization schemes, the control problem is transcribed into a nonlinear programming problem. Necessary conditions of optimality are discussed both for the continuous and the discretized control problem. It is shown that the recently developed interior point method LOQO of [35] is capable of solving these problems even for high discretizations. Four numerical examples with Dirichlet and Neumann boundary conditions are provided that illustrate the performance of the algorithm for different types of controls including bang–bang controls.     

On some elliptic optimal control problems with state constraints

In this paper optimality conditions will be derived for elliptic optimal control problems with a restriction on the state or on the gradient of the state. Essential tools are the method of transposition and generalized trace theorems and green's formulas from the theory of elliptic differential equations.     

Transversality condition for infinite-horizon problems

We present necessary conditions of optimality for an infinitehorizon optimal control problem. The transversality condition is derived with the help of stability theory and is formulated in terms of the Lyapunov exponents of solutions to the adjoint equation. A problem without an exponential factor in the integral functional is considered. Necessary and sufficient conditions of optimality are proved for linear quadratic problems with conelike control constraints.     

SQP-methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis and real-time control

Parametric nonlinear optimal control problems subject to control and state constraints are studied. Two discretization methods are discussed that transcribe optimal control problems into nonlinear programming problems for which SQP-methods provide efficient solution methods. It is shown that SQP-methods can be used also for a check of second-order sufficient conditions and for a postoptimal calculation of adjoint variables. In addition, SQP-methods lead to a robust computation of sensitivity differentials of optimal solutions with respect to perturbation parameters. Numerical sensitivity analysis is the basis for real-time control approximations of perturbed solutions which are obtained by evaluating a first-order Taylor expansion with respect to the parameter. The proposed numerical methods are illustrated by the optimal control of a low-thrust satellite transfer to geosynchronous orbit and a complex control problem from aquanautics. The examples illustrate the robustness, accuracy and efficiency of the proposed numerical algorithms.