Sufficient quadratic conditions of extremum for discontinuous controls in optimal control problems with mixed constraints

We derive second-order sufficient optimality conditions for discontinuous controls in optimal control problems of ordinary differential equations with initial-final state constraints and mixed state-control constraints of equality and inequality type. Under the assumption that the gradients with respect to the control of active mixed constraints are linearly independent, the sufficient conditions imply a bounded strong minimum in the problem.     

Necessary extremum conditions in the optimal control problem with state constraints

The optimal control problem with state constraints is examined. An alternative to the available approaches to the study of this problem is proposed. The maximum principle and second-order necessary conditions are proved.     

Necessary conditions for optimal control problems with state constraints

Necessary conditions of optimality are derived for optimal control problems with pathwise state constraints, in which the dynamic constraint is modelled as a differential inclusion. The novel feature of the conditions is the unrestrictive nature of the hypotheses under which these conditions are shown to be valid. An Euler Lagrange type condition is obtained for problems where the multifunction associated with the dynamic constraint has values possibly unbounded, nonconvex sets and satisfies a mild `one-sided' Lipschitz continuity hypothesis. We recover as a special case the sharpest available necessary conditions for state constraint free problems proved in a recent paper by Ioffe. For problems where the multifunction is convex valued it is shown that the necessary conditions are still valid when the one-sided Lipschitz hypothesis is replaced by a milder, local hypothesis. A recent `dualization' theorem permits us to infer a strengthened form of the Hamiltonian inclusion from the Euler Lagrange condition. The necessary conditions for state constrained problems with convex valued multifunctions are derived under hypotheses on the dynamics which are significantly weaker than those invoked by Loewen and Rockafellar to achieve related necessary conditions for state constrained problems, and improve on available results in certain respects even when specialized to the state constraint free case.

Proofs make use of recent `decoupling' ideas of the authors, which reduce the optimization problem to one to which Pontryagin's maximum principle is applicable, and a refined penalization technique to deal with the dynamic constraint.

     

Necessary optimality conditions for a class of optimal control problems with discontinuous integrand

We consider a nonlinear optimal control problem with an integral functional in which the integrand contains the characteristic function of a given closed subset of the phase space. Using an approximation method, we prove necessary optimality conditions in the form of the Pontryagin maximum principle without any a priori assumptions about the behavior of an optimal trajectory.     

Necessary extremum conditions for smooth anormal problems with equality- and inequality-type constraints

Translated from Matematicheskie Zametki, Vol. 45, No. 6, pp. 3–11, June, 1989.     

Necessary conditions of Pareto optimality for multiobjective optimal control problems under constraints

This paper studies multiobjective optimal control problems in presence of constraints in the discrete time framework. Both the finite- and infinite-horizon settings are considered. The paper provides necessary conditions of Pareto optimality under lighter smoothness assumptions compared to the previously obtained results. These conditions are given in the form of weak and strong Pontryagin principles which generalize the existing ones. To obtain some of these results, we provide new multiplier rules for multiobjective static optimization problems and new Pontryagin principles for the finite horizon multiobjective optimal control problems.     

Investigation of regularity conditions in optimal control problems with geometric mixed constraints

We investigate regularity conditions in optimal control problems with mixed constraints of a general geometric type, in which a closed non-convex constraint set appears. A closely related question to this issue concerns the derivation of necessary optimality conditions under some regularity conditions on the constraints. By imposing strong and weak regularity condition on the constraints, we provide necessary optimality conditions in the form of Pontryagin maximum principle for the control problem with mixed constraints. The optimality conditions obtained here turn out to be more general than earlier results even in the case when the constraint set is convex. The proofs of our main results are based on a series of technical lemmas which are gathered in the Appendix.     

SEQUENTIAL QUADRATIC PROGRAMMING METHODS FOR OPTIMAL CONTROL PROBLEMS WITH STATE CONSTRAINTS

A Kind of direct methods is presented for the solution of optimal control problems with state constraints.These methods are sequential quadratic programming methods.At every iteration a quadratic programming which is obtained by quadratic approximation to Lagrangian function and Linear approximations to constraints is solved to get a search direction for a merit function.The merit function is formulated by augmenting the Lagrangian funetion with a penalty term.A line search is carried out along the search direction to determine a step length such that the merit function is decreased.The methods presented in this paper include continuous sequential quadratic programming methods and discreate sequential quadrade programming methods.     

Necessary conditions for optimal singular stochastic control problems

In this paper, necessary conditions of optimality, in the form of a maximum principle, are obtained for singular stochastic control problems. This maximum principle is derived for a state process satisfying a general stochastic differential equation where the coefficient associated to the control process can be dependent on the state, extending earlier results of the literature.     

Second-order conditions for extremum problems with nonregular equality constraints

Combining results of Avakov about tangent directions to equality constraints given by smooth operators with results of Ben-Tal and Zowe, we formulate a second-order theory for optimality in the sense of Dubovitskii-Milyutin which gives nontrivial conditions also in the case of equality constraints given by nonregular operators. Secondorder feasible and tangent directions are defined to construct conical approximations to inequality and equality constraints which within a single construction lead to first- and second-order conditions of optimality for the problem also in the nonregular case. The definitions of secondorder feasible and tangent directions given in this paper allow for reparametrizations of the approximating curves and give approximating sets which form cones. The main results of the paper are a theorem which states second-order necessary condition of optimality and several corollaries which treat special cases. In particular, the paper generalizes the Avakov result in the smooth case.This research was supported by NSF Grant DMS-91-009324, NSF Grant DMS-91-00043, SIUE Research Scholar Award and Fourth Quarter Fellowship, Summer 1992.     

A maximum principle for optimal control problems with mixed constraints

Necessary conditions in the form of maximum principles are derivedfor optimal control problems with mixed control and state constraints.Traditionally, necessary condtions for problems with mixed constraintshave been proved under hypothesis which include the requirementthat the Jacobian of the mixed constraint functional, with respectto the control variable, have full rank. We show that it canbe replaced by a weaker ‘interiority’ hypothesis.This refinement broadens the scope of the optimality conditions,to cover some optimal control problems involving differentialalgebraic constraints, with index greater than unity.     

Quadratic weak-minimum conditions for optimal control problems with intermediate constraints

Optimal control problems with constraints at intermediate trajectory points are considered. By using a certain natural method (of reproduction of state and control variables), these problems reduce to the standard optimal control problem of Pontryagin type, which allows one to obtain quadratic weak-minimum conditions for them.     

Necessary conditions for stochastic optimal control problems in infinite dimensions

The purpose of this paper is to establish the first and second order necessary conditions for stochastic optimal controls in infinite dimensions. The control system is governed by a stochastic evolution equation, in which both drift and diffusion terms may contain the control variable and the set of controls is allowed to be nonconvex. Only one adjoint equation is introduced to derive the first order necessary optimality condition either by means of the classical variational analysis approach or, under an additional assumption, by using differential calculus of set-valued maps. More importantly, in order to avoid the essential difficulty with the well-posedness of higher order adjoint equations, using again the classical variational analysis approach, only the first and the second order adjoint equations are needed to formulate the second order necessary optimality condition, in which the solutions to the second order adjoint equation are understood in the sense of the relaxed transposition.