First- and second-order optimality conditions for a strong local minimum in control problems with pure state constraints

In this paper first- and second-order optimality conditions for a strong local minimum are presented for optimal control problems with pure state set-inclusion constraints. The first-order condition is of Pontryagin type, while the second-order condition is of the form of an accessory problem associated with the strong local minimality. This latter condition contains an extra term reflecting the presence of the pure state constraints.     

Regularity properties of optimal controls for problems with time-varying state and control constraints

In this paper we report new results on the regularity of optimal controls for dynamic optimization problems with functional inequality state constraints, a convex time-dependent control constraint and a coercive cost function. Recently, it has been shown that the linear independence condition on active state constraints, present in the earlier literature, can be replaced by a less restrictive, positive linear independence condition, that requires linear independence merely with respect to non-negative weighting parameters, provided the control constraint set is independent of the time variable. We show that, if the control constraint set, regarded as a time-dependent multifunction, is merely Lipschitz continuous with respect to the time variable, then optimal controls can fail to be Lipschitz continuous. In these circumstances, however, a weaker Hölder continuity-like regularity property can be established. On the other hand, Lipschitz continuity of optimal controls is guaranteed for time-varying control sets under a positive linear independence hypothesis, when the control constraint sets are described, at each time, by a finite collection of functional inequalities.     

Necessary optimality conditions for infinite dimensional state constrained control problems

This paper is concerned with first order necessary optimality conditions for state constrained control problems in separable Banach spaces. Assuming inward pointing conditions on the constraint, we give a simple proof of Pontryagin maximum principle, relying on infinite dimensional neighboring feasible trajectories theorems proved in [20]. Further, we provide sufficient conditions guaranteeing normality of the maximum principle. We work in the abstract semigroup setting, but nevertheless we apply our results to several concrete models involving controlled PDEs. Pointwise state constraints (as positivity of the solutions) are allowed.     

Dirichlet Boundary Control of Semilinear Parabolic Equations Part 1: Problems with No State Constraints

This paper is concerned with distributed and Dirichlet boundary controls of semilinear parabolic equations, in the presence of pointwise state constraints. The paper is divided into two parts. In the first part we define solutions of the state equation as the limit of a sequence of solutions for equations with Robin boundary conditions. We establish Taylor expansions for solutions of the state equation with respect to perturbations of boundary control (Theorem 5.2). For problems with no state constraints, we prove three decoupled Pontryagin's principles, one for the distributed control, one for the boundary control, and the last one for the control in the initial condition (Theorem 2.1). Tools and results of Part 1 are used in the second part to derive Pontryagin's principles for problems with pointwise state constraints. Accepted 12 July 2001. Online publication 21 December 2001.     

A lagrange multiplier theorem for control problems with state constraints

We prove an existence theorem of Lagrange multipliers for an abstract control problem in Banach spaces. This theorem may be applied to obtain optimality conditions for control problems governed by partial differential equations in the presence of pointwise state constraints.     

Solving optimal control problems for the unsteady Burgers equation in COMSOL Multiphysics

The optimal control of unsteady Burgers equation without constraints and with control constraints are solved using the high-level modelling and simulation package COMSOL Multiphysics. Using the first-order optimality conditions, projection and semi-smooth Newton methods are applied for solving the optimality system. The optimality system is solved numerically using the classical iterative approach by integrating the state equation forward in time and the adjoint equation backward in time using the gradient method and considering the optimality system in the space-time cylinder as an elliptic equation and solving it adaptively. The equivalence of the optimality system to the elliptic partial differential equation (PDE) is shown by transforming the Burgers equation by the Cole-Hopf transformation to a linear diffusion type equation. Numerical results obtained with adaptive and nonadaptive elliptic solvers of COMSOL Multiphysics are presented both for the unconstrained and the control constrained case.     

Finite element approximation of elliptic control problems with constraints on the gradient

We consider an elliptic optimal control problem with control constraints and pointwise bounds on the gradient of the state. We present a tailored finite element approximation to this optimal control problem, where the cost functional is approximated by a sequence of functionals which are obtained by discretizing the state equation with the help of the lowest order Raviart–Thomas mixed finite element. Pointwise bounds on the gradient variable are enforced in the elements of the triangulation. Controls are not discretized. Error bounds for control and state are obtained in two and three space dimensions. A numerical example confirms our analytical findings.     

Minimax Control of Parabolic Systems with Dirichlet Boundary Conditions and State Constraints

In this paper we formulate and study a minimax control problem for a class of parabolic systems with controlled Dirichlet boundary conditions and uncertain distributed perturbations under pointwise control and state constraints. We prove an existence theorem for minimax solutions and develop effective penalized procedures to approximate state constraints. Based on a careful variational analysis, we establish convergence results and optimality conditions for approximating problems that allow us to characterize suboptimal solutions to the original minimax problem with hard constraints. Then passing to the limit in approximations, we prove necessary optimality conditions for the minimax problem considered under proper constraint qualification conditions. Accepted 7 June 1996     

Lipschitz continuity and local semiconcavity for exit time problems with state constraints

In the classical time optimal control problem, it is well known that the so-called Petrov condition is necessary and sufficient for the minimum time function to be locally Lipschitz continuous. In this paper, the same regularity result is obtained in the presence of nonsmooth state constraints. Moreover, for a special class of control systems we obtain a local semiconcavity result for the constrained minimum time function.     

Mesh-independence of semismooth Newton methods for Lavrentiev-regularized state constrained nonlinear optimal control problems

A class of nonlinear elliptic optimal control problems with mixed control-state constraints arising, e.g., in Lavrentiev-type regularized state constrained optimal control is considered. Based on its first order necessary optimality conditions, a semismooth Newton method is proposed and its fast local convergence in function space as well as a mesh-independence principle for appropriate discretizations are proved. The paper ends by a numerical verification of the theoretical results including a study of the algorithm in the case of vanishing Lavrentiev-parameter. The latter process is realized numerically by a combination of a nested iteration concept and an extrapolation technique for the state with respect to the Lavrentiev-parameter.     

A multigrid method for constrained optimal control problems

We consider the fast and efficient numerical solution of linear-quadratic optimal control problems with additional constraints on the control. Discretization of the first-order conditions leads to an indefinite linear system of saddle point type with additional complementarity conditions due to the control constraints. The complementarity conditions are treated by a primal-dual active set strategy that serves as outer iteration. At each iteration step, a KKT system has to be solved. Here, we develop a multigrid method for its fast solution. To this end, we use a smoother which is based on an inexact constraint preconditioner.We present numerical results which show that the proposed multigrid method possesses convergence rates of the same order as for the underlying (elliptic) PDE problem. Furthermore, when combined with a nested iteration, the solver is of optimal complexity and achieves the solution of the optimization problem at only a small multiple of the cost for the PDE solution.     

On convergence of Lavrentiev regularization for semilinear parabolic optimal control problems with pointwise control and state constraints

We consider Lavrentiev regularization for a class of semilinear parabolic optimal control problems with control constraints and pointwise state constraints and review convergence results for local solutions under Slater type assumptions as well as quadratic growth conditions. Moreover, we state a local uniqueness result for local optima under the assumptions of strict separability of the active sets as well as a second order sufficient condition for the regularized solution. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Nondegenerate necessary conditions for nonlinear optimal control problems with higher-index state constraints

For some optimal control problems with pathwise state constraints the standard versions of the necessary conditions of optimality are unable to provide useful information to select minimizers. There exist some literature on stronger forms of the maximum principle, the so-called nondegenerate necessary conditions, that can be informative for those problems. These conditions can be applied when certain constraint qualifications are satisfied. However, when the state constraints have higher index (i.e. their first derivative with respect to time does not depend on the control) these nondegenerate necessary conditions cannot be used. This happens because constraint qualifications assumptions are never satisfied for higher index state constraints. We note that control problems with higher index state constraints arise frequently in practice. An example is a common mechanical systems for which there is a constraint on the position (an obstacle in the path, for example) and the control acts as a second derivative of the position (a force or acceleration) which is a typical case. Here, we provide a nondegenerate form of the necessary conditions that can be applied to nonlinear problems with higher index state constraints. When addressing a problem with a state constraint of index k, the result described is applicable under a constraint qualification that involves the k -th derivative of the state constraint, corresponding to the first time when derivative depends explicitly on the control. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Necessary and sufficient optimality conditions for mathematical programs with equilibrium constraints

In this paper we consider a mathematical program with equilibrium constraints (MPEC) formulated as a mathematical program with complementarity constraints. Various stationary conditions for MPECs exist in literature due to different reformulations. We give a simple proof to the M-stationary condition and show that it is sufficient for global or local optimality under some MPEC generalized convexity assumptions. Moreover, we propose new constraint qualifications for M-stationary conditions to hold. These new constraint qualifications include piecewise MFCQ, piecewise Slater condition, MPEC weak reverse convex constraint qualification, MPEC Arrow-Hurwicz-Uzawa constraint qualification, MPEC Zangwill constraint qualification, MPEC Kuhn-Tucker constraint qualification, and MPEC Abadie constraint qualification.     

Dirichlet Boundary Control of Semilinear Parabolic Equations Part 2: Problems with Pointwise State Constraints

This paper is the continuation of the paper ``Dirichlet boundary control of semilinear parabolic equations. Part 1: Problems with no state constraints.' It is concerned with an optimal control problem with distributed and Dirichlet boundary controls for semilinear parabolic equations, in the presence of pointwise state constraints. We first obtain approximate optimality conditions for problems in which state constraints are penalized on subdomains. Next by using a decomposition theorem for some additive measures (based on the Stone—Cech compactification), we pass to the limit and recover Pontryagin's principles for the original problem. Accepted 21 July 2001. Online publication 21 December 2001.     

Optimality conditions with state constraints for semilinear systems determined by operator valued measures

In this paper we develop the necessary conditions of optimality for a class of distributed parameter systems (partial differential equations) determined by operator valued measures and controlled by vector measures. Based on some recent results on existence of optimal controls from the space of vector measures, we develop necessary conditions of optimality for a class of control problems. The main results are the necessary conditions of optimality for problems without state constraints and those with state constraints. Also, a conceptual algorithm along with a brief discussion of its convergence is presented.     

Second-Order Analysis for Control Constrained Optimal Control Problems of Semilinear Elliptic Systems

This paper presents a second-order analysis for a simple model optimal control problem of a partial differential equation, namely, a well-posed semilinear elliptic system with constraints on the control variable only. The cost to be minimized is a standard quadratic functional. Assuming the feasible set to be polyhedric, we state necessary and sufficient second-order optimality conditions, including a characterization of the quadratic growth condition. Assuming that the second-order sufficient condition holds, we give a formula for the second-order expansion of the value of the problem as well as the directional derivative of the optimal control, when the cost function is perturbed. Then we extend the theory of second-order optimality conditions to the case of vector-valued controls when the feasible set is defined by local and smooth convex constraints. When the space dimension n is greater than 3, the results are based on a two norms approach, involving spaces L ² and L ^s , with s>n/2 . Accepted 27 January 1997     

Weak maximum principle and accessory problem for control problems on time scales

In this paper we derive the first and second variations for a nonlinear time scale optimal control problem with control and state-endpoints equality constraints. Using the first variation, a first order necessary condition for weak local optimality is obtained under the form of a weak maximum principle generalizing the Dubois–Reymond Lemma to the optimal control setting and time scales. A second order necessary condition in terms of the accessory problem is derived by using the nonnegativity of the second variation at all admissible directions. The control problem is studied under a controllability assumption, and with or without the shift in the state variable. These two forms of the problem are shown to be equivalent.     

Optimality conditions for discrete optimal control problems with equality and inequality type of constraints

We consider nonlinear discrete optimal control problems with variable endpoints and with equality and inequality type of constraints on control. We derive new nontrivial first and second-order necessary optimality conditions.      

Necessary Optimality Conditions for Optimal Control Problems with Nonsmooth Mixed State and Control Constraints

In this paper we study an optimal control problem with nonsmooth mixed state and control constraints. In most of the existing results, the necessary optimality condition for optimal control problems with mixed state and control constraints are derived under the Mangasarian-Fromovitz condition and under the assumption that the state and control constraint functions are smooth. In this paper we derive necessary optimality conditions for problems with nonsmooth mixed state and control constraints under constraint qualifications based on pseudo-Lipschitz continuity and calmness of certain set-valued maps. The necessary conditions are stratified, in the sense that they are asserted on precisely the domain upon which the hypotheses (and the optimality) are assumed to hold. Moreover necessary optimality conditions with an Euler inclusion taking an explicit multiplier form are derived for certain cases.