Stochastic maximum principle for mean-field forward-backward stochastic control system with terminal state constraints

In this paper,we consider an optimal control problem with state constraints,where the control system is described by a mean-field forward-backward stochastic differential equation(MFFBSDE,for short)and the admissible control is mean-field type.Making full use of the backward stochastic differential equation theory,we transform the original control system into an equivalent backward form,i.e.,the equations in the control system are all backward.In addition,Ekeland’s variational principle helps us deal with the state constraints so that we get a stochastic maximum principle which characterizes the necessary condition of the optimal control.We also study a stochastic linear quadratic control problem with state constraints.     

Generalized Derivatives for the Solution Operator of the Obstacle Problem

We characterize generalized derivatives of the solution operator of the obstacle problem. This precise characterization requires the usage of the theory of so-called capacitary measures and the associated solution operators of relaxed Dirichlet problems. The generalized derivatives can be used to obtain a novel necessary optimality condition for the optimal control of the obstacle problem with control constraints. A comparison shows that this system is stronger than the known system of C-stationarity.

     

Weak maximum principle and accessory problem for control problems on time scales

In this paper we derive the first and second variations for a nonlinear time scale optimal control problem with control and state-endpoints equality constraints. Using the first variation, a first order necessary condition for weak local optimality is obtained under the form of a weak maximum principle generalizing the Dubois–Reymond Lemma to the optimal control setting and time scales. A second order necessary condition in terms of the accessory problem is derived by using the nonnegativity of the second variation at all admissible directions. The control problem is studied under a controllability assumption, and with or without the shift in the state variable. These two forms of the problem are shown to be equivalent.     

A Study on Abnormality in Variational and Optimal Control Problems

In this paper, a variational problem is considered with differential equality constraints over a variable interval. It is stressed that the abnormality is a local character of the admissible set; consequently, a definition of regularity related to the constraints characterizing the admissible set is given. Then, for the local minimum necessary conditions, a compact form equivalent to the well-known Euler equation and transversality condition is given. By exploiting this result and the previous definition of regularity, it is proved that nonregularity is a necessary and sufficient condition for an admissible solution to be an abnormal extremal. Then, a necessary and sufficient condition is given for an abnormal extremal to be weakly abnormal. The analysis of the abnormality is completed by considering the particular case of affine constraints over a fixed interval: in this case, the abnormality turns out to have a global character, so that it is possible to define an abnormal problem or a normal problem. The last section is devoted to the study of an optimal control problem characterized by differential constraints corresponding to the dynamics of a controlled process. The above general results are particularized to this problem, yielding a necessary and sufficient condition for an admissible solution to be an abnormal extremal. From this, a previously known result is recovered concerning the linearized system controllability as a sufficient condition to exclude the abnormality.     

A maximum principle for smooth optimal impulsive control problems with multipoint state constraints

A nonlinear optimal impulsive control problem with trajectories of bounded variation subject to intermediate state constraints at a finite number on nonfixed instants of time is considered. Features of this problem are discussed from the viewpoint of the extension of the classical optimal control problem with the corresponding state constraints. A necessary optimality condition is formulated in the form of a smooth maximum principle; thorough comments are given, a short proof is presented, and examples are discussed.     

Necessary Optimality Conditions for Optimal Control Problems with Nonsmooth Mixed State and Control Constraints

In this paper we study an optimal control problem with nonsmooth mixed state and control constraints. In most of the existing results, the necessary optimality condition for optimal control problems with mixed state and control constraints are derived under the Mangasarian-Fromovitz condition and under the assumption that the state and control constraint functions are smooth. In this paper we derive necessary optimality conditions for problems with nonsmooth mixed state and control constraints under constraint qualifications based on pseudo-Lipschitz continuity and calmness of certain set-valued maps. The necessary conditions are stratified, in the sense that they are asserted on precisely the domain upon which the hypotheses (and the optimality) are assumed to hold. Moreover necessary optimality conditions with an Euler inclusion taking an explicit multiplier form are derived for certain cases.     

State-constrained optimal control of the three-dimensional stationary Navier-Stokes equations

In this paper, an optimal control problem for the stationary Navier-Stokes equations in the presence of state constraints is investigated. Existence of optimal solutions is proved and first order necessary conditions are derived. The regularity of the adjoint state and the state constraint multiplier is also studied. Lipschitz stability of the optimal control, state and adjoint variables with respect to perturbations is proved and a second order sufficient optimality condition for the case of pointwise state constraints is stated.     

Some Properties of General Minimization Problems with Constraints

The paper studies the existence of solutions and necessary conditions of optimality for a general minimization problem with constraints. Although we focus mainly on the case where the cost functional is locally Lipschitz, a general Palais–Smale condition is proposed and some of its properties are studied. Applications to an optimal control problem and a Lagrange multiplier rule are also given.     

Maximum principle in the problem of time optimal response with nonsmooth constraints : PMM vol. 40, n 6, 1976, pp. 1014–1023

The problem of optimal response [1, 2] with nonsmooth (generally speaking, nonfunctional) constraints imposed on the state variables is considered. This problem is used to illustrate the method of proving the necessary conditions of optimality in the problems of optimal control with phase constraints, based on constructive approximation of the initial problem with constraints by a sequence of problems of optimal control with constraint-free state variables. The variational analysis of the approximating problems is carried out by means of a purely algebraic method involving the formulas for the incremental growth of a functional [3, 4] and the theorems of separability of convex sets is not used.Using a passage to the limit, the convergence of the approximating problems to the initial problem with constraints is proved, and for general assumptions the necessary conditions of optimality resembling the Pontriagin maximum principle [1] are derived for the generalized solutions of the initial problem. The conditions of transversality are expressed, in the case of nonsmooth (nonfunctional) constraints by a novel concept of a cone conjugate to an arbitrary closed set of a finite-dimensional space. The concept generalizes the usual notions of the normal and the normal cone for the cases of smooth and convex manifolds.     

On necessary optimality conditions for systems Governed by a two point boundary value problem. I

The paper concerns a necessary optimality condition in form of a Pontryagin Minimum Principle for a system governed by a linear two point boundary value problem with homogeneous Dibichlet conditions, whereby the control vector occurs in all coefficients of the differential equation. Without any convexity assumption the optimality condition is derived using a needle-like variation of the optimal control. In case of convex local control constraints the optimality condition implies the linearized minimum principle, which we have proved in [2]. An example shows that for this linearized optimality condition the convexity of the set of all admissible controls is essential.     

Real-Time Solution of Bi-Level Optimal Control Problems

Bi-level optimal control problems are presented as an extension to classical optimal control problems. Hereby, additional constraints for the primary problem are considered, which depend on the optimal solution of a secondary optimal control problem. A demanding problem is the numerical complexity, since at any point in time the solution of the optimal control problem as well as a complete solution of the secondary problem have to be determined. Hence we deal with two dependent variables in time. The numerical solution of the bi-level problem is illustrated by an application of a container crane. Jerk and energy optimal trajectories with free final time are calculated under the terminal condition that the crane system comes to be at rest at a predefined location. In enlargement additional constraints are investigated to ensure that the crane system can be brought to a rest position by a safety stop at a free but admissible location in minimal time from any state of the trajectory. (© 2005 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Optimal Control Problems for Elliptic–Parabolic Variational Inequalities with Time-Dependent Constraints

In this paper, we study optimal control problems for quasi-linear elliptic–parabolic variational inequalities with time-dependent constraints. We prove the existence of an optimal control that minimizes the nonlinear cost functional. Moreover, we apply our general results to some model problems. In particular, we show the necessary condition of optimal pair for a problem of partial differential equation (PDE) with a non-homogeneous Dirichlet boundary condition.     

Normality of the maximum principle for nonconvex constrained Bolza problems

We consider a Bolza optimal control problem with state constraints. It is well known that under some technical assumptions every strong local minimizer of this problem satisfies first order necessary optimality conditions in the form of a constrained maximum principle. In general, the maximum principle may be abnormal or even degenerate and so does not provide a sufficient information about optimal controls. In the recent literature some sufficient conditions were proposed to guarantee that at least one maximum principle is nondegenerate, cf. [A.V. Arutyanov, S.M. Aseev, Investigation of the degeneracy phenomenon of the maximum principle for optimal control problems with state constraints, SIAM J. Control Optim. 35 (1997) 930–952; F. Rampazzo, R.B. Vinter, A theorem on existence of neighbouring trajectories satisfying a state constraint, with applications to optimal control, IMA 16 (4) (1999) 335–351; F. Rampazzo, R.B. Vinter, Degenerate optimal control problems with state constraints, SIAM J. Control Optim. 39 (4) (2000) 989–1007]. Our aim is to show that actually conditions of a similar nature guarantee normality of every nondegenerate maximum principle. In particular we allow the initial condition to be fixed and the state constraints to be nonsmooth. To prove normality we use J. Yorke type linearization of control systems and show the existence of a solution to a linearized control system satisfying new state constraints defined, in turn, by linearization of the original set of constraints along an extremal trajectory.     

Transversality condition for infinite-horizon problems

We present necessary conditions of optimality for an infinitehorizon optimal control problem. The transversality condition is derived with the help of stability theory and is formulated in terms of the Lyapunov exponents of solutions to the adjoint equation. A problem without an exponential factor in the integral functional is considered. Necessary and sufficient conditions of optimality are proved for linear quadratic problems with conelike control constraints.     

Second-Order Analysis for Control Constrained Optimal Control Problems of Semilinear Elliptic Systems

This paper presents a second-order analysis for a simple model optimal control problem of a partial differential equation, namely, a well-posed semilinear elliptic system with constraints on the control variable only. The cost to be minimized is a standard quadratic functional. Assuming the feasible set to be polyhedric, we state necessary and sufficient second-order optimality conditions, including a characterization of the quadratic growth condition. Assuming that the second-order sufficient condition holds, we give a formula for the second-order expansion of the value of the problem as well as the directional derivative of the optimal control, when the cost function is perturbed. Then we extend the theory of second-order optimality conditions to the case of vector-valued controls when the feasible set is defined by local and smooth convex constraints. When the space dimension n is greater than 3, the results are based on a two norms approach, involving spaces L ² and L ^s , with s>n/2 . Accepted 27 January 1997     

Lipschitzianity of optimal trajectories for the Bolza optimal control problem

In this paper we investigate Lipschitz continuity of optimal solutions for the Bolza optimal control problem under Tonelli’s type growth condition. Such regularity being a consequence of normal necessary conditions for optimality, we propose new sufficient conditions for normality of state-constrained nonsmooth maximum principles for absolutely continuous optimal trajectories. Furthermore we show that for unconstrained problems any minimizing sequence of controls can be slightly modified to get a new minimizing sequence with nice boundedness properties. Finally, we provide a sufficient condition for Lipschitzianity of optimal trajectories for Bolza optimal control problems with end point constraints and extend a result from (J. Math. Anal. Appl. 143, 301–316, 1989) on Lipschitzianity of minimizers for a classical problem of the calculus of variations with discontinuous Lagrangian to the nonautonomous case.     

Investigation of regularity conditions in optimal control problems with geometric mixed constraints

We investigate regularity conditions in optimal control problems with mixed constraints of a general geometric type, in which a closed non-convex constraint set appears. A closely related question to this issue concerns the derivation of necessary optimality conditions under some regularity conditions on the constraints. By imposing strong and weak regularity condition on the constraints, we provide necessary optimality conditions in the form of Pontryagin maximum principle for the control problem with mixed constraints. The optimality conditions obtained here turn out to be more general than earlier results even in the case when the constraint set is convex. The proofs of our main results are based on a series of technical lemmas which are gathered in the Appendix.     

First and Second Order Necessary Conditions for Stochastic Optimal Control Problems

In this work we consider a stochastic optimal control problem with either convex control constraints or finitely many equality and inequality constraints over the final state. Using the variational approach, we are able to obtain first and second order expansions for the state and cost function, around a local minimum. This fact allows us to prove general first order necessary condition and, under a geometrical assumption over the constraint set, second order necessary conditions are also established. We end by giving second order optimality conditions for problems with constraints on expectations of the final state.     

双值约束非凸三次规化问题的全局最优性条件

考虑一类带有双值约束的非凸三次优化问题, 给出了该问题的一个全局最优充分必要条件. 结果改进并推广了一些文献中所给出的全局最优性条件, 同时还通过数值例子来说明所给出的全局最优充要条件是易验证的.