Semiconcavity results for optimal control problems admitting no singular minimizing controls

Semiconcavity results have generally been obtained for optimal control problems in absence of state constraints. In this paper, we prove the semiconcavity of the value function of an optimal control problem with end-point constraints for which all minimizing controls are supposed to be nonsingular.     

A virtual control concept for state constrained optimal control problems

A linear elliptic control problem with pointwise state constraints is considered. These constraints are given in the domain. In contrast to this, the control acts only at the boundary. We propose a general concept using virtual control in this paper. The virtual control is introduced in objective, state equation, and constraints. Moreover, additional control constraints for the virtual control are investigated. An error estimate for the regularization error is derived as main result of the paper. The theory is illustrated by numerical tests.     

State constrained optimal control problems with time delays

In a recent, related, paper, necessary conditions in the form of a Maximum Principle were derived for optimal control problems with time delays in both state and control variables. Different versions of the necessary conditions covered fixed end-time problems and, under additional hypotheses, free end-time problems. These conditions improved on previous conditions in the following respects. They provided the first fully non-smooth Pontryagin Maximum Principle for problems involving delays in both state and control variables, only special cases of which were previously available. They provide a strong version of the Weierstrass condition for general problems with possibly non-commensurate control delays, whereas the earlier literature does so only under structural assumptions about the dynamic constraint. They also provided a new ‘two-sided’ generalized transversality condition, associated with the optimal end-time. This paper provides an extension of the Pontryagin Maximum Principle of the earlier paper for time delay systems, to allow for the presence of a unilateral state constraint. The new results fully recover the necessary conditions of the earlier paper when the state constraint is absent, and therefore retain all their advantages but in a setting of greater generality.     

Nonlinearly constrained time-delayed optimal control problems

A computational algorithm for solving a class of optimal control problems involving terminal and continuous state constraints of inequality type was developed in Ref. 1. In this paper, we extend the results of Ref. 1 to a more general class of constrained time-delayed optimal control problems, which involves terminal state equality constraints as well as terminal state inequality constraints and continuous state constraints. Two examples have been solved to illustrate the efficiency of the method.     

Differential sensitivity of solutions of convex constrained optimal control problems for discrete systems

A family of optimal control problems for discrete systems that depend on a real parameter is considered. The problems are strongly convex and subject to state and control constraints. Some regularity conditions are imposed on the constraints.The control problems are reformulated as mathematical programming problems. It is shown that both the primal and dual optimal variables for these problems are right-differentiable functions of a parameter. The right-derivatives are characterized as solutions to auxiliary quadratic control problems. Conditions of continuous differentiability are discussed, and some estimates of the rate of convergence of the difference quotients to the respective derivatives are given.     

Mixed constrained control problems

Necessary optimality conditions are derived in the form of a weak maximum principle for optimal control problems with mixed state-control equality and inequality constraints. In contrast to previous work these conditions hold when the Jacobian of the active constraints, with respect to the unconstrained control variable, has full rank. A feature of these conditions is that they are stated in terms of a joint Clarke subdifferential. Furthermore the use of the joint subdifferential gives sufficiency for nonsmooth, normal, linear convex problems. The main point of interest is not only the full rank condition assumption but also the nature of the analysis employed in this paper. A key element is the removal of the constraints and application of Ekeland's variational principle.     

The Lagrange-Newton method for state constrained optimal control problems

Local convergence of the Lagrange-Newton method for optimization problems with two-norm discrepancy in abstract Banach spaces is investigated. Based on stability analysis of optimization problems with two-norm discrepancy, sufficient conditions for local superlinear convergence are derived. The abstract results are applied to optimal control problems for nonlinear ordinary differential equations subject to control and state constraints.This research was completed while the second author was a visitor at the University of Bayreuth, Germany, supported by grant No. CIPA3510CT920789 from the Commission of the European Communities.     

A solution method for regular optimal control problems with state constraints

A method of region analysis is developed for solving a class of optimal control problems with one state and one control variable, including state and control constraints. The performance index is strictly convex with respect to the control variable, while this variable appears only linearly in the state equation. The convexity or linearity assumption of the performance index or the state equation with respect to the state variable is not required.The author would like to express his sincere gratitude to Prof. R. Klötzler, Prof. E. Zeidler, Prof. H. Schumann, Prof. J. Focke, and other colleagues of the Department of Mathematics, Karl Marx University, Leipzig, GDR, for their support during his stay in Leipzig.     

B‐spline spectral method for constrained fractional optimal control problems

In this paper, we present a direct B‐spline spectral collocation method to approximate the solutions of fractional optimal control problems with inequality constraints. We use the location of the maximum of B‐spline functions as collocation points, which leads to sparse and nonsingular matrix B whose entries are the values of B‐spline functions at the collocation points. In this method, both the control and Caputo fractional derivative of the state are approximated by B‐spline functions. The fractional integral of these functions is computed by the Cox‐de Boor recursion formula. The convergence of the method is investigated. Several numerical examples are considered to indicate the efficiency of the method.     

Dynamic programming for some optimal control problems with hysteresis

We study an infinite horizon optimal control problem for a system with two state variables. One of them has the evolution governed by a controlled ordinary differential equation and the other one is related to the latter by a hysteresis relation, represented here by either a play operator or a Prandtl-Ishlinskii operator. By dynamic programming, we derive the corresponding (discontinuous) first order Hamilton-Jacobi equation, which in the first case is of finite dimension and in the second case is of infinite dimension. In both cases we prove that the value function is the only bounded uniformly continuous viscosity solution of the equation.     

SQP-methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis and real-time control

Parametric nonlinear optimal control problems subject to control and state constraints are studied. Two discretization methods are discussed that transcribe optimal control problems into nonlinear programming problems for which SQP-methods provide efficient solution methods. It is shown that SQP-methods can be used also for a check of second-order sufficient conditions and for a postoptimal calculation of adjoint variables. In addition, SQP-methods lead to a robust computation of sensitivity differentials of optimal solutions with respect to perturbation parameters. Numerical sensitivity analysis is the basis for real-time control approximations of perturbed solutions which are obtained by evaluating a first-order Taylor expansion with respect to the parameter. The proposed numerical methods are illustrated by the optimal control of a low-thrust satellite transfer to geosynchronous orbit and a complex control problem from aquanautics. The examples illustrate the robustness, accuracy and efficiency of the proposed numerical algorithms.     

Convergent computational method for relaxed optimal control problems

A class of relaxed optimal control problems for ordinary differential equations with a state-space constraint is considered. The discretization by the control parametrization method, formerly proposed by Teo and Goh (Refs. 1, 2), is modified by admitting a tolerance in the state constraint, which enables one to prove a conditional convergence under certain additional qualification on the dynamics. Also, a counterexample is constructed, showing that the original, nonmodified discretization need not approximate the continuous problem.The author is grateful to Professor K. L. Teo for useful comments on this paper.     

Rationalized Haar approach for nonlinear constrained optimal control problems

This paper presents a numerical method for solving nonlinear optimal control problems including state and control inequality constraints. The method is based upon rationalized Haar functions. The differential and integral expressions which arise in the system dynamics, the performance index and the boundary conditions are converted into some algebraic equations which can be solved for the unknown coefficients. Illustrative examples are included to demonstrate the validity and applicability of the technique.     

An optimal algorithm for a class of equality constrained quadratic programming problems with bounded spectrum

The implementation of the recently proposed semi-monotonic augmented Lagrangian algorithm for the solution of large convex equality constrained quadratic programming problems is considered. It is proved that if the auxiliary problems are approximately solved by the conjugate gradient method, then the algorithm finds an approximate solution of the class of problems with uniformly bounded spectrum of the Hessian matrix at O(1) matrix–vector multiplications. If applied to the class of problems with the Hessian matrices that are in addition either sufficiently sparse or can be expressed as a product of such sparse matrices, then the cost of the solution is proportional to the dimension of the problems. Theoretical results are illustrated by numerical experiments. This research is supported by grants of the Ministry of Education No. S3086102, ET400300415 and MSM 6198910027.     

The Euler approximation in state constrained optimal control

We analyze the Euler approximation to a state constrained control problem. We show that if the active constraints satisfy an independence condition and the Lagrangian satisfies a coercivity condition, then locally there exists a solution to the Euler discretization, and the error is bounded by a constant times the mesh size. The proof couples recent stability results for state constrained control problems with results established here on discrete-time regularity. The analysis utilizes mappings of the discrete variables into continuous spaces where classical finite element estimates can be invoked.

     

Numerical solution of minimax optimal control problems by multiple shooting technique

This paper presents the application of the multiple shooting technique to minimax optimal control problems (optimal control problems with Chebyshev performance index). A standard transformation is used to convert the minimax problem into an equivalent optimal control problem with state variable inequality constraints. Using this technique, the highly developed theory on the necessary conditions for state-restricted optimal control problems can be applied advantageously. It is shown that, in general, these necessary conditions lead to a boundary-value problem with switching conditions, which can be treated numerically by a special version of the multiple shooting algorithm. The method is tested on the problem of the optimal heating and cooling of a house. This application shows some typical difficulties arising with minimax optimal control problems, i.e., the estimation of the switching structure which is dependent on the parameters of the problem. This difficulty can be overcome by a careful application of a continuity method. Numerical solutions for the example are presented which demonstrate the efficiency of the method proposed.     

Coexistence and optimal control problems for a degenerate predator-prey model

In this paper we present a predator-prey mathematical model for two biological populations which dislike crowding. The model consists of a system of two degenerate parabolic equations with nonlocal terms and drifts. We provide conditions on the system ensuring the periodic coexistence, namely the existence of two non-trivial non-negative periodic solutions representing the densities of the two populations. We assume that the predator species is harvested if its density exceeds a given threshold. A minimization problem for a cost functional associated with this process and with some other significant parameters of the model is also considered.     

Error bounds for euler approximation of a state and control constrained optimal control problem 1

We examine convergence of the Euler approximation to a nonlinear optimal control problem subject to mixed state-control and pure state constraints. We prove that under smoothness, independence, controllability and coercivity conditions at a reference solution of the continuous problem, there exists a locally unique solution to the Euler approximation, for sufficiently fine discretization, which converges to the reference solution with rate proportional to the mesh size.     

On optimal control problems with state constraints

This paper is concerned with necessary conditions for a general optimal control problem developed by Russak and Tan. It is shown that, in most cases, a further relation between the multipliers holds. This result is of interest in particular for the investigation of perturbations of the state constraint.     

The existence results for optimal control problems governed by a variational inequality

In this paper, we establish the existence of the optimal control for an optimal control problem where the state of the system is defined by a variational inequality problem with monotone type mappings. Moreover, as an application, we get several existence results of an optimal control for the optimal control problem where the system is defined by a quasilinear elliptic variational inequality problem with an obstacle.