Nonlinearly constrained time-delayed optimal control problems

A computational algorithm for solving a class of optimal control problems involving terminal and continuous state constraints of inequality type was developed in Ref. 1. In this paper, we extend the results of Ref. 1 to a more general class of constrained time-delayed optimal control problems, which involves terminal state equality constraints as well as terminal state inequality constraints and continuous state constraints. Two examples have been solved to illustrate the efficiency of the method.     

A feasible directions algorithm for time-lag optimal control problems with control and terminal inequality constraints

A computational algorithm for a class of time-lag optimal control problems involving control and terminal inequality constraints is presented. The convergence properties of the algorithm is also investigated. To test the algorithm, an example is solved.This work was partially supported by the Australian Research Grant Committee.     

Distributed computing viewed as a team problem with constraints

The optimal distribution of the workload in a system of interconnected computer units is considered. Formulated as a team decision problem with a singular cost criterion and with equality and inequality constraints, it is shown that the problem admits always a unique piecewise linear strategy which is globally optimal. Some interesting particular cases are studied.The research reported in this paper was made possible through support from the Office of Naval Research under the Joint Services Electronics Program by Contract No. N00014-75-C-0648 and Contract No. N00014-77-C-0531 and by the National Science Foundation, Grant No. ENG-76-11824.     

Necessary conditions for problems with higher derivative bounded state variables

This paper combines the separate works of two authors. Tan proves a set of necessary conditions for a control problem with second-order state inequality constraints (see Ref. 1). Russak proves necessary conditions for an extended version of that problem. Specifically, the extended version augments the original problem by including state equality constraints, differential and isopermetric equality and inequality constraints, and endpoint constraints. In addition, Russak (i) relaxes the solvability assumption on the state constraints, (ii) extends the maximum principle to a larger set, (iii) obtains modified forms of the relationH =H _t and of the transversality relation usually obtained in problems of this type, and (iv) proves a condition concerning (t ¹), the derivative of the multiplier functions at the final time.Russak's work was supported by a NPS Foundation Grant.Tan is indebted to his thesis advisor, Professor M. R. Hestenes, for suggesting the topic and for his help and guidance in the development of his work. Tan's work was supported by the Army Research Office, Contract No. DA-ARO-D-31-124-71-G18.     

An Exact Penalty Function Method for Continuous Inequality Constrained Optimal Control Problem

In this paper, we consider a class of optimal control problems subject to equality terminal state constraints and continuous state and control inequality constraints. By using the control parametrization technique and a time scaling transformation, the constrained optimal control problem is approximated by a sequence of optimal parameter selection problems with equality terminal state constraints and continuous state inequality constraints. Each of these constrained optimal parameter selection problems can be regarded as an optimization problem subject to equality constraints and continuous inequality constraints. On this basis, an exact penalty function method is used to devise a computational method to solve these optimization problems with equality constraints and continuous inequality constraints. The main idea is to augment the exact penalty function constructed from the equality constraints and continuous inequality constraints to the objective function, forming a new one. This gives rise to a sequence of unconstrained optimization problems. It is shown that, for sufficiently large penalty parameter value, any local minimizer of the unconstrained optimization problem is a local minimizer of the optimization problem with equality constraints and continuous inequality constraints. The convergent properties of the optimal parameter selection problems with equality constraints and continuous inequality constraints to the original optimal control problem are also discussed. For illustration, three examples are solved showing the effectiveness and applicability of the approach proposed.     

An exact penalty function algorithm for optimal control problems with control and terminal equality constraints,part 1

The presence of control constraints, because they are nondifferentiable in the space of control functions, makes it difficult to cope with terminal equality constraints in optimal control problems. Gradient-projection algorithms, for example, cannot be employed easily. These difficulties are overcome in this paper by employing an exact penalty function to handle the cost and terminal equality constraints and using the control constraints to define the space of permissible search directions in the search-direction subalgorithm. The search-direction subalgorithm is, therefore, more complex than the usual linear program employed in feasible-directions algorithms. The subalgorithm approximately solves a convex optimal control problem to determine the search direction; in the implementable version of the algorithm, the accuracy of the approximation is automatically increased to ensure convergence.This work was supported by the United Kingdom Science Research Council, by the US Army Research Office, Contract No. DAAG-29-73-C-0025, and by the National Science Foundation, Grant No. ENG-73-08214-A01.     

On unbounded solutions of Bellman's equation associated with optimal switching control problems with state constraints

We study a quasi-variational inequality system with unbounded solutions. It represents the Bellman equation associated with an optimal switching control problem with state constraints arising from production engineering. We show that the optimal cost is the unique viscosity solution of the system.This work was supported by the National Research Council of Argentina, Grant No. PID-BID 213.     

State constraints in the linear regulator problem: Case study

In this paper, we consider the problem of minimum-norm control of the double integrator with bilateral inequality constraints for the output. We approximate the constraints by piecewise linear functions and prove that the Langrange multipliers associated with the state constraints of the approximating problem are discrete measures, concentrated in at most two points in every interval of discretization. This allows us to reduce the problem to a convex finite-dimensional optimization problem. An algorithm based on this reduction is proposed and its convergence is examined. Numerical examples illustrate our approach. We also discuss regularity properties of the optimal control for a higher-dimensional state-constrained linear regulator problem.The first author was supported by the National Science Foundation, Grant No. DMS-9404431. The second author was supported by a François-Xavier Bagnoud Doctoral Fellowship and by NSF Grants DMS-9404431 and MSS-9114630.     

A unified framework for linear control problems with state-variable inequality constraints

This paper briefly reviews the literature on necessary optimality conditions for optimal control problems with state-variable inequality constraints. Then, it attempts to unify the treatment of linear optimal control problems with state-variable inequality constraints in the framework of continuous linear programming. The duality theory in this framework makes it possible to relate the adjoint variables arising in different formulations of a problem; these relationships are illustrated by the use of a simple example. This framework also allows more general problems and admits a simplex-like algorithm to solve these problems.This research was partially supported by Grant No. A4619 from the National Research Council of Canada to the first author. The first author also acknowledges the support provided by the Brookhaven National Laboratory, where he conducted his research.     

Optimality,stability, and convergence in nonlinear control

Sufficient optimality conditions for infinite-dimensional optimization problems are derived in a setting that is applicable to optimal control with endpoint constraints and with equality and inequality constraints on the controls. These conditions involve controllability of the system dynamics, independence of the gradients of active control constraints, and a relatively weak coercivity assumption for the integral cost functional. Under these hypotheses, we show that the solution to an optimal control problem is Lipschitz stable relative to problem perturbations. As an application of this stability result, we establish convergence results for the sequential quadratic programming algorithm and for penalty and multiplier approximations applied to optimal control problems.This research was supported by the U.S. Army Research Office under Contract. Number DAAL03-89-G-0082, by the National Science Foundation under Grant Number DMS 9404431, and by Air Force Office of Scientific Research under Grant Number AFOSR-88-0059. A. L. Dontchev is on leave from the Institute of Mathematics, Bulgarian Academy of Sciences, Sofia, Bulgaria.     

Sequential gradient-restoration algorithm for optimal control problems with general boundary conditions

This paper considers the numerical solution of two classes of optimal control problems, called Problem P1 and Problem P2 for easy identification.Problem P1 involves a functionalI subject to differential constraints and general boundary conditions. It consists of finding the statex(t), the controlu(t), and the parameter so that the functionalI is minimized, while the constraints and the boundary conditions are satisfied to a predetermined accuracy. Problem P2 extends Problem P1 to include nondifferential constraints to be satisfied everywhere along the interval of integration. Algorithms are developed for both Problem P1 and Problem P2.The approach taken is a sequence of two-phase cycles, composed of a gradient phase and a restoration phase. The gradient phase involves one iteration and is designed to decrease the value of the functional, while the constraints are satisfied to first order. The restoration phase involves one or more iterations and is designed to force constraint satisfaction to a predetermined accuracy, while the norm squared of the variations of the control, the parameter, and the missing components of the initial state is minimized.The principal property of both algorithms is that they produce a sequence of feasible suboptimal solutions: the functions obtained at the end of each cycle satisfy the constraints to a predetermined accuracy. Therefore, the values of the functionalI corresponding to any two elements of the sequence are comparable.The stepsize of the gradient phase is determined by a one-dimensional search on the augmented functionalJ, while the stepsize of the restoration phase is obtained by a one-dimensional search on the constraint errorP. The gradient stepsize and the restoration stepsize are chosen so that the restoration phase preserves the descent property of the gradient phase. Therefore, the value of the functionalI at the end of any complete gradient-restoration cycle is smaller than the value of the same functional at the beginning of that cycle.The algorithms presented here differ from those of Refs. 1 and 2, in that it is not required that the state vector be given at the initial point. Instead, the initial conditions can be absolutely general. In analogy with Refs. 1 and 2, the present algorithms are capable of handling general final conditions; therefore, they are suited for the solution of optimal control problems with general boundary conditions. Their importance lies in the fact that many optimal control problems involve initial conditions of the type considered here.Six numerical examples are presented in order to illustrate the performance of the algorithms associated with Problem P1 and Problem P2. The numerical results show the feasibility as well as the convergence characteristics of these algorithms.This research was supported by the Office of Scientific Research, Office of Aerospace Research, United States Air Force, Grant No. AF-AFOSR-76-3075. Partial support for S. Gonzalez was provided by CONACYT, Consejo Nacional de Ciencia y Tecnologia, Mexico City, Mexico.     

Optimization Techniques for Solving Elliptic Control Problems with Control and State Constraints: Part 1. Boundary Control

We study optimal control problems for semilinear elliptic equations subject to control and state inequality constraints. In a first part we consider boundary control problems with either Dirichlet or Neumann conditions. By introducing suitable discretization schemes, the control problem is transcribed into a nonlinear programming problem. It is shown that a recently developed interior point method is able to solve these problems even for high discretizations. Several numerical examples with Dirichlet and Neumann boundary conditions are provided that illustrate the performance of the algorithm for different types of controls including bang-bang and singular controls. The necessary conditions of optimality are checked numerically in the presence of active control and state constraints.     

An exact penalty function algorithm for optimal control problems with control and terminal equality constraints,part 2

In Part 1 of this paper, implementable and conceptual versions of an algorithm for optimal control problems with control constraints and terminal equality constraints were presented. It was shown that anyL accumulation points of control sequences generated by the algorithms satisfy necessary conditions of optimality. Since such accumulation points need not exist, it is shown in this paper that control sequences generated by the algorithms always have accumulation points in the sense of control measure, and these accumulation points satisfy optimality conditions for the corresponding relaxed control problem.This work was supported by the United Kingdom Science Research Council, by the US Army Research Office, Contract No. DAA-29-73-C-0025, and by the National Science Foundation, Grant No. ENG-73-08214-A01.     

Global State Space Approach for the Efficient Numerical Solution of State-Constrained Trajectory Optimization Problems

A new approach based on a global state space form is introduced for solving trajectory optimization problems with state inequality constraints via indirect methods. The use of minimal coordinates on a boundary arc of the state constraint eliminates severe problems, which occur for standard methods and are due to the appearance of differential-algebraic boundary-value problems. Together with a hybrid approach and a careful treatment of some interior-point conditions, we obtain an efficient and reliable solution method.     

Computational algorithm for a distributed optimal control problem of parabolic type with terminal inequality constraints

A computational algorithm for optimal control problems with control and terminal inequality constraints involving first boundary-value problems of parabolic type is presented. The convergence properties are also studied.This work, which was partly supported by the Australian Research Grants Committee, was done during the period when Z. S. Wu was an Honorary Visiting Fellow in the School of Mathematics at the University of New South Wales, Australia.     

Solving variational inequalities defined on a domain with infinitely many linear constraints

We study a variational inequality problem whose domain is defined by infinitely many linear inequalities. A discretization method and an analytic center based inexact cutting plane method are proposed. Under proper assumptions, the convergence results for both methods are given. We also provide numerical examples to illustrate the proposed methods. The work of S. Wu was partially supported by the National Science Council, Taiwan, ROC (Grant No. 19731001). S.-C. Fang’s research has been supported by the US Army Research Office (Grant No. W911NF-04-D-0003) and National Science Foundation (Grant No. DMI-0553310).     

Convex analysis treated by linear programming

The theme of this paper is the application of linear analysis to simplify and extend convex analysis. The central problem treated is the standard convex program — minimize a convex function subject to inequality constraints on other convex functions. The present approach uses the support planes of the constraint region to transform the convex program into an equivalent linear program. Then the duality theory of infinite linear programming shows how to construct a new dual program of bilinear type. When this dual program is transformed back into the convex function formulation it concerns the minimax of an unconstrained Lagrange function. This result is somewhat similar to the Kuhn—Tucker theorem. However, no constraint qualifications are needed and yet perfect duality maintains between the primal and dual programs.Work prepared under Research Grant DA-AROD-31-124-71-G17, Army Research Office (Durham).     

New Robust Model Predictive Control for Uncertain Systems with Input Constraints Using Relaxation Matrices

In this paper, we propose a new robust model predictive control (MPC) method for time-varying uncertain systems with input constraints. We formulate the problem as a minimization of the worst-case finite-horizon cost function subject to a new sufficient condition for cost monotonicity. The proposed MPC technique uses relaxation matrices to derive a less conservative terminal inequality condition. The relaxation matrices improve feasibility and system performance. The optimization problem is solved by semidefinite programming involving linear matrix inequalities (LMIs). A numerical example shows the effectiveness of the proposed method. The authors thank the associate editor and two anonymous referees for careful reading and useful suggestions.     

On certain optimization methods with finite-step inner algorithms for convex finite-dimensional problems with inequality constraints

Numerical methods are proposed for solving finite-dimensional convex problems with inequality constraints satisfying the Slater condition. A method based on solving the dual to the original regularized problem is proposed and justified for problems having a strictly uniformly convex sum of the objective function and the constraint functions. Conditions for the convergence of this method are derived, and convergence rate estimates are obtained for convergence with respect to the functional, convergence with respect to the argument to the set of optimizers, and convergence to the g-normal solution. For more general convex finite-dimensional minimization problems with inequality constraints, two methods with finite-step inner algorithms are proposed. The methods are based on the projected gradient and conditional gradient algorithms. The paper is focused on finite-dimensional problems obtained by approximating infinite-dimensional problems, in particular, optimal control problems for systems with lumped or distributed parameters.