Infinite-horizon periodic minimax control problem

This note analyzes a minimax optimal control problem involving a periodic discrete-time system. The functional to be minimized is the maximum value of the sum over a period of the costs incurred by the system. A dynamic programming algorithm is proposed for the solution.     

Portfolio optimization with uncertain exit time in infinite-time horizon

In this paper, we study infinite-period mean-variance formulations for portfolio selections with an uncertain exit time. We employ the convergence control method together with the dynamic programming algorithm to derive analytical expressions for the optimal portfolio policy and the mean-variance efficient frontier under certain conditions. We illustrate these results by an numerical example.     

Numerical solution of minimax problems of optimal control,part 2

In a previous paper (Part 1), we presented general transformation techniques useful to convert minimax problems of optimal control into the Mayer-Bolza problem of the calculus of variations [Problem (P)]. We considered two types of minimax problems: minimax problems of Type (Q), in which the minimax function depends on the state and does not depend on the control; and minimax problems of Type (R), in which the minimax function depends on both the state and the control. Both Problem (Q) and Problem (R) can be reduced to Problem (P).In this paper, the transformation techniques presented in Part 1 are employed in conjunction with the sequential gradient-restoration algorithm for solving optimal control problems on a digital computer. Both the single-subarc approach and the multiple-subarc approach are employed. Three test problems characterized by known analytical solutions are solved numerically.It is found that the combination of transformation techniques and sequential gradient-restoration algorithm yields numerical solutions which are quite close to the analytical solutions from the point of view of the minimax performance index. The relative differences between the numerical values and the analytical values of the minimax performance index are of order 10^–3 if the single-subarc approach is employed. These relative differences are of order 10^–4 or better if the multiple-subarc approach is employed.This research was supported by the National Science Foundation, Grant No. ENG-79-18667, and by Wright-Patterson Air Force Base, Contract No. F33615-80-C3000. This paper is a condensation of the investigations reported in Refs. 1–7. The authors are indebted to E. M. Coker and E. M. Sims for analytical and computational assistance.     

Numerical solution of minimax problems of optimal control,part 1

This paper contains general transformation techniques useful to convert minimax problems of optimal control into the Mayer-Bolza problem of the calculus of variations [Problem (P)]. We consider two types of minimax problems: minimax problems of Type (Q), in which the minimax function depends on the state and does not depend on the control; and minimax problems of Type (R), in which the minimax function depends on both the state and the control. Both Problem (Q) and Problem (R) can be reduced to Problem (P).For Problem (Q), we exploit the analogy with a bounded-state problem in combination with a transformation of the Jacobson type. This requires the proper augmentation of the state vectorx(t), the control vectoru(t), and the parameter vector , as well as the proper augmentation of the constraining relations. As a result of the transformation, the unknown minimax value of the performance index becomes a component of the parameter vector being optimized.For Problem (R), we exploit the analogy with a bounded-control problem in combination with a transformation of the Valentine type. This requires the proper augmentation of the control vectoru(t) and the parameter vector , as well as the proper augmentation of the constraining relations. As a result of the transformation, the unknown minimax value of the performance index becomes a component of the parameter vector being optimized.In a subsequent paper (Part 2), the transformation techniques presented here are employed in conjunction with the sequential gradient-restoration algorithm for solving optimal control problems on a digital computer; both the single-subarc approach and the multiple-subarc approach are discussed.This research was supported by the National Science Foundation, Grant No. ENG-79-18667, and by Wright-Patterson Air Force Base, Contract No. F33615-80-C3000. This paper is a condensation of the investigations reported in Refs. 1–7. The authors are indebted to E. M. Coker and E. M. Sims for analytical and computational assistance.     

A minimax optimal control problem

A control system x=f(t,x,u) is considered, and a cost functional ess supT ₀tT ₁ G(t, x(t),u(t)) is to be minimized. Necessary conditions for optimality (maximum principle and transversality conditions) are derived. It is also shown that an optimal control is optimal for the corresponding problem on a subinterval of [T ₀,T ₁], if a certain controllability condition is satisfied.     

Constructive method for solving a linear minimax problem of optimal control

In this paper, we propose a constructive method for solving a linear minimax problem of optimal control. Following the Gabasov-Kirillova approach, we introduce the concept of so-called support control. After establishing an optimality criterion for the support control, we describe a scheme for reducing the initial infinite-dimensional problem to a finite-dimensional one, which can be solved numerically by the methods of linear programming. At the end, we give an illustrative example.     

Algorithms for the solution of stochastic dynamic minimax problems

In this paper, we present algorithms for the solution of the dynamic minimax problem in stochastic programs. This dynamic minimax approach is suggested for the analysis of multi-stage stochastic decision problems when there is only partial knowledge on the joint probability distribution of the random data. The algorithms proposed in this paper are based on projected sub-gradient and bundle methods.

---

Résumé Dans cet article, nous proposons des algorithmes pour la solution du problème du minimax dynamique stochastique. Ce problème se présente par exemple lorsque, dans un problème de décision dynamique stochastique, l'information disponible au sujet des distributions de probabilité des paramètres est incomplète. Les algorithmes proposés sont fondés sur la méthode de sous-gradient projeté et la méthode des faisceaux.

     

On the optimality equation for average cost Markov control processes with Feller transition probabilities

We consider Markov control processes with Borel state space and Feller transition probabilities, satisfying some generalized geometric ergodicity conditions. We provide a new theorem on the existence of a solution to the average cost optimality equation.     

Numerical solution of minimax optimal control problems by multiple shooting technique

This paper presents the application of the multiple shooting technique to minimax optimal control problems (optimal control problems with Chebyshev performance index). A standard transformation is used to convert the minimax problem into an equivalent optimal control problem with state variable inequality constraints. Using this technique, the highly developed theory on the necessary conditions for state-restricted optimal control problems can be applied advantageously. It is shown that, in general, these necessary conditions lead to a boundary-value problem with switching conditions, which can be treated numerically by a special version of the multiple shooting algorithm. The method is tested on the problem of the optimal heating and cooling of a house. This application shows some typical difficulties arising with minimax optimal control problems, i.e., the estimation of the switching structure which is dependent on the parameters of the problem. This difficulty can be overcome by a careful application of a continuity method. Numerical solutions for the example are presented which demonstrate the efficiency of the method proposed.     

A dual dynamic programming for minimax optimal control problems governed by parabolic equation

In the article, minimax optimal control problems governed by parabolic equations are considered. We apply a new dual dynamic programming approach to derive sufficient optimality conditions for such problems. The idea is to move all the notions from a state space to a dual space and to obtain a new verification theorem providing the conditions, which should be satisfied by a solution of the dual partial differential equation of dynamic programming. We also give sufficient optimality conditions for the existence of an optimal dual feedback control and some approximation of the problem considered, which seems to be very useful from a practical point of view.     

Higher-order duality for nondifferentiable minimax programming problem with generalized convexity

In this paper, we are concerned with a class of nondifferentiable minimax programming problems and its two types of higher-order dual models. We establish weak, strong and strict converse duality theorems in the framework of generalized convexity in order to relate the optimal solutions of primal and dual problems. Our study improves and extends some of the known results in the literature.     

Effective Information for Offline Stochastic Feedback and Optimal Control of Dynamic Systems

The impact of uncertain future events on decision making in a stochastic environment is modeled in this paper. Such modeling is presented for both feedback and optimal control problems. This research overcomes the difficulties of forecasting that arise when considering future information. In this paper, we seek to find the minimum amount of information (effective information) necessary to evaluating system performance offline or to optimally control a system. The existence of effective information is proved and a methodology for determining it is developed. It is also shown that ignoring information beyond the planning horizon leads to significant performance loss and may even lead to violating the constraints of a control problem.     

A multi-parametric programming approach for multilevel hierarchical and decentralised optimisation problems

In this paper, we outline the foundations of a general global optimisation strategy for the solution of multilevel hierarchical and general decentralised multilevel problems, based on our recent developments on multi-parametric programming and control theory. The core idea is to recast each optimisation subproblem, present in the hierarchy, as a multi-parametric programming problem, with parameters being the optimisation variables belonging to the remaining subproblems. This then transforms the multilevel problem into single-level linear/convex optimisation problems. For decentralised systems, where more than one optimisation problem is present at each level of the hierarchy, Nash equilibrium is considered. A three person dynamic optimisation problem is presented to illustrate the mathematical developments.     

Control synthesis for discrete time systems with control and state bounds in the presence of disturbances

The problem of control in the presence of unknown but limited disturbance for a discrete-time linear system with polyhedral input and state bounds is investigated. Two problems are considered: that of reaching an assigned target set in the state space; and that of keeping the state in a given region using the available controls. In both cases, a solution is given via linear programming. A computational procedure for the control synthesis is proposed which can be implemented to obtain a feedback control.The author thanks Professor G. Leitmann for his helpful suggestions.     

Static output feedback and guaranteed cost control of a class of discrete-time nonlinear systems with partial state measurements

In this paper both the static output feedback issue and the observer-based control of a class of discrete-time nonlinear systems are considered. Thanks to a newly developed linearization lemma, it is shown that the solution of the discrete-time output feedback problem is conditioned by a set of simple convex optimization conditions that are numerically tractable and free from any equality constraint. An illustrative example is provided to show the usefulness of the proposed control designs.     

Optimality conditions for nondifferentiable minimax fractional programming with complex variables

We show that a minimax fractional programming problem is equivalent to a minimax nonfractional parametric problem for a given parameter in complex space. We establish the necessary and sufficient optimality conditions of nondifferentiable minimax fractional programming problem with complex variables under generalized convexities.     

Efficient dynamic programming implementations of Newton's method for unconstrained optimal control problems

Naive implementations of Newton's method for unconstrainedN-stage discrete-time optimal control problems with Bolza objective functions tend to increase in cost likeN ³ asN increases. However, if the inherent recursive structure of the Bolza problem is properly exploited, the cost of computing a Newton step will increase only linearly withN. The efficient Newton implementation scheme proposed here is similar to Mayne's DDP (differential dynamic programming) method but produces the Newton step exactly, even when the dynamical equations are nonlinear. The proposed scheme is also related to a Riccati treatment of the linear, two-point boundary-value problems that characterize optimal solutions. For discrete-time problems, the dynamic programming approach and the Riccati substitution differ in an interesting way; however, these differences essentially vanish in the continuous-time limit.This work was supported by the National Science Foundation, Grant No. DMS-85-03746.     

Optimal control synthesis in therapy of solid tumor growth

A mathematical model of tumor growth therapy is considered. The total amount of a drug is bounded and fixed. The problem is to choose an optimal therapeutic strategy, i.e., to choose an amount of the drug permanently affecting the tumor that minimizes the number of tumor cells by a given time. The problem is solved by the dynamic programming method. Exact and approximate solutions to the corresponding Hamilton-Jacobi-Bellman equation are found. An error estimate is proved. Numerical results are presented.     

Numerical solution of positive control problem via linear programming

The reachability problem for linear time-invariant discrete-time control systems with sign-restricted input is considered. The time-optimal control is constructed by an iterative procedure. Each step of the iteration is defined as a linear programming problem. This problem is solved by the simplex algorithm. The initial feasible solution for the simplex algorithm is provided by the preceding step of the iteration. The inversion of the basis matrix is reduced to a bordering procedure. The structural stability of the solution is investigated.     

Necessary optimality conditions for minimax programming problems with mathematical constraints

In this paper, necessary optimality conditions in terms of upper and/or lower subdifferentials of both cost and constraint functions are derived for minimax optimization problems with inequality, equality and geometric constraints in the setting of non-differentiatiable and non-Lipschitz functions in Asplund spaces. Necessary optimality conditions in the fuzzy form are also presented. An application of the fuzzy necessary optimality condition is shown by considering minimax fractional programming problem.