Finding candidate singular optimal controls: A state of the art survey

Pontryagin's maximum principle gives no information about a singular optimal control if the problem is linear. This survey shows how candidate singular optimal controls may be found for linear and nonlinear problems. A theorem is given on the maximum order of a linear singular problem.This paper is based in part on the research undertaken by the author at the Hatfield Polytechnic, Hatfield, Hertfordshire, England, for the Ph.D. Degree.     

On Necessary Optimality Conditions for Singular Controls in Dynamical Systems with a Delay in Control

Abstract

In this article, an optimal control problem with a delay in control is considered. The second-order necessary condition is obtained for the optimality of singular (in the sense of the maximum principle) control. Also, the notion of degenerate singular control of order k (k?≥?1) is introduced and for optimality of this, the high-order necessary condition is obtained. Moreover, while studying the problem, one of the strengthened version of an analog of the maximum principle is shown. Finally, the rich content of the obtained results is illustrated by specific examples.     

Banach空间中非光滑指标奇异最优控制

本文对于Ｂａｎａｃｈ空间中分布参数系统讨论非光滑指标奇异最优控制问题，利用Ｍｏｏｒｓ－Ｐｅｎｒｏｓｅ广义逆与Ｃｌａｒｋｅ广义梯度证得奇异最优控制的存在性，并给出广义一阶必要条件，推广了Ｌｉｏｎｓ［３］的相应结果．     

Singular mean-field control games

This article studies singular mean field control problems and singular mean field two-players stochastic differential games. Both sufficient and necessary conditions for the optimal controls and for the Nash equilibrium are obtained. Under some assumptions the optimality conditions for singular mean-field control are reduced to a reflected Skorohod problem, whose solution is proved to exist uniquely. Motivations are given as optimal harvesting of stochastic mean-field systems, optimal irreversible investments under uncertainty and mean-field singular investment games. In particular, a simple singular mean-field investment game is studied, where the Nash equilibrium exists but is not unique.     

Riccati equations for generalized singular estimate control systems

We consider the Bolza problem associated with boundary/point control systems governed by strongly continuous semigroups. In continuation of our work in Lasiecka and Tuffaha [I. Lasiecka and A. Tuffaha, Riccati equations for the Bolza problem arising in boundary/point control problems governed by C ₀–semigroups satisfying a singular estimate, J. Optim. Theory Appl. 136 (2008), pp. 229–246; I. Lasiecka and A. Tuffaha, A Bolza optimal synthesis problem for singular estimate control systems, Control Cybernet 38(4B) (2009), pp. 1429–1460], we yet extend the theory to a more general class of control problems that are not analytic providing sharp blow-up rates for the regularity. Solvability of the associated Riccati equations and an optimal feedback synthesis are established. The presence of unbounded control actions, such as boundary/point controls, naturally lead to a singularity at the terminal point t?=?T of the optimal control and of the corresponding feedback operator as before. The class of control systems considered in this article is a generalization to the class usually referred to in the literature as ‘Singular Estimate Control Systems’. The prototype is still that of a PDE system consisting of coupled hyperbolic parabolic dynamics interacting on an interface with point/boundary control. The distinct feature of the class considered in this article is that the degree of unboundedness in the control is stronger than that allowed in the usual singular estimate control system configuration, giving rise to less regular optimal state trajectories.     

Equivalent models for finite-fuel stochastic control

A stochastic control problem with finite-fuel constraint, of the type studied by Bene?, Shepp and Witsenhausen (1980), is solved explicitly. It is shown to be reducible to “simpler” stochastic optimization problems, such as optimal stopping and singular control for Brownian motion with unlimited fuel.     

Second-order optimality principle for singular optimal control problems

Recently published results of Gift (Ref. 1) are concerned with the necessary conditions for singular optimal control problems (in the sense of Pontryagin's minimum principle). However, those results are incorrect. An illustrative counterexample is given here.This paper was written while the author studied at Fudan University. The author wishes to thank Professor X. J. Li for his guidance and encouragement. The research was partially supported by NSF of China and the Chinese State Education Commission NSF.     

Second order optimality conditions for a class of control problems governed by non-linear integral equations with application to parabolic boundary control

In the paper necessary and sufficient second order optimality conditions for optimal control problems governed by weakly singular non linear Hammerstein integral equations are derived. They are applied to a semilinear parabolic boundary control problem for the one dimensional heat equation.     

A variational problem determined by probability measures

ABSTRACT

An optimization problem of maximizing an integral of a function over a family of probability measures is considered. The problem is a generalization of a well-studied variational problem in mathematical economics, concerning optimal allocations. The specific generalization that we examine arises also in the limit of singularly perturbed optimal control problems. We examine the mathematical problem and allude to the singular perturbation motivation.     

A unified approach to portfolio optimization with linear transaction costs

In this paper we study the continuous time optimal portfolio selection problem for an investor with a finite horizon who maximizes expected utility of terminal wealth and faces transaction costs in the capital market. It is well known that, depending on a particular structure of transaction costs, such a problem is formulated and solved within either stochastic singular control or stochastic impulse control framework. In this paper we propose a unified framework, which generalizes the contemporary approaches and is capable to deal with any problem where transaction costs are a linear/piecewise-linear function of the volume of trade. We also discuss some methods for solving numerically the problem within our unified framework.     

Bounds for the additional cost of near-optimal controls

Near-optimal controls are considered for singular problems with a constrained control. These controls result in a higher cost than the optimal cost. Bounds for the additional cost are derived for problems with fixed terminal time or free terminal time and for minimal time problems. An illustrative example is solved of an optimal evasive control of an aircraft against a homing missile.     

带停时的奇异型随机控制问题在金融投资模型中的应用

以随机分析的知识和最优控制理论为基础,讨论了一类带停时的奇异型随机控制的折扣费用问题在金融投资模型中的应用,将该带停时的奇异型随机控制模型的受控状态过程和费用函数结构都推广到了最一般的形式,使该模型的应用范围更加广泛.通过讨论一组相应的变分不等式的解,分别对退化和非退化两种情况给出了此随机控制问题的最优策略,相应得出了投资模型中的最佳决策,并且证明了变分不等式的解即为最优费用函数.与以往不同的是,所得的相关结论应用到了金融投资模型中,从而解决了一类金融投资问题.     

Approximate Solution of Optimization Problems for Infinite-Dimensional Singular Systems

An optimal control problem is considered for a system described by a singular equation of parabolic type. The study bases on a special regularization method. We establish existence of a solution to the regularized problem, as well as the corresponding necessary optimality conditions. The results enable us to find an approximate solution to the original problem even in the absence of solvability.     

Necessary optimality conditions for a singular surface in the form of synthesis

For a linear control problem using the traditional open-loop approach, a new representation for the singular control and generalized, invariant conditions for optimality are found. The phase portrait of a nonlinear control problem is considered in the neighborhood of singular trajectories. The singular paths form a hypersurface, approached by regular paths from both sides. The Bellman function for this problem is a classical (smooth) solution to a first-order PDE with nonsmooth Hamiltonian over two smooth (regular) branches, related to the halfneighborhoods of the surface. These solutions are at least twice differentiable and have first discontinuous derivatives of odd order. The invariant form for these necessary conditions is found in terms of Jacobi (Poisson) brackets, consisting of several equalities and inequalities. The latter relations guarantee the validity of the Kelley condition as well as the geometrical constraints for the singular control variables. Thus, the Kelley condition appears to be just a certain property of a smooth solution to a first-order PDE with nonsmooth Hamiltonian. All the relations, including the Hamiltonian equations of singular motion, do not use singular controls; they are based on regular Hamiltonians depending only upon the state vector and the gradient of the Bellman function (adjoint vector).This work was suported by Grant No. 93-013-16285 of the Russian Fund for Fundamental Research.     

Abort landing in the presence of windshear as a minimax optimal control problem,part 2: Multiple shooting and homotopy

In Part 1 of the paper (Ref. 2), we have shown that the necessary conditions for the optimal control problem of the abort landing of a passenger aircraft in the presence of windshear result in a multipoint boundary-value problem. This boundary-value problem is especially well suited for numerical treatment by the multiple shooting method. Since this method is basically a Newton iteration, initial guesses of all variables are needed and assumptions about the switching structure have to be made. These are big obstacles, but both can be overcome by a so-called homotopy strategy where the problem is imbedded into a one-parameter family of subproblems in such a way that (at least) the first problem is simple to solve. The solution data to the first problem may serve as an initial guess for the next problem, thus resulting in a whole chain of problems. This process is to be continued until the objective problem is reached.Techniques are presented here on how to handle the various changes of the switching structure during the homotopy run. The windshear problem, of great interest for safety in aviation, also serves as an excellent benchmark problem: Nearly all features that can arise in optimal control appear when solving this problem. For example, the candidate for an optimal trajectory of the minimax optimal control problem shows subarcs with both bang-bang and singular control functions, boundary arcs and touch points of two state constraints, one being of first order and the other being of third order, etc. Therefore, the results of this paper may also serve as some sort of user's guide for the solution of complicated real-life optimal control problems by multiple shooting.The candidate found for an optimal trajectory is discussed and compared with an approximate solution already known (Refs. 3–4). Besides the known necessary conditions, additional sharp necessary conditions based on sign conditions of certain multipliers are also checked. This is not possible when using direct methods.An extended abstract of this paper was presented at the 8th IFAC Workshop on Control Applications of Nonlinear Programming and Optimization, Paris, France, 1989 (see Ref. 1).This paper is dedicated to Professor Hans J. Stetter on the occasion of his 60th birthday.     

具有有限燃料的奇异型最佳随机控制问题之推广

本文推广了有限燃料情况下的奇异型随控制模型，对推广后的模型求出了最佳费用函数的结构表达式及最佳控制的存在条件，且当最佳控制存在时具体地构造出了该最佳控制。     

An Optimal Control Problem for a Singular System of Solid–Liquid Phase Transition

In this article, we deal with a control problem for a singular system regarding a phase-field model which describes a solid–liquid transition by the Ginzburg–Landau theory. The purpose is to control the system by the means of the heat supply r able to guide it into a certain state with a solid (or liquid) part in a prescribed subset Ω₀ of the space domain Ω, and maintain it in this state during a period of time. The transition is described by a nonlinear differential system of two equations for the phase field and temperature. The control problem is set for some expressions of the cost functional which might reveal cases of physical interest. An approximating control problem is introduced and the existence of at least an optimal pair is proved. The first-order optimality conditions for the approximating problem are determined and a convergence result is given.     

Graded Galerkin methods for the high‐order convection‐diffusion problem

We develop a Galerkin method using the Hermite spline on an admissible graded mesh for solving the high‐order singular perturbation problem of the convection‐diffusion type. We identify a special function class to which the solution of the convection‐diffusion problem belongs and characterize the approximation order of the Hermite spline for such a function class. The approximation order is then used to establish the optimal order of uniform convergence for the Galerkin method. Numerical results are presented to confirm the theoretical estimate.© 2008 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq, 2009     

Numerical methods for singular optimal control

Methods are described for the numerical solution of singular optimal control problems. A simple method is given for solving a class of problems which form a transition from nonsingular to singular cases. A procedure is given for determining the structure of a singular problem if it is initially unknown. Several numerical examples are presented.This work is based on the author's PhD Dissertation at The Hatfield Polytechnic, Hatfield, Hertfordshire, England.     

奇异脉冲系统的奇异H_∞控制

主要研究奇异脉冲系统的奇异H∞控制问题.当系统不满足正则条件时,给出奇异脉冲系统的奇异H∞控制问题可解的充分条件,控制律使得闭环系统在保证内稳定的条件下达到干扰衰减.