Maximum principle for optimal control problems involving impulse controls with nonsmooth data

This paper is concerned with the stochastic maximum principle for impulse optimal control problems of forward–backward systems, where the coefficients of the forward part are Lipschitz continuous. The domain of the regular controls is not necessarily convex. We establish a Pontryagins maximum principle for this control problem by applying Ekelands variational principle to a sequence of approximated control problems with smooth coefficients of the initial problems.     

Maximum principle for the optimal control of systems with continuous leads

A sufficiency theorem is provided for the optimal control of systems with continuous leads wherein the motion of today's state is governed by the future trajectory of the control and the state. An application to the economics of dynamic limit pricing is given.This research had its origin in the doctoral dissertation of the author. The comments of H. Ryder are gratefully acknowledged.     

On the sufficiency of the linear maximum principle for discrete-time control problems

This note presents a family of linear maximum principles for the discrete-time optimal control problem, derived from the saddle-point theorem of mathematical programming. Some simple examples illustrate the applicability of the main theoretical results.     

On the maximum principle for deterministic impulse control problems

This paper is devoted to a simple and direct proof of a version of the Blaquiere's maximum principle for deterministic impulse control problems.     

Decision and forecast horizons,agreeable plans,and the maximum principle for infinite horizon control problems

This paper establishes a link between the concepts of optimality used in economic theory for infinite horizon planning models, and the concepts of decision and forecast horizons used in several areas of Management Science. It is shown that decision and forecast horizons induce an alternate definition of optimality which is stronger than the concept of ‘agreeable plan’ proposed by Hammond. All concepts of optimality share a common property, namely a Principle of Optimality. In an optimal control framework this implies that the maximum principle will be a necessary condition for optimality according to any of these definitions.     

Maximum principle,dynamic programming,and their connection in deterministic control

Two major tools for studying optimally controlled systems are Pontryagin's maximum principle and Bellman's dynamic programming, which involve the adjoint function, the Hamiltonian function, and the value function. The relationships among these functions are investigated in this work, in the case of deterministic, finite-dimensional systems, by employing the notions of superdifferential and subdifferential introduced by Crandall and Lions. Our results are essentially non-smooth versions of the classical ones. The connection between the maximum principle and the Hamilton-Jacobi-Bellman equation (in the viscosity sense) is thereby explained by virtue of the above relationship.This research was supported by the Natural Science Fund of China.This paper was written while the author visited Keio University, Japan. The author is indebted to Professors H. Tanaka and M. Nisio for their helpful suggestions and discussions. Thanks are also due to Professor X. J. Li for his comments and criticism.     

带Poisson 跳跃的正倒向随机延迟系统递归最优控制问题的最大值原理

本文研究了带Poisson 跳跃的正倒向随机延迟系统的递归最优控制问题. 利用经典的针状变分方法、对偶技术和带Poisson 跳跃的超前倒向随机微分方程的相关结果, 证明了最优控制的最大值原理, 包括了最优控制满足的必要条件和充分条件.     

Maximum principle in problems with mixed constraints under weak assumptions of regularity

In the present work, optimal control problems with mixed constraints are investigated. A novel weakening of the conventional regularity assumptions on mixed constraints is introduced. A maximum principle is derived in which the maximum condition is of nonstandard type: the maximum is taken over the closure of the set of regular points, but not over the whole feasible set.     

Weak maximum principle for optimal control problems of nonsmooth systems

In this paper, by considering vector-valued maximum type functions satisfying Lipschitz condition, and optimal control systems with continuous-time which is governed by systems of ordinary differential equation, we derive results similar to Pontryagin’s maximum principle and properties concerning the generalized Jacobian set for optimal control problems of these systems.     

Necessary and sufficient optimality conditions for control of piecewise deterministic markov processes

Piecewise deterministic Markov processes (PDPs) are continuous time homogeneous Markov processes whose trajectories are solutions of ordinary differential equations with random jumps between the different integral curves. Both continuous deterministic motion and the random jumps of the processes are controlled in order to minimize the expected value of a performance criterion involving discounted running and boundary costs. Under fairly general assumptions, we will show that there exists an optimal control, that the value function is Lipschitz continuous and that a generalized Bellman-Hamilton-Jacobi (BHJ) equation involving the Clarke generalized gradient is a necessary and sufficient optimality condition for the problem.     

Maximum principle and second-order conditions for minimax problems of optimal control

In this paper, we study the optimal control problem of minimizing the functionalJ(x, u)=max_t1tt2(x(t),t). We formulate and prove necessary optimality conditions for this problem. We establish the equivalence between the initial minimax problem and a problem involving a terminal functional and phase constraints.     

Maximum principle for optimal control of distributed-parameter systems with singular mass matrix

A maximum principle for the open-loop optimal control of a vibrating system relative to a given convex index of performance is investigated. Though maximum principles have been studied by many people (see, e.g., Refs. 1–5), the principle derived in this paper is of particular use for control problems involving mechanical structures. The state variable satisfies general initial conditions as well as a self-adjoint system of partial differential equations together with a homogeneous system of boundary conditions. The mass matrix is diagonal, constant, and singular, and the viscous damping matrix is diagonal. The maximum principle relates the optimal control with the solution of the homogeneous adjoint equation in which terminal conditions are prescribed in terms of the terminal values of the optimal state variable. An application of this theory to a structural vibrating system is given in a companion paper (Ref. 6).     

Maximum principle for optimal distributed control of the viscous Dullin-Gottwald-Holm equation

In this paper, the optimal distributed control of the viscous Dullin-Gottwald-Holm equation is investigated. Adopting the Dubovitskii and Milyutin functional analytical approach, we obtain the Pontryagin maximum principle of the system. The necessary optimality condition is established for an optimal control problem in fixed final horizon case. Finally, an illustrative example is also given.     

A maximum principle for optimal control problems with mixed constraints

Necessary conditions in the form of maximum principles are derivedfor optimal control problems with mixed control and state constraints.Traditionally, necessary condtions for problems with mixed constraintshave been proved under hypothesis which include the requirementthat the Jacobian of the mixed constraint functional, with respectto the control variable, have full rank. We show that it canbe replaced by a weaker ‘interiority’ hypothesis.This refinement broadens the scope of the optimality conditions,to cover some optimal control problems involving differentialalgebraic constraints, with index greater than unity.     

Normality of the maximum principle for nonconvex constrained Bolza problems

We consider a Bolza optimal control problem with state constraints. It is well known that under some technical assumptions every strong local minimizer of this problem satisfies first order necessary optimality conditions in the form of a constrained maximum principle. In general, the maximum principle may be abnormal or even degenerate and so does not provide a sufficient information about optimal controls. In the recent literature some sufficient conditions were proposed to guarantee that at least one maximum principle is nondegenerate, cf. [A.V. Arutyanov, S.M. Aseev, Investigation of the degeneracy phenomenon of the maximum principle for optimal control problems with state constraints, SIAM J. Control Optim. 35 (1997) 930–952; F. Rampazzo, R.B. Vinter, A theorem on existence of neighbouring trajectories satisfying a state constraint, with applications to optimal control, IMA 16 (4) (1999) 335–351; F. Rampazzo, R.B. Vinter, Degenerate optimal control problems with state constraints, SIAM J. Control Optim. 39 (4) (2000) 989–1007]. Our aim is to show that actually conditions of a similar nature guarantee normality of every nondegenerate maximum principle. In particular we allow the initial condition to be fixed and the state constraints to be nonsmooth. To prove normality we use J. Yorke type linearization of control systems and show the existence of a solution to a linearized control system satisfying new state constraints defined, in turn, by linearization of the original set of constraints along an extremal trajectory.     

Wealth optimization and dual problems for jump stock dynamics with stochastic factor

An incomplete financial market is considered with a risky asset and a bond. The risky asset price is a pure jump process whose dynamics depends on a jump-diffusion stochastic factor describing the activity of other markets, macroeconomics factors or microstructure rules that drive the market. With a stochastic control approach, maximization of the expected utility of terminal wealth is discussed for utility functions of constant relative risk aversion type. Under suitable assumptions, closed form solutions for the value functions and for the optimal strategy are provided and verification results are discussed. Moreover, the solution to the dual problems associated with the utility maximization problems is derived.     

Maximum principle for optimal control of sterilization of prepackaged food

Mi-Xia Wu College of Applied Sciences, Beijing University of Technology, Beijing 100022, People's Republic of China Corresponding author. Present address: 23 Paca PL, Rockville, MD 20852-1123, USA. E-mail: sunbing{at}amss.ac.cn, sunamss{at}gmail.com Received on November 13, 2006; Revision received December 8, 2006. Accepted on January 20, 2007 This paper is concerned with an optimal control problem of thesterilization of prepackaged food. The Dubovitskii–Milyutinapproach is adopted in investigation of the Pontryagin's maximumprinciple of the system. The necessary condition is presentedfor the problem with fixed final horizon and phase constraints.     

一类状态受限的随机延迟最优控制问题的最大值原理

本文考虑一类状态受限的随机延迟最优控制问题,其中控制域为凸集且扩散项系数中含有控制变量.控制域可以是无界集合.用最大值原理方法建立了最优控制满足的必要条件.也给出了充分最优性条件,从而有助于找到最优控制.     

Pontryagin Type Maximum Principle for budget-constrained infinite horizon optimal control problems with linear dynamics

In this paper a class of infinite horizon optimal control problems with an isoperimetrical constraint, also interpreted as a budget constraint, is considered. Herein a linear both in the state and in the control dynamic is allowed. The problem setting includes a weighted Sobolev space as the state space. For this class of problems, we establish the necessary optimality conditions in form of a Pontryagin Type Maximum Principle including a transversality condition. The proved theoretical result is applied to a linear–quadratic regulator problem.     

Maximum principle of optimal control for functional differential systems

We show that the maximum principle holds for optimal periodic control problems governed by functional differential equations under a Lipschitz condition on the value functional. Generalizations to other boundary conditions are also considered.This research was partially supported by NSF Grant No. DMS-84-01719.The first author was partially supported by the Science Fund of the Chinese Academy of Sciences, Beijing, China.