The stochastic goodwill problem

Stochastic control problems related to optimal advertising under uncertainty are considered. In particular, we determine the optimal strategies for the problem of maximizing the utility of goodwill at launch time and minimizing the disutility of a stream of advertising costs that extends until the launch time for some classes of stochastic perturbations of the classical Nerlove–Arrow dynamics. We also consider some generalizations such as problems with constrained budget and with discretionary launching.     

Variational Inequalities for Leavable Bounded-Velocity Control

We study the variational inequality associated with a bounded-velocity control problem when discretionary stopping is allowed. We establish the existence of a strong solution by using the viscosity solution techniques. The optimal policy is shown to exist from the optimality conditions in the variational inequality.     

Variational Inequalities for Leavable Bounded-Velocity Control

We study the variational inequality associated with a bounded-velocity control problem when discretionary stopping is allowed. We establish the existence of a strong solution by using the viscosity solution techniques. The optimal policy is shown to exist from the optimality conditions in the variational inequality.     

Note on local quadratic growth estimates in bang–bang optimal control problems

Abstract

Strong second-order conditions in mathematical programming play an important role not only as optimality tests but also as an intrinsic feature in stability and convergence theory of related numerical methods. Besides of appropriate firstorder regularity conditions, the crucial point consists in local growth estimation for the objective which yields inverse stability information on the solution. In optimal control, similar results are known in case of continuous control functions, and for bang–bang optimal controls when the state system is linear. The paper provides a generalization of the latter result to bang–bang optimal control problems for systems which are affine-linear w.r.t. the control but depend nonlinearly on the state. Local quadratic growth in terms of L₁ norms of the control variation are obtained under appropriate structural and second-order sufficient optimality conditions.     

A Capped Optimal Stopping Problem for the Maximum Process

This paper concerns an optimal stopping problem driven by the running maximum of a spectrally negative Lévy process X. More precisely, we are interested in capped versions of the American lookback optimal stopping problem (Gapeev in J. Appl. Probab. 44:713–731, 2007; Guo and Shepp in J. Appl. Probab. 38:647–658, 2001; Pedersen in J. Appl. Probab. 37:972–983, 2000), which has its origins in mathematical finance, and provide semi-explicit solutions in terms of scale functions. The optimal stopping boundary is characterised by an ordinary first-order differential equation involving scale functions and, in particular, changes according to the path variation of X. Furthermore, we will link these capped problems to Peskir’s maximality principle (Peskir in Ann. Probab. 26:1614–1640, 1998).     

Equivalent models for finite-fuel stochastic control

A stochastic control problem with finite-fuel constraint, of the type studied by Bene?, Shepp and Witsenhausen (1980), is solved explicitly. It is shown to be reducible to “simpler” stochastic optimization problems, such as optimal stopping and singular control for Brownian motion with unlimited fuel.     

有限时区上的最优转换和停止问题

讨论了有限时区上的最优转换和停止问题,它是一类同时具备脉冲控制和最优停止特征的最优控制问题.问题的最优值以及最优转换和停止决策可以由具有混合障碍的多维反射倒向随机微分方程的解来刻画.接着考虑了形式更一般的反射倒向随机微分方程并证明了方程解的存在唯一性.     

Reflected BSDEs and robust optimal stopping for dynamic risk measures with jumps

We study the optimal stopping problem for dynamic risk measures represented by Backward Stochastic Differential Equations (BSDEs) with jumps and its relation with reflected BSDEs (RBSDEs). The financial position is given by an RCLL adapted process. We first state some properties of RBSDEs with jumps when the obstacle process is RCLL only. We then prove that the value function of the optimal stopping problem is characterized as the solution of an RBSDE. The existence of optimal stopping times is obtained when the obstacle is left-upper semi-continuous along stopping times. Finally, we investigate robust optimal stopping problems related to the case with model ambiguity and their links with mixed control/optimal stopping game problems. We prove that, under some hypothesis, the value function is equal to the solution of an RBSDE. We then study the existence of saddle points when the obstacle is left-upper semi-continuous along stopping times.     

有限时区上的最优转换和停止问题

讨论了有限时区上的最优转换和停止问题,它是一类同时具备脉冲控制和最优停止特征的最优控制问题.问题的最优值以及最优转换和停止决策可以由具有混合障碍的多维反射倒向随机微分方程的解来刻画.接着考虑了形式更一般的反射倒向随机微分方程并证明了方程解的存在唯一性.     

The full-information best choice problem with a random number of observations

The full-information best choice problem with a random number of observations is considered. N i.i.d. random variables with a known continuous distribution are observed sequentially with the object of selecting the largest. Neither recall nor uncertainty of selection is allowed and one choice must be made. In this paper the number N of observations is random with a known distribution. The structure of the stopping set is investigated. A class of distributions of N (which contains in particular the uniform, negative-binomial and Poisson distributions) is determined, for which the so-called “monotone case” occurs. The theoretical solution for the monotone case is considered. In the case where N is geometric the optimal solution is presented and the probability of winning worked out. Finally, the case where N is uniform is examined. A simple asymptotically optimal stopping rule is found and the asymptotic probability of winning is obtained.     

Synthesis of Optimal Bang–Bang Control for Cooperative Collision Avoidance for Aircraft (Ships) with Unequal Linear Speeds

Close proximity encounters most often occur for situations in which participants have unequal linear speeds. Cooperative collision avoidance strategies for such situations are investigated. We show that, unlike the encounters of participants with equal linear speeds, bang–bang collision avoidance strategies are not always optimal when the linear speeds are unequal, and we establish the conditions for which no optimal bang–bang controls exist near the terminal time. Nevertheless, under certain conditions, we demonstrate that bang–bang collision avoidance strategies remain optimal for encounters of participants with unequal linear speeds. Such conditions are established, and it appears that they cover a wide range of important practical situations. The synthesis of bang–bang control is constructed, and its optimality is established.     

Maximization of the total population in a reaction–diffusion model with logistic growth

This paper is concerned with a nonlinear optimization problem that naturally arises in population biology. We consider the effect of spatial heterogeneity on the total population of a biological species at a steady state, using a reaction–diffusion logistic model. Our objective is to maximize the total population when resources are distributed in the habitat to control the intrinsic growth rate, but the total amount of resources is limited. It is shown that under some conditions, any local maximizer must be of “bang–bang” type, which gives a partial answer to the conjecture addressed by Ding et al. (Nonlinear Anal Real World Appl 11(2):688–704, 2010). To this purpose, we compute the first and second variations of the total population. When the growth rate is not of bang–bang type, it is shown in some cases that the first variation becomes nonzero and hence the resource distribution is not a local maximizer. When the first variation becomes zero, we prove that the second variation is positive. These results implies that the bang–bang property is essential for the maximization of total population.     

Time optimal boundary controls for the heat equation

The fact that the time optimal controls for parabolic equations have the bang–bang property has been recently proved for controls distributed inside the considered domain (interior control). The main result in this article asserts that the boundary controls for the heat equation have the same property, at least in rectangular domains. This result is proved by combining methods from traditionally distinct fields: the Lebeau–Robbiano strategy for null controllability and estimates of the controllability cost in small time for parabolic systems, on one side, and a Remez-type inequality for Müntz spaces and a generalization of Turán?s inequality, on the other side.     

Game options with gradual exercise and cancellation under proportional transaction costs

ABSTRACT

Game (Israeli) options in a multi-asset market model with proportional transaction costs are studied in the case when the buyer is allowed to exercise the option and the seller has the right to cancel the option gradually at a mixed (or randomized) stopping time, rather than instantly at an ordinary stopping time. Allowing gradual exercise and cancellation leads to increased flexibility in hedging, and hence tighter bounds on the option price as compared to the case of instantaneous exercise and cancellation. Algorithmic constructions for the bid and ask prices, and the associated superhedging strategies and optimal mixed stopping times for both exercise and cancellation are developed and illustrated. Probabilistic dual representations for bid and ask prices are also established.     

The CLT for Markov chains with a countable state space embedded in the space lp

We find necessary and sufficient conditions for the CLT for Markov chains with a countable state space embedded in the space l_p for p⩾1. This result is an extension of the uniform CLT over the family of indicator functions in Levental (Stochastic Processes Appl. 34 (1990) 245–253), where the result is equivalent to our case p=1. A similar extension for the uniform CLT over a family of possibly unbounded functions in Tsai (Taiwan. J. Math. 1(4) (1997) 481–498) is also obtained.     

Tikhonov regularization of control-constrained optimal control problems

We consider Tikhonov regularization of control-constrained optimal control problems. We present new a-priori estimates for the regularization error assuming measure and source-measure conditions. In the special case of bang–bang solutions, we introduce another assumption to obtain the same convergence rates. This new condition turns out to be useful in the derivation of error estimates for the discretized problem. The necessity of the just mentioned assumptions to obtain certain convergence rates is analyzed. Finally, a numerical example confirms the analytical findings.     

A numerical method for nonconvex multi-objective optimal control problems

A numerical method is proposed for constructing an approximation of the Pareto front of nonconvex multi-objective optimal control problems. First, a suitable scalarization technique is employed for the multi-objective optimal control problem. Then by using a grid of scalarization parameter values, i.e., a grid of weights, a sequence of single-objective optimal control problems are solved to obtain points which are spread over the Pareto front. The technique is illustrated on problems involving tumor anti-angiogenesis and a fed-batch bioreactor, which exhibit bang–bang, singular and boundary types of optimal control. We illustrate that the Bolza form, the traditional scalarization in optimal control, fails to represent all the compromise, i.e., Pareto optimal, solutions.     

Polynomial profits in renewable resources management

A system of renewal equations on a graph provides a framework to describe the exploitation of a biological resource. In this context, we formulate an optimal control problem, prove the existence of an optimal control and ensure that the target cost function is polynomial in the control. In specific situations, further information about the form of this dependence is obtained. As a consequence, in some cases the optimal control is proved to be necessarily bang–bang, in other cases the computations necessary to find the optimal control are significantly reduced.     

A Continuous Implementation of a Second-Variation Optimal Control Method for Space Trajectory Problems

The paper describes a continuous second-variation method to solve optimal control problems with terminal constraints where the control is defined on a closed set. The integration of matrix differential equations based on a second-order expansion of a Lagrangian provides linear updates of the control and a locally optimal feedback controller. The process involves a backward and a forward integration stage, which require storing trajectories. A method has been devised to store continuous solutions of ordinary differential equations and compute accurately the continuous expansion of the Lagrangian around a nominal trajectory. Thanks to the continuous approach, the method adapts implicitly the numerical time mesh and provides precise gradient iterates to find an optimal control. The method represents an evolution to the continuous case of discrete second-order techniques of optimal control. The novel method is demonstrated on bang–bang optimal control problems, showing its suitability to identify automatically optimal switching points in the control without insight into the switching structure or a choice of the time mesh. A complex space trajectory problem is tackled to demonstrate the numerical robustness of the method to problems with different time scales.