Stochastic control under progressive enlargement of filtrations and applications to multiple defaults risk management

We formulate and investigate a general stochastic control problem under a progressive enlargement of filtration. The global information is enlarged from a reference filtration and the knowledge of multiple random times together with associated marks when they occur. By working under a density hypothesis on the conditional joint distribution of the random times and marks, we prove a decomposition of the original stochastic control problem under the global filtration into classical stochastic control problems under the reference filtration, which is determined in a finite backward induction. Our method revisits and extends in particular stochastic control of diffusion processes with a finite number of jumps. This study is motivated by optimization problems arising in default risk management, and we provide applications of our decomposition result for the indifference pricing of defaultable claims, and the optimal investment under bilateral counterparty risk. The solutions are expressed in terms of BSDEs involving only Brownian filtration, and remarkably without jump terms coming from the default times and marks in the global filtration.     

Mean-Variance Hedging on Uncertain Time Horizon in a Market with a Jump

In this work, we study the problem of mean-variance hedging with a random horizon T∧τ, where T is a deterministic constant and τ is a jump time of the underlying asset price process. We first formulate this problem as a stochastic control problem and relate it to a system of BSDEs with a jump. We then provide a verification theorem which gives the optimal strategy for the mean-variance hedging using the solution of the previous system of BSDEs. Finally, we prove that this system of BSDEs admits a solution via a decomposition approach coming from filtration enlargement theory.     

Progressive Enlargement of Filtrations and Backward Stochastic Differential Equations with Jumps

This work deals with backward stochastic differential equations (BSDEs for short) with random marked jumps, and their applications to default risk. We show that these BSDEs are linked with Brownian BSDEs through the decomposition of processes with respect to the progressive enlargement of filtrations. We prove that the equations have solutions if the associated Brownian BSDEs have solutions. We also provide a uniqueness theorem for BSDEs with jumps by giving a comparison theorem based on the comparison for Brownian BSDEs. We give in particular some results for quadratic BSDEs. As applications, we study the pricing and the hedging of a European option in a market with a single jump, and the utility maximization problem in an incomplete market with a finite number of jumps.     

A penalty function-based random search algorithm for optimal control of switched systems with stochastic constraints and its application in automobile test-driving with gear shifts

Practical industrial process is usually a dynamic process including uncertainty. Stochastic constraints can be used for industrial process modeling, when system sate and/or control input constraints cannot be strictly satisfied. Thus, optimal control of switched systems with stochastic constraints can be available to address practical industrial process problems with different modes. In general, obtaining an analytical solution of the optimal control problem is usually very difficult due to the discrete nature of the switching law and the complexity of stochastic constraints. To obtain a numerical solution, this problem is formulated as a constrained nonlinear parameter selection problem (CNPSP) based on a relaxation transformation (RT) technique, an adaptive sample approximation (ASA) method, a smooth approximation (SA) technique, and a control parameterization (CP) method. Following that, a penalty function-based random search (PFRS) algorithm is designed for solving the CNPSP based on a novel search rule-based penalty function (NSRPF) method and a novel random search (NRS) algorithm. The convergence results show that the proposed method is globally convergent. Finally, an optimal control problem in automobile test-driving with gear shifts (ATGS) is further extended to illustrate the effectiveness of the proposed method by taking into account some stochastic constraints. Numerical results show that compared with other typical methods, the proposed method is less conservative and can obtain a stable and robust performance when considering the small perturbations in initial system state. In addition, to balance the computation amount and the numerical solution accuracy, a tolerance setting method is also provided by the numerical analysis technique.     

BSDEs driven by time-changed Lévy noises and optimal control

We study backward stochastic differential equations (BSDEs) for time-changed Lévy noises when the time-change is independent of the Lévy process. We prove existence and uniqueness of the solution and we obtain an explicit formula for linear BSDEs and a comparison principle. BSDEs naturally appear in control problems. Here we prove a sufficient maximum principle for a general optimal control problem of a system driven by a time-changed Lévy noise. As an illustration we solve the mean–variance portfolio selection problem.     

Solution of a class of stochastic linear-convex control problems using deterministic equivalents

In this paper, we identify a new class of stochastic linearconvex optimal control problems, whose solution can be obtained by solving appropriate equivalent deterministic optimal control problems. The term linear-convex is meant to imply that the dynamics is linear and the cost function is convex in the state variables, linear in the control variables, and separable. Moreover, some of the coefficients in the dynamics are allowed to be random and the expectations of the control variables are allowed to be constrained. For any stochastic linear-convex problem, the equivalent deterministic problem is obtained. Furthermore, it is shown that the optimal feedback policy of the stochastic problem is affine in its current state, where the affine transformation depends explicitly on the optimal solution of the equivalent deterministic problem in a simple way. The result is illustrated by its application to a simple stochastic inventory control problem.This research was supported in part by NSERC Grant A4617, by SSHRC Grant 410-83-0888, and by an INRIA Post-Doctoral Fellowship.     

A differential game with jump process observations

We introduce a stochastic differential game with jump process observations. Both players obtain common, noisy information of the state of the system only at random time instants. The solutions to this game and its continuous observations in noise counterpart are obtained. Some earlier results dealing with the effect of changes in system parameters on the optimal cost for the continuous observations case are extended to the game with jump process observations.This work was supported by a 1978 Summer Faculty Fellowship from the University of Maryland, Baltimore County.     

Forward-backward stochastic differential equations with Brownian motion and poisson process

1.IntroductionLet(n,Y,{S}tZo,P)beastochasticbasissuchthatAscontainsallp-nullelementsofFand5 =nR .=h,t2o.Wesupposethatthefiltration{R}tZoisgeneratede>0bythefollowingtwOmutuallyindependentProcesses:(i)Ad-dbonsionalstandardBroedanmotion{Bt}tZo;(h)APoissonrandommeasureNonR xZ,whereZCFIisanonemptyopensetequippedwithitsBorelheldB(Z),withcompensatorN(dz,dt)=A(dz)dt,suchthatN(Ax[0,t])=(N--N)(Ax10,t])tZoisamartingaleforallAEB(Z)satisfyingA(A)相似文献   

Stabilization of stochastic systems under Markovian switching

The problem of state feedback stabilization of discrete-time stochastic processes under Markovian switching is considered. The jump Markovian switching is modeled by a discrete-time Markov chain, and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Necessary and sufficient conditions based on linear matrix inequalities (LMI’s) for stochastic stability is obtained. The proposed control law for this stochastic stabilization result depends on the mode of the system as well as the environmental disturbances. The robustness results of such stability concepts against all admissible uncertainties are also investigated. An example is given to demonstrate the obtained results.     

The Convergence Rate from Discrete to Continuous Optimal Investment Stopping Problem

The author studies the optimal investment stopping problem in both continuous and discrete cases, where the investor needs to choose the optimal trading strategy and optimal stopping time concurrently to maximize the expected utility of terminal wealth.Based on the work of Hu et al. (2018) with an additional stochastic payoff function,the author characterizes the value function for the continuous problem via the theory of quadratic reflected backward stochastic differential equations (BSDEs for short) with unbounded terminal condition. In regard to the discrete problem, she gets the discretization form composed of piecewise quadratic BSDEs recursively under Markovian framework and the assumption of bounded obstacle, and provides some useful a priori estimates about the solutions with the help of an auxiliary forward-backward SDE system and Malliavin calculus. Finally, she obtains the uniform convergence and relevant rate from discretely to continuously quadratic reflected BSDE, which arise from corresponding optimal investment stopping problem through above characterization.     

OPTIMAL GRAZING MANAGEMENT RULES IN SEMI‐ARID RANGELANDS WITH UNCERTAIN RAINFALL

Abstract. We study optimal adaptive grazing management under uncertain rainfall in a discrete‐time model. As in each year actual rainfall can be observed during the short rainy season, and grazing management can be adapted accordingly for the growing season; the closed‐loop solution of the stochastic optimal control problem does not only depend on the state variable, but also on the realization of the random rainfall. This distinguishes optimal grazing management from the optimal use of most other natural resources under uncertainty, where the closed‐loop solution of the stochastic optimal control problem depends only on the state variables. Solving this unusual stochastic optimization problem allows us to critically contribute to a long‐standing controversy over how to optimally manage semi‐arid rangelands by simple rules of thumb.     

Optimal Guaranteed Cost Control of Stochastic Discrete-Time Systems with States and Input Dependent Noise Under Markovian Switching

A problem of robust guaranteed cost control of stochastic discrete-time systems with parametric uncertainties under Markovian switching is considered. The control is simultaneously applied to both the random and the deterministic components of the system. The noise (the random) term depends on both the states and the control input. The jump Markovian switching is modeled by a discrete-time Markov chain and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Using linear matrix inequalities (LMIs) approach, the robust quadratic stochastic stability is obtained. The proposed control law for this quadratic stochastic stabilization result depended on the mode of the system. This control law is developed such that the closed-loop system with a cost function has an upper bound under all admissible parameter uncertainties. The upper bound for the cost function is obtained as a minimization problem. Two numerical examples are given to demonstrate the potential of the proposed techniques and obtained results.     

Reflected BSDEs and robust optimal stopping for dynamic risk measures with jumps

We study the optimal stopping problem for dynamic risk measures represented by Backward Stochastic Differential Equations (BSDEs) with jumps and its relation with reflected BSDEs (RBSDEs). The financial position is given by an RCLL adapted process. We first state some properties of RBSDEs with jumps when the obstacle process is RCLL only. We then prove that the value function of the optimal stopping problem is characterized as the solution of an RBSDE. The existence of optimal stopping times is obtained when the obstacle is left-upper semi-continuous along stopping times. Finally, we investigate robust optimal stopping problems related to the case with model ambiguity and their links with mixed control/optimal stopping game problems. We prove that, under some hypothesis, the value function is equal to the solution of an RBSDE. We then study the existence of saddle points when the obstacle is left-upper semi-continuous along stopping times.     

基于二次效用函数的投资组合问题研究

设无风险利率、股票收益率和波动率都是一致有界随机过程,在股票价格服从跳跃一扩散过程时,同时考虑具有随机资金流的介入,研究了二次效用的动态投资组合选择优化问题,通过随机线性二次控制和倒向随机微分方程得到了最优投资组合策略的解析表达式.     

State constrained reachability for stochastic hybrid systems

Many control problems can be formulated as driving a system to reach some target states while avoiding some unwanted states. We study this problem for systems with regime change operating in uncertain environments. Nowadays, it is a common practice to model such systems in the framework of stochastic hybrid system models. In this casting, the problem is formalized as a mathematical problem named state constrained stochastic reachability analysis. In the state constrained stochastic reachability analysis, this probability is computed by imposing a constraint on the system to avoid the unwanted states. The scope of this paper is twofold. First we define and investigate the state constrained reachability analysis in an abstract mathematical setting. We define the problem for a general model of stochastic hybrid systems, and we show that the reach probabilities can be computed as solutions of an elliptic integro-differential equation. Moreover, we extend the problem by considering randomized targets. We approach this extension using stochastic dynamic programming. The second scope is to define a developmental setting in which the state constrained reachability analysis becomes more tractable. This framework is based on multilayer modelling of a stochastic system using hierarchical viewpoints. Viewpoints represent a method originated from software engineering, where a system is described by multiple models created from different perspectives. Using viewpoints, the reach probabilities can be easily computed, or even symbolically calculated. The reach probabilities computed in one viewpoint can be used in another viewpoint for improving the system control. We illustrate this technique for trajectory design.     

Stochastic stability and robust control for sampled-data systems with Markovian jump parameters

In this paper, the problems of stochastic stability and robust control for a class of uncertain sampled-data systems are studied. The systems consist of random jumping parameters described by finite-state semi-Markov process. Sufficient conditions for stochastic stability or exponential mean square stability of the systems are presented. The conditions for the existence of a sampled-data feedback control and a multirate sampled-data optimal control for the continuous-time uncertain Markovian jump systems are also obtained. The design procedure for robust multirate sampled-data control is formulated as linear matrix inequalities (LMIs), which can be solved efficiently by available software toolboxes. Finally, a numerical example is given to demonstrate the feasibility and effectiveness of the proposed techniques.     

An Optimal Control Problem Associated with SDEs Driven by Lévy-Type Processes

Abstract

In this article, we consider an optimal control problem associated with jump type stochastic differential equations driven by Lévy-type processes. The problem arises from portfolio optimization for the pair of the wealth process and the cumulative consumption process in (incomplete) financial market models. We establish the existence and the uniqueness of (constrained) viscosity solutions to the associated the integro-differential Hamilton–Jacobi–Bellman equation.     

Backward stochastic differential equations associated to jump Markov processes and applications

In this paper we study backward stochastic differential equations (BSDEs) driven by the compensated random measure associated to a given pure jump Markov process X$X$ on a general state space K$K$. We apply these results to prove well-posedness of a class of nonlinear parabolic differential equations on K$K$, that generalize the Kolmogorov equation of X$X$. Finally we formulate and solve optimal control problems for Markov jump processes, relating the value function and the optimal control law to an appropriate BSDE that also allows to construct probabilistically the unique solution to the Hamilton–Jacobi–Bellman equation and to identify it with the value function.     

Sufficient Stochastic Maximum Principle for the Optimal Control of Semi-Markov Modulated Jump-Diffusion with Application to Financial Optimization

The finite state semi-Markov process is a generalization over the Markov chain in which the sojourn time distribution is any general distribution. In this article, we provide a sufficient stochastic maximum principle for the optimal control of a semi-Markov modulated jump-diffusion process in which the drift, diffusion, and the jump kernel of the jump-diffusion process is modulated by a semi-Markov process. We also connect the sufficient stochastic maximum principle with the dynamic programming equation. We apply our results to finite horizon risk-sensitive control portfolio optimization problem and to a quadratic loss minimization problem.     

Multi-dimensional BSDE with oblique reflection and optimal switching

In this paper, we study a multi-dimensional backward stochastic differential equation (BSDE) with oblique reflection, which is a BSDE reflected on the boundary of a special unbounded convex domain along an oblique direction, and which arises naturally in the study of optimal switching problem. The existence of the adapted solution is obtained by the penalization method, the monotone convergence, and the a priori estimates. The uniqueness is obtained by a verification method (the first component of any adapted solution is shown to be the vector value of a switching problem for BSDEs). As applications, we apply the above results to solve the optimal switching problem for stochastic differential equations of functional type, and we give also a probabilistic interpretation of the viscosity solution to a system of variational inequalities.