Two-mode control of Brownian Motion with quadratic loss and switching costs

We consider a simple problem in the optimal control of Brownian Motion. There are two modes of control available, each with its own drift and diffusion coefficients, and switching costs are incurred whenever the control mode is changed. Finally, holding costs are incurred according to a quadratic function of the state of the system, and all costs are continuously discounted. It is shown that there exists an optimal policy involving just two critical numbers, and formulas are given for computation of the critical numbers.     

Stochastic maximum principle for mean-field forward-backward stochastic control system with terminal state constraints

In this paper,we consider an optimal control problem with state constraints,where the control system is described by a mean-field forward-backward stochastic differential equation(MFFBSDE,for short)and the admissible control is mean-field type.Making full use of the backward stochastic differential equation theory,we transform the original control system into an equivalent backward form,i.e.,the equations in the control system are all backward.In addition,Ekeland’s variational principle helps us deal with the state constraints so that we get a stochastic maximum principle which characterizes the necessary condition of the optimal control.We also study a stochastic linear quadratic control problem with state constraints.     

跳扩散模型下基金平衡管理的最优脉冲控制

在基金市值波动服从跳扩散过程, 基金持有的罚金成本为当前基金水平的二次函数及存在交易费的假设下研究了无穷时域的基金平衡管理的最小成本模型. 利用随机最优脉冲控制的拟变分不等式理论建立了判定定理,得到了最优脉冲控制策略的存在性, 同时通过构造方法给出了解的数学结构形式.     

Optimal impulse and regular control strategies for proportional reinsurance problem

We formulate a stochastic control problem on proportional reinsurance that includes impulse and regular control strategies. For the first time we combine impulse control with regular control, and derive the expected total discount pay-out (return function) from present to bankruptcy. By relying on both stochastic calculus and the classical theory of impulse and regular controls, we state a set of sufficient conditions for its solution in terms of optimal return function. Moreover, we also derive its explicit form and corresponding impulse and regular control strategies.     

An impulse control problem of a production model with interruptions to follow stochastic demand

The paper deals with the stochastic optimal intervention problem which arises in a production & storage system involving identical items. The requests for items arrive at random and the production of an item can be interrupted during production to meet the corresponding demand. The operational costs considered are due to the stock/backlog, running costs and set up costs associated to interruptions and re-initializations. The process presents distinct behaviour on each of two disjoint identical subsets of the state space, and the state process can only be transferred from one subset to the other by interventions associated to interruptions/re-initializations. A characterization is given in terms of piecewise deterministic Markov process, which explores the aforementioned structure, and a method of solution with assured convergence, that does not require any special initialization, is provided.Additionally, we demonstrate that under conditions on the data, the optimal policy is to produce the item completely in a certain region of the state space of low stock level.     

A STOCHASTIC FEEDBACK MODEL FOR OPTIMAL MANAGEMENT OF RENEWABLE RESOURCES

Analytical expressions for optimal harvest of a renewable resource stock which is subject to a stochastic process are found. These expressions give the optimal harvest as an explicit feedback control law. All relations in the model, including the stochastic process, may be arbitrary functions of the state variable (stock). The objective function, however, is at most a quadratic function in the control variable (yield). A quadratic objective function includes the cases of downward sloping demand and increasing marginal costs which are the most common sources for nonlinearities in the economic part of the model. When it is assumed that there is a moratorium on harvest for stock sizes below a certain level (biological barrier), it is shown that the barrier requirements influence the optimal harvest paths throughout.     

Estimation and control for linear,partially observable systems with non-gaussian initial distribution

The nonlinear filtering problem of estimating the state of a linear stochastic system from noisy observations is solved for a broad class of probability distributions of the initial state. It is shown that the conditional density of the present state, given the past observations, is a mixture of Gaussian distributions, and is parametrically determined by two sets of sufficient statistics which satisfy stochastic DEs; this result leads to a generalization of the Kalman–Bucy filter to a structure with a conditional mean vector, and additional sufficient statistics that obey nonlinear equations, and determine a generalized (random) Kalman gain. The theory is used to solve explicitly a control problem with quadratic running and terminal costs, and bounded controls.     

条件平均场随机微分方程的最优控制问题

作者研究了一个条件平均场随机微分方程的最优控制问题.这种方程和某些部分信息下的随机最优控制问题有关,并且可以看做是平均场随机微分方程的推广.作者以庞特里雅金最大值原理的形式给出最优控制满足的必要和充分条件.此外,文中给出一个线性二次最优控制问题来说明理论结果的应用.     

An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations

In this paper, we will study an indefinite stochastic linear quadratic optimal control problem, where the controlled system is described by a stochastic differential equation with delay. By introducing the relaxed compensator as a novel method, we obtain the well-posedness of this linear quadratic problem for indefinite case. And then, we discuss the uniqueness and existence of the solutions for a kind of anticipated forward–backward stochastic differential delayed equations. Based on this, we derive the solvability of the corresponding stochastic Hamiltonian systems, and give the explicit representation of the optimal control for the linear quadratic problem with delay in an open-loop form. The theoretical results are validated as well on the control problems of engineering and economics under indefinite condition.     

Optimal impulse control on an unbounded domain with nonlinear cost functions

In this paper we consider the optimal impulse control of a system which evolves randomly in accordance with a homogeneous diffusion process in ℜ¹. Whenever the system is controlled a cost is incurred which has a fixed component and a component which increases with the magnitude of the control applied. In addition to these controlling costs there are holding or carrying costs which are a positive function of the state of the system. Our objective is to minimize the expected discounted value of all costs over an infinite planning horizon. Under general assumptions on the cost functions we show that the value function is a weak solution of a quasi-variational inequality and we deduce from this solution the existence of an optimal impulse policy. The computation of the value function is performed by means of the Finite Element Method on suitable truncated domains, whose convergence is discussed. Mathematics Subject Classification: 49J40, 60G40, 65N30     

L\'evy过程驱动的正倒向随机系统的随机最大值原理

研究了由Teugels鞅和与之独立的多维Brown运动共同驱动的正倒向随机控制系统的最优控制问题. 这里Teugels鞅是一列与L\'{e}vy 过程相关的两两强正交的正态鞅 (见Nualart, Schoutens 在2000年的结果). 在允许控制值域为一非空凸闭集假设下, 采用凸变分法和对偶技术获得了最优控制存在所满足的充分和必要条件. 作为应用, 系统研究了线性正倒向随机系统的二次最优控制问题(简记为FBLQ问题), 通过相应的随机哈密顿系统对最优控制 进行了对偶刻画. 这里的随机哈密顿系统是由Teugels鞅和多维Brown运动共同驱动的线性正倒向随机微分方程, 其由状态方程、伴随方程和最优控制的对偶表示共同来构成.     

A unified approach to portfolio optimization with linear transaction costs

In this paper we study the continuous time optimal portfolio selection problem for an investor with a finite horizon who maximizes expected utility of terminal wealth and faces transaction costs in the capital market. It is well known that, depending on a particular structure of transaction costs, such a problem is formulated and solved within either stochastic singular control or stochastic impulse control framework. In this paper we propose a unified framework, which generalizes the contemporary approaches and is capable to deal with any problem where transaction costs are a linear/piecewise-linear function of the volume of trade. We also discuss some methods for solving numerically the problem within our unified framework.     

Impulse Control of One-Dimensional Ito Diffusions with an Expected and a Pathwise Ergodic Criterion

We consider the problem of controlling a general one-dimensional Ito diffusion by means of an impulse control process. The objective is to minimise a long-term expected criterion as well as a long-term pathwise criterion that penalise both deviations of the state process from a given nominal point and the use of impulsive control effort. In particular, each time the controller deploys an impulse to reposition the system's state, a fixed cost and a cost proportional to the impulse's size are incurred. We solve the resulting optimisation problems and we provide an explicit characterisation of an optimal control strategy under general assumptions. The control of a foreign exchange rate or an inflation rate presents a potential application of the model that we study.     

Transient and steady-state analysis of a manufacturing system with setup changes

This paper deals with the optimal scheduling of a one-machine two-product manufacturing system with setup, operating in a continuous time dynamic environment. The machine is reliable. A known constant setup time is incurred when switching over from a part to the other. Each part has specified constant processing time and constant demand rate, as well as an infinite supply of raw material. The problem is formulated as a production flow control problem. The objective is to minimize the sum of the backlog and inventory costs incurred over a finite planning horizon. The global optimal solution, expressed as an optimal feedback control law, provides the optimal production rate and setup switching epochs as a function of the state of the system (backlog and inventory levels). For the steady-state, the optimal cyclic schedule (Limit Cycle) is determined. This is equivalent to solving a one-machine two-product Lot Scheduling Problem. To solve the transient case, the system's state space is partitioned into mutually exclusive regions such that with each region is associated an optimal control policy. A novel algorithm (Direction Sweeping Algorithm) is developed to obtain the optimal state trajectory (optimal policy that minimizes the sum of inventory and backlog costs) for this last case.     

Stochastic impulse control with regime switching for the optimal dividend policy when there are business cycles,taxes and fixed costs

We consider the problem of finding the optimal dividend policy for a company whose cash reserve follows a Brownian motion with drift and volatility modulated by an observable finite-state continuous-time Markov chain. The Markov chain represents the regime of the economy. We allow fixed costs and taxes associated with the dividend payments. This optimization problem generates a stochastic impulse control problem with regime switching. We solve this problem and obtain the first analytical solutions for the optimal dividend policy when there are simultaneously fixed costs, taxes and business cycles. Our results show that the optimal dividend policy depends strongly on the regime of the economy, on fixed costs and on taxes.     

Optimal production control of a dynamic two-product manufacturing system with setup costs and setup times

This paper deals with the optimal control of a one-machine two-product manufacturing system with setup changes, operating in a continuous time dynamic environment. The system is deterministic. When production is switched from one product to the other, a known constant setup time and a setup cost are incurred. Each product has specified constant processing time and constant demand rate, as well as an infinite supply of raw material. The problem is formulated as a feedback control problem. The objective is to minimize the total backlog, inventory and setup costs incurred over a finite horizon. The optimal solution provides the optimal production rate and setup switching epochs as a function of the state of the system (backlog and inventory levels). For the steady state, the optimal cyclic schedule is determined. To solve the transient case, the system's state space is partitioned into mutually exclusive regions such that with each region, the optimal control policy is determined analytically.     

一类新的线性二次随机最优控制器的设计

给出一类正倒向随机微分方程解的存在唯一性结果,应用这个结果研究了一类新的推广的随机线性二次最优控制器的设计问题,得到了由正倒向随机微分方程解所表示的唯一最优控制器的显式结构;在推广的Riccati方程系统基础上,得到最优控制器精确的线性反馈形式.最后,给出了随机线性二次最优控制器的设计算法.     

A controllable linear stochastic system with delay in the information feedback channel

We consider the problem of optimal control of the solution of a linear stochastic differential equation whose stochastic terms depend on the solution and a control in the presence of variable delay in the information feedback channel. We find an explicit form for the optimal control minimizing a quadratic cost functional.Translated fromTeoriya Sluchaínykh Protsessov, Vol. 14, pp. 37–43, 1986.     

On the LQG theory with bounded control

We consider a stochastic optimal control problem in the whole space, where the corresponding HJB equation is degenerate, with a quadratic running cost and coefficients with a linear growth. In this paper we provide full mathematical details on the key estimate relating the asymptotic behavior of the solution as the space variables tend to infinite.     

Optimal dividend and capital injection problem in the dual model with proportional and fixed transaction costs

In this paper we consider the dividend payments and capital injections control problem in a dual risk model. Such a model might be appropriate for a company that specializes in inventions and discoveries, which pays costs continuously and has occasional profits. The objective is to maximize the expected present value of the dividends minus the discounted costs of capital injections. This paper can be considered as an extension of Yao et al. (2010), we include fixed transaction costs incurred by capital injections in this paper. This leads to an impulse control problem. Using the techniques of quasi-variational inequalities (QVI), this optimal control problem is solved. Numerical solutions are provided to illustrate the idea and methodologies, and some interesting economic insights are included.