Stationary,completely mixed and symmetric optimal and equilibrium strategies in stochastic games

In this paper, we address various types of two-person stochastic games—both zero-sum and nonzero-sum, discounted and undiscounted. In particular, we address different aspects of stochastic games, namely: (1) When is a two-person stochastic game completely mixed? (2) Can we identify classes of undiscounted zero-sum stochastic games that have stationary optimal strategies? (3) When does a two-person stochastic game possess symmetric optimal/equilibrium strategies? Firstly, we provide some necessary and some sufficient conditions under which certain classes of discounted and undiscounted stochastic games are completely mixed. In particular, we show that, if a discounted zero-sum switching control stochastic game with symmetric payoff matrices has a completely mixed stationary optimal strategy, then the stochastic game is completely mixed if and only if the matrix games restricted to states are all completely mixed. Secondly, we identify certain classes of undiscounted zero-sum stochastic games that have stationary optima under specific conditions for individual payoff matrices and transition probabilities. Thirdly, we provide sufficient conditions for discounted as well as certain classes of undiscounted stochastic games to have symmetric optimal/equilibrium strategies—namely, transitions are symmetric and the payoff matrices of one player are the transpose of those of the other. We also provide a sufficient condition for the stochastic game to have a symmetric pure strategy equilibrium. We also provide examples to show the sharpness of our results.     

不确定性对混合CVaR约束库存系统的影响

运用应用概率中的随机占优研究需求不确定性对混合CVaR约束库存系统最优订购量和最优利润的影响。引入刻画决策者风险态度的“风险偏好系数”,得到系统最优订购量和最优利润关于风险偏好系数的单调性。研究表明随机大需求总会导致系统较高的最优订购量和最优利润;在割准则序意义下,最优订购量可能随需求可变性的增加而增加也可能随需求可变性的增加而减少;在二阶随机占优且风险偏好系数大于等于1的情况下系统最优利润具有随机单调性,然而当风险偏好系数小于1时最优利润在二阶随机占优意义下的结论不一定成立,我们通过一个数值例子来说明。     

Robust non-zero-sum investment and reinsurance game with default risk

This paper investigates a non-zero-sum stochastic differential game between two competitive CARA insurers, who are concerned about the potential model ambiguity and aim to seek the robust optimal reinsurance and investment strategies. The ambiguity-averse insurers are allowed to purchase reinsurance treaty to mitigate individual claim risks; and can invest in a financial market consisting of one risk-free asset, one risky asset and one defaultable corporate bond. The objective of each insurer is to maximize the expected exponential utility of his terminal surplus relative to that of his competitor under the worst-case scenario of the alternative measures. Applying the techniques of stochastic dynamic programming, we derive the robust Nash equilibrium reinsurance and investment policies explicitly and present the corresponding verification theorem. Finally, we perform some numerical examples to illustrate the influence of model parameters on the equilibrium reinsurance and investment strategies and draw some economic interpretations from these results.     

Optimal portfolio choice and stochastic volatility

In this paper we examine the effect of stochastic volatility on optimal portfolio choice in both partial and general equilibrium settings. In a partial equilibrium setting we derive an analog of the classic Samuelson–Merton optimal portfolio result and define volatility‐adjusted risk aversion as the effective risk aversion of an individual investing in an asset with stochastic volatility. We extend prior research which shows that effective risk aversion is greater with stochastic volatility than without for investors without wealth effects by providing further comparative static results on changes in effective risk aversion due to changes in the distribution of volatility. We demonstrate that effective risk aversion is increasing in the constant absolute risk aversion and the variance of the volatility distribution for investors without wealth effects. We further show that for these investors a first‐order stochastic dominant shift in the volatility distribution does not necessarily increase effective risk aversion, whereas a second‐order stochastic dominant shift in the volatility does increase effective risk aversion. Finally, we examine the effect of stochastic volatility on equilibrium asset prices. We derive an explicit capital asset pricing relationship that illustrates how stochastic volatility alters equilibrium asset prices in a setting with multiple risky assets, where returns have a market factor and asset‐specific random components and multiple investor types. Copyright © 2011 John Wiley & Sons, Ltd.     

Optimal excess-of-loss reinsurance and investment problem for an insurer with jump–diffusion risk process under the Heston model

In this paper, we study the optimal excess-of-loss reinsurance and investment problem for an insurer with jump–diffusion risk model. The insurer is allowed to purchase reinsurance and invest in one risk-free asset and one risky asset whose price process satisfies the Heston model. The objective of the insurer is to maximize the expected exponential utility of terminal wealth. By applying stochastic optimal control approach, we obtain the optimal strategy and value function explicitly. In addition, a verification theorem is provided and the properties of the optimal strategy are discussed. Finally, we present a numerical example to illustrate the effects of model parameters on the optimal investment–reinsurance strategy and the optimal value function.     

随机利率及随机收益保证下的投资策略

考虑随机利率环境及随机收益保证下基金经理的投资组合问题。利用鞅方法,得到了最优投资策略的显性解。结论表明,最优投资策略包括三个部分：投机策略、利率套期保值策略以及随机收益保证的复制策略,且该最优策略等价于将一部分资金投资于确保终端时刻获得最低收益的基准组合,而剩余资金则依照无保证情况下的最优策略进行投资。     

Optimal reinsurance with positively dependent risks

In the individual risk model, one is often concerned about positively dependent risks. Several notions of positive dependence have been proposed to describe such dependent risks. In this paper, we assume that the risks in the individual risk model are positively dependent through the stochastic ordering (PDS). The PDS risks include independent, comonotonic, conditionally stochastically increasing (CI) risks, and other interesting dependent risks. By proving the convolution preservation of the convex order for PDS random vectors, we show that in individualized reinsurance treaties, to minimize certain risk measures of the retained loss of an insurer, the excess-of-loss treaty is the optimal reinsurance form for an insurer with PDS dependent risks among a general class of individualized reinsurance contracts. This extends the study in Denuit and Vermandele (1998) on individualized reinsurance treaties to dependent risks. We also derive the explicit expressions for the retentions in the optimal excess-of-loss treaty in a two-line insurance business model.     

Minimizing the weighted number of early and tardy jobs in a stochastic single machine scheduling problem

We study a static stochastic single machine scheduling problem in which jobs have random processing times with arbitrary distributions, due dates are known with certainty, and fixed individual penalties (or weights) are imposed on both early and tardy jobs. The objective is to find an optimal sequence that minimizes the expected total weighted number of early and tardy jobs. The general problem is NP-hard to solve; however, in this paper, we develop certain conditions under which the problem is solvable exactly. An efficient heuristic is also introduced to find a candidate for the optimal sequence of the general problem. Our illustrative examples and computational results demonstrate that the heuristic performs well in identifying either optimal sequences or good candidates with low errors. Furthermore, we show that special cases of the problem studied here reduce to some classical stochastic single machine scheduling problems including the problem of minimizing the expected weighted number of early jobs and the problem of minimizing the expected weighted number of tardy jobs which are both solvable by the proposed exact or heuristic methods.     

人力资本与教育的随机扰动模型

在一个带有生产扰动和公共支出扰动的随机模型中,把教育的产出--人力资本引入效用函数和生产函数,利用随机最优化方法,确定了最优经济增长率和最优个体教育投资率.通过分析参数,得出了最优税率.     

基于动态VaR约束与随机波动率模型的最优投资策略

研究Stein-Stein随机波动率模型下带动态VaR约束的最优投资组合选择问题. 假设投资者的目标是最大化终端财富的期望幂效用,可投资于无风险资产和一种风险资产, 风险资产的价格过程由Stein-Stein随机波动率模型刻画. 同时, 投资者期望能在投资过程中利用动态VaR约束控制所面对的风险.运用Bellman动态规划方法和Lagrange乘子法, 得到了该约束问题最优策略的解析式及特殊情形下最优值函数的解析式; 并通过理论分析和数值算例, 阐述了动态VaR约束与随机波动率对最优投资策略的影响.     

Stochastic optimal control of DC pension funds

In this paper, we study the portfolio problem of a pension fund manager who wants to maximize the expected utility of the terminal wealth in a complete financial market with the stochastic interest rate. Using the method of stochastic optimal control, we derive a non-linear second-order partial differential equation for the value function. As it is difficult to find a closed form solution, we transform the primary problem into a dual one by applying a Legendre transform and dual theory, and try to find an explicit solution for the optimal investment strategy under the logarithm utility function. Finally, a numerical simulation is presented to characterize the dynamic behavior of the optimal portfolio strategy.     

政府投资环保的随机增长模型

本文分析了一个带有污染的随机内生增长模型.利用随机最优化的方法,求出了最优的政府环保投资比率和最优的税收政策.并进一步得出了最优的收入税因污染的外部性指标、生产的扰动的增大而减少;而最优消费税则因这两个参数的增大而增加的结论.     

A tighter variant of Jensen’s lower bound for stochastic programs and separable approximations to recourse functions

In this paper, we propose a new method to compute lower bounds on the optimal objective value of a stochastic program and show how this method can be used to construct separable approximations to the recourse functions. We show that our method yields tighter lower bounds than Jensen’s lower bound and it requires a reasonable amount of computational effort even for large problems. The fundamental idea behind our method is to relax certain constraints by associating dual multipliers with them. This yields a smaller stochastic program that is easier to solve. We particularly focus on the special case where we relax all but one of the constraints. In this case, the recourse functions of the smaller stochastic program are one dimensional functions. We use these one dimensional recourse functions to construct separable approximations to the original recourse functions. Computational experiments indicate that our lower bounds can significantly improve Jensen’s lower bound and our recourse function approximations can provide good solutions.     

Deterministic mean-variance-optimal consumption and investment

In dynamic optimal consumption–investment problems one typically aims to find an optimal control from the set of adapted processes. This is also the natural starting point in case of a mean-variance objective. In contrast, we solve the optimization problem with the special feature that the consumption rate and the investment proportion are constrained to be deterministic processes. As a result we get rid of a series of unwanted features of the stochastic solution including diffusive consumption, satisfaction points and consistency problems. Deterministic strategies typically appear in unit-linked life insurance contracts, where the life-cycle investment strategy is age dependent but wealth independent. We explain how optimal deterministic strategies can be found numerically and present an example from life insurance where we compare the optimal solution with suboptimal deterministic strategies derived from the stochastic solution.     

An optimal regulation of a storage level with application to the water level regulation of a lake

In [10] a system of stochastic programming models was introduced for the optimal control of a storage level. Each model in this system serves to determine the optimal policy for only one period ahead though the time horizon consists of many future periods. The optimal control thus obtained can be considered an open loop control methodology. The main purpose of this paper is to present an application by giving an optimal control method for the regulation of the water level of Lake Balaton in Hungary. By solving almost 600 stochastic programming problems we analyze what would have happened if we had controlled the water level using our method between 1922 and 1970, where one decision period is one month. The numerical results show that the proposed control methodology works quite well in this case.     

The optimal harvesting problem under price uncertainty

In this paper we study the exploitation of a one species forest plantation when timber price is governed by a stochastic process. The work focuses on providing closed expressions for the optimal harvesting policy in terms of the parameters of the price process and the discount factor, with finite and infinite time horizon. We assume that harvest is restricted to mature trees older than a certain age and that growth and natural mortality after maturity are neglected. We use stochastic dynamic programming techniques to characterize the optimal policy and we model price using a geometric Brownian motion and an Ornstein–Uhlenbeck process. In the first case we completely characterize the optimal policy for all possible choices of the parameters. In the second case we provide sufficient conditions, based on explicit expressions for reservation prices, assuring that harvesting everything available is optimal. In addition, for the Ornstein–Uhlenbeck case we propose a policy based on a reservation price that performs well in numerical simulations. In both cases we solve the problem for every initial condition and the best policy is obtained endogenously, that is, without imposing any ad hoc restrictions such as maximum sustained yield or convergence to a predefined final state.     

An analytic framework to develop policies for testing, prevention, and treatment of two-stage contagious diseases

In this paper we consider healthcare policy issues for trading off resources in testing, prevention, and cure of two-stage contagious diseases. An individual that has contracted the two-stage contagious disease will initially show no symptoms of the disease but is capable of spreading it. If the initial stages are not detected which could lead to complications eventually, then symptoms start appearing in the latter stage when it would be necessary to perform expensive treatment. Under a constrained budget situation, policymakers are faced with the decision of how to allocate budget for prevention (via vaccinations), subsidizing treatment, and examination to detect the presence of initial stages of the contagious disease. These decisions need to be performed in each period of a given time horizon. To aid this decision-making exercise, we formulate a stochastic dynamic optimal control problem with feedback which can be modeled as a Markov decision process (MDP). However, solving the MDP is computationally intractable due to the large state space as the embedded stochastic network cannot be decomposed. Hence we propose an asymptotically optimal solution based on a fluid model of the dynamics in the stochastic network. We heuristically fine-tune the asymptotically optimal solution for the non-asymptotic case, and test it extensively for several numerical cases. In particular we investigate the effect of budget, length of planning horizon, type of disease, population size, and ratio of costs on the policy for budget allocation.     

Linear-quadratic efficient frontiers for portfolio optimization

Finding portfolios with given mean return and minimal lower partial mean or variance, two risk criteria of interest in the theory of optimal portfolio selection, is a stochastic linear-quadratic program that can be converted to a large-scale linear or quadratic program when the asset returns are finitely distributed. These efficient frontiers can be computed on presently available platforms for problems of reasonable size; we discuss our experience with a problem involving one thousand assets. Asymptotic statistics for stochastic programs can be applied to justify sampling as a means to approximate continuous distributions by finite distributions.     

A Type of General Forward-Backward Stochastic Differential Equations and Applications

The authors discuss one type of general forward-backward stochastic differential equations (FBSDEs) with It?o’s stochastic delayed equations as the forward equations and anticipated backward stochastic differential equations as the backward equations. The existence and uniqueness results of the general FBSDEs are obtained. In the framework of the general FBSDEs in this paper, the explicit form of the optimal control for linearquadratic stochastic optimal control problem with delay and the Nash equilibrium point for nonzero sum differential games problem with delay are obtained.     

Forward–Backward Stochastic Differential Games and Stochastic Control under Model Uncertainty

We study optimal stochastic control problems with jumps under model uncertainty. We rewrite such problems as stochastic differential games of forward–backward stochastic differential equations. We prove general stochastic maximum principles for such games, both in the zero-sum case (finding conditions for saddle points) and for the nonzero sum games (finding conditions for Nash equilibria). We then apply these results to study robust optimal portfolio-consumption problems with penalty. We establish a connection between market viability under model uncertainty and equivalent martingale measures. In the case with entropic penalty, we prove a general reduction theorem, stating that a optimal portfolio-consumption problem under model uncertainty can be reduced to a classical portfolio-consumption problem under model certainty, with a change in the utility function, and we relate this to risk sensitive control. In particular, this result shows that model uncertainty increases the Arrow–Pratt risk aversion index.