Maximum Principle for Risk-Sensitive Stochastic Optimal Control Problem and Applications to Finance

This article is concerned with a risk-sensitive stochastic optimal control problem motivated by a kind of optimal portfolio choice problem in the financial market. The maximum principle for this kind of problem is obtained, which is similar in form to its risk-neutral counterpart. But the adjoint equations and maximum condition heavily depend on the risk-sensitive parameter. This result is used to solve a kind of optimal portfolio choice problem and the optimal portfolio choice strategy is obtained. Computational results and figures explicitly illustrate the optimal solution and the sensitivity to the volatility rate parameter.     

The maximum principles for partially observed risk-sensitive optimal controls of Markov regime-switching jump-diffusion system

ABSTRACT

This paper studies partially observed risk-sensitive optimal control problems with correlated noises between the system and the observation. It is assumed that the state process is governed by a continuous-time Markov regime-switching jump-diffusion process and the cost functional is of an exponential-of-integral type. By virtue of a classical spike variational approach, we obtain two general maximum principles for the aforementioned problems. Moreover, under certain convexity assumptions on both the control domain and the Hamiltonian, we give a sufficient condition for the optimality. For illustration, a linear-quadratic risk-sensitive control problem is proposed and solved using the main results. As a natural deduction, a fully observed risk-sensitive maximum principle is also obtained and applied to study a risk-sensitive portfolio optimization problem. Closed-form expressions for both the optimal portfolio and the corresponding optimal cost functional are obtained.     

General Maximum Principles for Partially Observed Risk-Sensitive Optimal Control Problems and Applications to Finance

This paper is concerned with partially observed risk-sensitive optimal control problems. Combining Girsanov’s theorem with a standard spike variational technique, we obtain some general maximum principles for the aforementioned problems. One of the distinctive differences between our results and the standard risk-neutral case is that the adjoint equations and variational inequalities strongly depend on a risk-sensitive parameter γ. Two examples are given to illustrate the applications of the theoretical results obtained in this paper. As a natural deduction, a general maximum principle is also obtained for a fully observed risk-sensitive case. At last, this result is applied to study a risk-sensitive optimal portfolio problem. An explicit optimal investment strategy and a cost functional are obtained. A numerical simulation result shows the influence of a risk-sensitive parameter on an optimal investment proportion; this coincides with its economic meaning and theoretical results. This work was partially supported by the National Natural Science Foundation (10671112), the National Basic Research Program of China (973 Program, No. 2007CB814904), the Natural Science Foundation of Shandong Province (Z2006A01) and the Doctoral Fund of the Education Ministry of China.     

Sufficient Stochastic Maximum Principle for the Optimal Control of Semi-Markov Modulated Jump-Diffusion with Application to Financial Optimization

The finite state semi-Markov process is a generalization over the Markov chain in which the sojourn time distribution is any general distribution. In this article, we provide a sufficient stochastic maximum principle for the optimal control of a semi-Markov modulated jump-diffusion process in which the drift, diffusion, and the jump kernel of the jump-diffusion process is modulated by a semi-Markov process. We also connect the sufficient stochastic maximum principle with the dynamic programming equation. We apply our results to finite horizon risk-sensitive control portfolio optimization problem and to a quadratic loss minimization problem.     

Risk-sensitive portfolio optimization on infinite time horizon

We consider a continuous time portfolio optimization problems on an infinite time horizon for a factor model, recently treated by Bielecki and Pliska ["Risk-sensitive dynamic asset management", Appl. Math. Optim. , 39 (1990) 337-360], where the mean returns of individual securities or asset categories are explicitly affected by economic factors. The factors are assumed to be Gaussian processes. We see new features in constructing optimal strategies for risk-sensitive criteria of the portfolio optimization on an infinite time horizon, which are obtained from the solutions of matrix Riccati equations.     

Existence of Risk-Sensitive Optimal Stationary Policies for Controlled Markov Processes

In this paper we are concerned with the existence of optimal stationary policies for infinite-horizon risk-sensitive Markov control processes with denumerable state space, unbounded cost function, and long-run average cost. Introducing a discounted cost dynamic game, we prove that its value function satisfies an Isaacs equation, and its relationship with the risk-sensitive control problem is studied. Using the vanishing discount approach, we prove that the risk-sensitive dynamic programming inequality holds, and derive an optimal stationary policy. Accepted 1 October 1997     

Portfolio Optimization in a Semi-Markov Modulated Market

We address a portfolio optimization problem in a semi-Markov modulated market. We study both the terminal expected utility optimization on finite time horizon and the risk-sensitive portfolio optimization on finite and infinite time horizon. We obtain optimal portfolios in relevant cases. A numerical procedure is also developed to compute the optimal expected terminal utility for finite horizon problem. This work was supported in part by a DST project: SR/S4/MS: 379/06; also supported in part by a grant from UGC via DSA-SAP Phase IV, and in part by a CSIR Fellowship.     

Risk-Sensitive Control with Near Monotone Cost

The infinite horizon risk-sensitive control problem for non-degenerate controlled diffusions is analyzed under a ‘near monotonicity’ condition on the running cost that penalizes large excursions of the process.     

Erratum to: Risk-Sensitive Control with Near Monotone Cost

The infinite horizon risk-sensitive control problem for non-degenerate controlled diffusions is analyzed under a ‘near monotonicity’ condition on the running cost that penalizes large excursions of the process.     

Risk-Sensitive Dynamic Asset Management

This paper develops a continuous time portfolio optimization model where the mean returns of individual securities or asset categories are explicitly affected by underlying economic factors such as dividend yields, a firm's return on equity, interest rates, and unemployment rates. In particular, the factors are Gaussian processes, and the drift coefficients for the securities are affine functions of these factors. We employ methods of risk-sensitive control theory, thereby using an infinite horizon objective that is natural and features the long run expected growth rate, the asymptotic variance, and a single risk-aversion parameter. Even with constraints on the admissible trading strategies, it is shown that the optimal trading strategy has a simple characterization in terms of the factor levels. For particular factor levels, the optimal trading positions can be obtained as the solution of a quadratic program. The optimal objective value, as a function of the risk-aversion parameter, is shown to be the solution of a partial differential equation. A simple asset allocation example, featuring a Vasicek-type interest rate which affects a stock index and also serves as a second investment opportunity, provides some additional insight about the risk-sensitive criterion in the context of dynamic asset management. Accepted 10 December 1997     

Risk-Sensitive Portfolio Optimization Problems with Fixed Income Securities

We discuss a class of risk-sensitive portfolio optimization problems. We consider the portfolio optimization model investigated by Nagai (SIAM J. Control Optim. 41:1779–1800, 2003). The model by its nature can include fixed income securities as well in the portfolio. Under fairly general conditions, we prove the existence of an optimal portfolio in both finite-horizon and infinite-horizon problems.     

Composition of an efficient portfolio in the Bielecki and Pliska market model

We study the continuous time portfolio optimization model due to Bielecki and Pliska where the mean returns of individual securities or asset categories are explicitly affected by underlying economic factors. We introduce the functional Q _γ featuring the expected earnings yield of portfolio minus a penalty term proportional with a coefficient γ to the variance when we keep the value of the factor levels fixed. The coefficient γ plays the role of a risk-aversion parameter. We find the optimal trading positions that can be obtained as the solution to a maximization problem for Q _γ at any moment of time. The single-factor case is analyzed in more details. We present a simple asset allocation example featuring a Vasicek-type interest rate which affects a stock index and also serves as a second investment opportunity. Then we compare our results with the theory of Bielecki and Pliska where the authors employ the methods of the risk-sensitive control theory thereby using an infinite horizon objective featuring the long run expected growth rate, the asymptotic variance, and a risk-aversion parameter similar to γ.     

Risk-sensitive average continuous-time Markov decision processes with unbounded rates

Abstract

In this paper we study the risk-sensitive average cost criterion for continuous-time Markov decision processes in the class of all randomized Markov policies. The state space is a denumerable set, and the cost and transition rates are allowed to be unbounded. Under the suitable conditions, we establish the optimality equation of the auxiliary risk-sensitive first passage optimization problem and obtain the properties of the corresponding optimal value function. Then by a technique of constructing the appropriate approximating sequences of the cost and transition rates and employing the results on the auxiliary optimization problem, we show the existence of a solution to the risk-sensitive average optimality inequality and develop a new approach called the risk-sensitive average optimality inequality approach to prove the existence of an optimal deterministic stationary policy. Furthermore, we give some sufficient conditions for the verification of the simultaneous Doeblin condition, use a controlled birth and death system to illustrate our conditions and provide an example for which the risk-sensitive average optimality strict inequality occurs.     

Risk-adjusted probability measures in portfolio optimization with coherent measures of risk

We consider the problem of optimizing a portfolio of n assets, whose returns are described by a joint discrete distribution. We formulate the mean–risk model, using as risk functionals the semideviation, deviation from quantile, and spectral risk measures. Using the modern theory of measures of risk, we derive an equivalent representation of the portfolio problem as a zero-sum matrix game, and we provide ways to solve it by convex optimization techniques. In this way, we reconstruct new probability measures which constitute part of the saddle point of the game. These risk-adjusted measures always exist, irrespective of the completeness of the market. We provide an illustrative example, in which we derive these measures in a universe of 200 assets and we use them to evaluate the market portfolio and optimal risk-averse portfolios.     

A review of credibilistic portfolio selection

This paper reviews the credibilistic portfolio selection approaches which deal with fuzzy portfolio selection problem based on credibility measure. The reason for choosing credibility measure is given. Several mathematical definitions of risk of an investment in the portfolio are introduced. Some credibilistic portfolio selection models are presented, including mean-risk model, mean-variance model, mean-semivariance model, credibility maximization model, α-return maximization model, entropy optimization model and game models. A hybrid intelligent algorithm for solving the optimization models is documented. In addition, as extensions of credibilistic portfolio selection approaches, the paper also gives a brief review of some hybrid portfolio selection models.     

基于DEA博弈交叉效率和投资者心理的模糊投资组合研究

考虑到投资者并不是完全理性的,本文结合DEA博弈交叉效率方法研究了带有投资者心理因素的多目标模糊投资组合决策问题。首先,为了充分描绘投资者的心理因素和风险感知,本文基于可能性理论推导了带有风险态度的可能性均值和半绝对偏差。其次,将候选的风险资产视为互相竞争的博弈者,采用基于熵权法的DEA博弈交叉效率模型衡量它们的综合表现,从而得到每项资产的博弈交叉效率和奇异指数,并将其分别作为额外的收益和风险决策准则。基于此,提出了更加综合的可能性均值—半绝对偏差—博弈交叉效率—奇异指数模型。最后,通过一个应用实例验证了所提出的模型的合理性和有效性,从而为不同类型的投资者提供具有个性化的投资策略。     

Stochastic differential portfolio games for an insurer in a jump-diffusion risk process

We discuss an optimal portfolio selection problem of an insurer who faces model uncertainty in a jump-diffusion risk model using a game theoretic approach. In particular, the optimal portfolio selection problem is formulated as a two-person, zero-sum, stochastic differential game between the insurer and the market. There are two leader-follower games embedded in the game problem: (i) The insurer is the leader of the game and aims to select an optimal portfolio strategy by maximizing the expected utility of the terminal surplus in the “worst-case” scenario; (ii) The market acts as the leader of the game and aims to choose an optimal probability scenario to minimize the maximal expected utility of the terminal surplus. Using techniques of stochastic linear-quadratic control, we obtain closed-form solutions to the game problems in both the jump-diffusion risk process and its diffusion approximation for the case of an exponential utility.     

Risk Sensitive Control of Diffusions with Small Running Cost

Infinite horizon risk-sensitive control of diffusions is analyzed under a stability condition coupled with a bound on the running cost. It is shown that the corresponding Hamilton-Jacobi-Bellman equation has a solution (w(⋅),λ ^∗) where the scalar λ ^∗ is in fact the optimal cost. This also leads to an existence result for optimal controls.     

Optimal exit probabilities and differential games

The problem considered is to control the drift of a Markov diffusion process in such a way that the probability that the process exits from a given regionD during a given finite time interval is minimum. An asymptotic formula for the minimum exit probability when the process is nearly deterministic is given. This formula involves the lower value of an associated differential game. It is related to a result of Ventsel and Freidlin for nearly deterministic, uncontrolled diffusions.This research was supported in part by the Air Force Office of Scientific Research under AF-AFOSR 76-3063C and in part by the National Science Foundation, NSF-76-07261.     

Particle swarm optimization approach to portfolio optimization

The survey of the relevant literature showed that there have been many studies for portfolio optimization problem and that the number of studies which have investigated the optimum portfolio using heuristic techniques is quite high. But almost none of these studies deals with particle swarm optimization (PSO) approach. This study presents a heuristic approach to portfolio optimization problem using PSO technique. The test data set is the weekly prices from March 1992 to September 1997 from the following indices: Hang Seng in Hong Kong, DAX 100 in Germany, FTSE 100 in UK, S&P 100 in USA and Nikkei in Japan. This study uses the cardinality constrained mean-variance model. Thus, the portfolio optimization model is a mixed quadratic and integer programming problem for which efficient algorithms do not exist. The results of this study are compared with those of the genetic algorithms, simulated annealing and tabu search approaches. The purpose of this paper is to apply PSO technique to the portfolio optimization problem. The results show that particle swarm optimization approach is successful in portfolio optimization.