Infinite Horizon Controlled Diffusions with Randomly Varying and State-Dependent Discount Cost Rates

This work focuses on optimal controls of diffusions in an infinite horizon. It has several distinct features in contrast to the existing literature. The discount factor is allowed to be randomly varying and state dependent. The existence and uniqueness of the viscosity solution to the associated Hamilton–Jacobi–Bellman equation are established. The verification theorem is also obtained. Because closed-form solutions are virtually impossible to obtain in most cases, we develop numerical methods. Using the Markov chain approximation methods, numerical schemes are constructed; viscosity solution methods are used to prove the convergence of the algorithm. In addition, examples are given for demonstration purpose.