A Vector Minimum Superharmonic Approach to Solving Infinite-Horizon Discounted Markov Decision Processes

In this paper a new algorithm is provided for obtaining approximately optimal policies for infinite-horizon discounted Markov decision processes. In addition, some of the properties of the algorithm are established. The algorithm is based upon the fact that the optimal value function is the unique vector minimum function within the superharmonic set.