Real-time decision problems: an operational research perspective

This paper is concerned with a class of dynamic and stochastic problems known as real-time decision problems. The objective is to provide responses of a required quality in a continuously evolving environment, within a prescribed time frame, using limited resources and information that is often incomplete or uncertain. Furthermore, the outcome of any particular decision may also be uncertain. This paper provides an overview of this class of problems, reviews the relevant Artificial Intelligence literature, proposes a dynamic programming framework, and assesses the potential usefulness of Operational Research approaches for their solution. Throughout the paper, a vehicle dispatching application illustrates the relevant concepts.