On the structure of the optimal server control for fluid networks

This paper derives the optimal trajectories in a general fluid network with server control. The stationary optimal policy in the complete state space is constructed. The optimal policy is constant on polyhedral convex cones. An algorithm is derived that computes these cones and the optimal policy. Generalized Klimov indices are introduced, they are used for characterizing myopic and time-uniformly optimal policies.Received: November 2004 / Revised: February 2005The research of this author has been supported by the project ‘‘Stochastic Networks’’ of the Netherlands Organisation for Scientific Research NWO.     

Fluid approximation of a controlled multiclass tandem network

A two-station, four-class queueing network with dynamic scheduling of servers is analyzed. It is shown that the corresponding Markov decision problem converges under fluid scaling to a fluid optimal control model. The structure of the optimal policy for the fluid network, and of an asymptotically optimal policy for the queueing network are derived in an explicit form. They concur with the tandem μ-rule, if this policy gives priority to the same flow of customers in both stations. In general, they are monotone with a linear switching surface. This revised version was published online in June 2006 with corrections to the Cover Date.