Stochastic games with two non-absorbing states

In the present paper we consider recursive games that satisfy an absorbing property defined by Vieille. We give two sufficient conditions for existence of an equilibrium payoff in such games, and prove that if the game has at most two non-absorbing states, then at least one of the conditions is satisfied. Using a reduction of Vieille, we conclude that every stochastic game which has at most two non-absorbing states admits an equilibrium payoff. This paper is part of the Ph.D. thesis of the author completed under the supervision of Prof. Abraham Neyman at the Hebrew University of Jerusalem. I would like to thank Prof. Neyman for many discussions and ideas and for the continuous help he offered. I also thank Nicolas Vieille for his comments on earlier versions of the paper.