Randomized stopping games and Markov market games

We study nonzero-sum stopping games with randomized stopping strategies. The existence of Nash equilibrium and ɛ-equilibrium strategies are discussed under various assumptions on players random payoffs and utility functions dependent on the observed discrete time Markov process. Then we will present a model of a market game in which randomized stopping times are involved. The model is a mixture of a stochastic game and stopping game. Research supported by grant PBZ-KBN-016/P03/99.     

A BSDE approach to Nash equilibrium payoffs for stochastic differential games with nonlinear cost functionals

In this paper, we study Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games via the theory of backward stochastic differential equations. We obtain an existence theorem and a characterization theorem of Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games with nonlinear cost functionals defined with the help of doubly controlled backward stochastic differential equations. Our results extend former ones by Buckdahn et al. (2004) [3] and are based on a backward stochastic differential equation approach.     

Nondominated equilibrium solutions of a multiobjective two-person nonzero-sum game in extensive form and corresponding mathematical programming problem

In most of studies on multiobjective noncooperative games, games are represented in normal form and a solution concept of Pareto equilibrium solutions which is an extension of Nash equilibrium solutions has been focused on. However, for analyzing economic situations and modeling real world applications, we often see cases where the extensive form representation of games is more appropriate than the normal form representation. In this paper, in a multiobjective two-person nonzero-sum game in extensive form, we employ the sequence form of strategy representation to define a nondominated equilibrium solution which is an extension of a Pareto equilibrium solution, and provide a necessary and sufficient condition that a pair of realization plans, which are strategies of players in sequence form, is a nondominated equilibrium solution. Using the necessary and sufficient condition, we formulate a mathematical programming problem yielding nondominated equilibrium solutions. Finally, giving a numerical example, we demonstrate that nondominated equilibrium solutions can be obtained by solving the formulated mathematical programming problem.     

On nash equilibrium solutions in nonzero-sum stochastic games with complete information

Two-person nonzero-sum stochastic games with complete information are considered. It is shown that it is sufficient to search the equilibrium solutions in a class of deterministic strategy pairs — the so-calledintimidation strategy pairs. Furthermore, properties of the set of all equilibrium losses of such strategy pairs are proved.     

Existence and uniqueness of a Nash equilibrium feedback for a simple nonzero-sum differential game

Existence and uniqueness of a Nash equilibrium feedback is established for a simple class nonzero-sum differential games on the line.     

Remarks on sensitive equilibria in stochastic games with additive reward and transition structure

A class of stochastic games with additive reward and transition structure is studied. For zero-sum games under some ergodicity assumptions 1-equilibria are shown to exist. They correspond to so-called sensitive optimal policies in dynamic programming. For a class of nonzero-sum stochastic games with nonatomic transitions nonrandomized Nash equilibrium points with respect to the average payoff criterion are also obtained. Included examples show that the results of this paper can not be extented to more general payoff or transition structure.     

On stochastic games in economics

In this paper we show that many results on equilibria in stochastic games arising from economic theory can be deduced from the theorem on the existence of a correlated equilibrium due to Nowak and Raghavan. Some new classes of nonzero-sum Borel state space discounted stochastic games having stationary Nash equilibria are also presented. Three nontrivial examples of dynamic stochastic games arising from economic theory are given closed form solutions. Research partially supported by MNSW grant 1 P03A 01030.     

Nonzero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates

This paper attempts to study two-person nonzero-sum games for denumerable continuous-time Markov chains determined by transition rates,with an expected average criterion.The transition rates are allowed to be unbounded,and the payoff functions may be unbounded from above and from below.We give suitable conditions under which the existence of a Nash equilibrium is ensured.More precisely,using the socalled "vanishing discount" approach,a Nash equilibrium for the average criterion is obtained as a limit point of a sequence of equilibrium strategies for the discounted criterion as the discount factors tend to zero.Our results are illustrated with a birth-and-death game.     

Average stochastic games for continuous-time jump processes

We consider nonzero-sum games for continuous-time jump processes with unbounded transition rates under expected average payoff criterion. The state and action spaces are Borel spaces and reward rates are unbounded. We introduce an approximating sequence of stochastic game models with extended state space, for which the uniform exponential ergodicity is obtained. Moreover, we prove the existence of a stationary almost Markov Nash equilibrium by introducing auxiliary static game models. Finally, a cash flow model is employed to illustrate the results.     

A maximum principle for Markov regime-switching forward–backward stochastic differential games and applications

In this paper, we present an optimal control problem for stochastic differential games under Markov regime-switching forward–backward stochastic differential equations with jumps. First, we prove a sufficient maximum principle for nonzero-sum stochastic differential games problems and obtain equilibrium point for such games. Second, we prove an equivalent maximum principle for nonzero-sum stochastic differential games. The zero-sum stochastic differential games equivalent maximum principle is then obtained as a corollary. We apply the obtained results to study a problem of robust utility maximization under a relative entropy penalty and to find optimal investment of an insurance firm under model uncertainty.     

Solution concepts in continuous-kernel multicriteria games

This paper considers nonzero-sum multicriteria games with continuous kernels. Solution concepts based on the notions of Pareto optimality, equilibrium, and security are extended to these games. Separate necessary and sufficient conditions and existence results are presented for equilibrium, Pareto-optimal response, and Pareto-optimal security strategies of the players.This paper is based partially on research supported by the Council of Scientific and Industrial Research, India, through a Research Associateship Grant to the first author.The authors are grateful to two anonymous referees for suggesting useful changes and pointing out some errors in a previous draft.     

An exponential differential game which admits a simple Nash solution

This paper deals with a class ofN-person nonzero-sum differential games where the control variables enter into the state equations as well as the payoff functionals in an exponential way. Due to the structure of the game, Nash-optimal controls are easily determined. The equilibrium in open-loop controls is also a closed-loop equilibrium. An example of optimal exploitation of an exhaustible resource is presented.The helpful comments of Professor Y. C. Ho and Dipl. Ing. E. Dockner are gratefully acknowledged.     

Periodic stopping games

Stopping games (without simultaneous stopping) are sequential games in which at every stage one of the players is chosen, who decides whether to continue the interaction or stop it, whereby a terminal payoff vector is obtained. Periodic stopping games are stopping games in which both of the processes that define it, the payoff process as well as the process by which players are chosen, are periodic and do not depend on the past choices. We prove that every periodic stopping game without simultaneous stopping, has either periodic subgame perfect ϵ-equilibrium or a subgame perfect 0-equilibrium in pure strategies. This work is part of the master thesis of the author done under the supervision of Prof. Eilon Solan. I am thankful to Prof. Solan for his inspiring guidance. I also thank two anonymous referees of the International Journal of Game Theory for their comments.     

Stochastic Games with Average Payoff Criterion

We study two-person stochastic games on a Polish state and compact action spaces and with average payoff criterion under a certain ergodicity condition. For the zero-sum game we establish the existence of a value and stationary optimal strategies for both players. For the nonzero-sum case the existence of Nash equilibrium in stationary strategies is established under certain separability conditions. Accepted 9 January 1997     

On Nash equilibrium points and games of imperfect information

This paper considers a class of two-player, nonzero-sum games in which the players have only local, as opposed to global, information about the payoff functions. We study various modes of behavior and their relationship to different stability properties of the Nash equilibrium points.     

Qualitative analysis of secured outcome regions for two-target games

Qualitative (game of kind) outcomes of two-target games are analyzed in this paper, under both the zero-sum and nonzero-sum preference ordering of outcomes by the players. The outcome regions of each player are defined from a security standpoint. The secured draw and mutual-kill regions of a player depend explicitly on his preference ordering of outcomes and should be constructed separately for each player, especially in a nonzero-sum game. General guidelines are presented for identifying the secured outcome regions of players in a class of two-target games that satisfy an Isaacs-like condition, in terms of the qualitative solutions of the two underlying single-target pursuit-evasion games. A construction has been proposed for obtaining the qualitative solution of a large class of two-target games. Illustrative examples are included.This work was done while the first author was a Research Associate in the Department of Electrical Engineering at the Indian Institute of Science, Bangalore, and was financially supported by the Council of Scientific and Industrial Research, Delhi, India.     

On a class of nonzero-sum,linear-quadratic differential games

A class of two-player, nonzero-sum, linear-quadratic differential games is investigated for Nash equilibrium solutions when both players use closed-loop control and when one or both of the players are required to use open-loop control. For three formulations of the game, necessary and sufficient conditions are obtained for a particular strategy set to be a Nash equilibrium strategy set. For a fourth formulation of the game, where both players use open-loop control, necessary and sufficient conditions for the existence of a Nash equilibrium strategy set are developed. Several examples are presented in order to illustrate the differences between this class of differential games and its zero-sum analog.This research was supported by the National Science Foundation under Grant No. GK-3341.     

On nonunique closed-loop Nash equilibria for a class of differential games with a unique and degenerated feedback solution

In this paper, we derive essentially nonunique closed-loop Nash equilibria for a class of nonzero-sum differential games with a unique and degenerated feedback Nash equilibrium.     

Maximum principle for differential games of forward–backward stochastic systems with applications

This paper is concerned with a maximum principle for both zero-sum and nonzero-sum games. The most distinguishing feature, compared with the existing literature, is that the game systems are described by forward–backward stochastic differential equations. This kind of games is motivated by linear-quadratic differential game problems with generalized expectation. We give a necessary condition and a sufficient condition in the form of maximum principle for the foregoing games. Finally, an example of a nonzero-sum game is worked out to illustrate that the theories may find interesting applications in practice. In terms of the maximum principle, the explicit form of an equilibrium point is obtained.     

Sensitive equilibria for ergodic stochastic games with countable state spaces

We consider stochastic games with countable state spaces and unbounded immediate payoff functions. Our assumptions on the transition structure of the game are based on a recent work by Meyn and Tweedie [19] on computable bounds for geometric convergence rates of Markov chains. The main results in this paper concern the existence of sensitive optimal strategies in some classes of zero-sum stochastic games. By sensitive optimality we mean overtaking or 1-optimality. We also provide a new Nash equilibrium theorem for a class of ergodic nonzero-sum stochastic games with denumerable state spaces.