Stochastic dominance equilibria in two-person noncooperative games

Two-person noncooperative games with finitely many pure strategies are considered, in which the players have linear orderings over sure outcomes but incomplete preferences over probability distributions resulting from mixed strategies. These probability distributions are evaluated according to t-degree stochastic dominance. A t-best reply is a strategy that induces a t-degree stochastically undominated distribution, and a t-equilibrium is a pair of t-best replies. The paper provides a characterization and an existence proof of t-equilibria in terms of representing utility functions, and shows that for large t behavior converges to a form of max–min play. Specifically, increased aversion to bad outcomes makes each player put all weight on a strategy that maximizes the worst outcome for the opponent, within the supports of the strategies in the limiting sequence of t-equilibria.The paper has benefitted from the comments of four referees and an associate editor.     

Proper belief revision and rationalizability in dynamic games

In this paper we develop an epistemic model for dynamic games in which players may revise their beliefs about the opponents’ utility functions as the game proceeds. Within this framework, we propose a rationalizability concept that is based upon the following three principles: (1) at every instance of the game, a player should believe that his opponents are carrying out optimal strategies, (2) a player, at information set h, should not change his belief about an opponent’s relative ranking of two strategies s and s′ if both s and s′ could have led to h, and (3) the players’ initial beliefs about the opponents’ utility functions should agree on a given profile u of utility functions. Common belief in these events leads to the concept of persistent rationalizability for the profile u of utility functions. It is shown that for a given game tree with observable deviators and a given profile u of utility functions, every properly point-rationalizable strategy is a persistently rationalizable strategy for u. This result implies that persistently rationalizable strategies always exist for all game trees with observable deviators and all profiles of utility functions. We provide an algorithm that can be used to compute the set of persistently rationalizable strategies for a given profile u of utility functions. For generic games with perfect information, persistent rationalizability uniquely selects the backward induction strategy for every player.     

Efficient Winning Strategies in Random‐Turn Maker–Breaker Games

We consider random‐turn positional games, introduced by Peres, Schramm, Sheffield, and Wilson in 2007. A p‐random‐turn positional game is a two‐player game, played the same as an ordinary positional game, except that instead of alternating turns, a coin is being tossed before each turn to decide the identity of the next player to move (the probability of Player I to move is p ). We analyze the random‐turn version of several classical Maker–Breaker games such as the game Box (introduced by Chvátal and Erd?s in 1987), the Hamilton cycle game and the k‐vertex‐connectivity game (both played on the edge set of ). For each of these games we provide each of the players with a (randomized) efficient strategy that typically ensures his win in the asymptotic order of the minimum value of p for which he typically wins the game, assuming optimal strategies of both players.     

On a duel with time lag and equal accuracy functions

This paper deals with a duel with time lag that has the following structure: Each of two players I and II has a gun with one bullet and he can fire his bullet at any time in [0, 1], aiming at this opponent. The gun of player I is silent and the gun of player II is noisy with time lagt (i.e., if player II fires at timex, then player I knows it at timex+t). They both have equal accuracy functions. Furthermore, if player I hits player II without being hit himself before, the payoff is +1; if player I is hit by player II without hitting player II before, the payoff is –1; if they hit each other at the same time or both survive, the payoff is 0.This paper gives the optimal strategy for each player, the game value, and some examples.     

On the existence of good stationary strategies for nonleavable stochastic games

This paper discusses the problem regarding the existence of optimal or nearly optimal stationary strategies for a player engaged in a nonleavable stochastic game. It is known that, for these games, player I need not have an -optimal stationary strategy even when the state space of the game is finite. On the contrary, we show that uniformly -optimal stationary strategies are available to player II for nonleavable stochastic games with finite state space. Our methods will also yield sufficient conditions for the existence of optimal and -optimal stationary strategies for player II for games with countably infinite state space. With the purpose of introducing and explaining the main results of the paper, special consideration is given to a particular class of nonleavable games whose utility is equal to the indicator of a subset of the state space of the game.     

Quitting games – An example

Quitting games are multi-player sequential games in which, at every stage, each player has the choice between continuing and quitting. The game ends as soon as at least one player chooses to quit; each player i then receives a payoff r _S ⁱ, which depends on the set S of players that did choose to quit. If the game never ends, the payoff to each player is zero.? We exhibit a four-player quitting game, where the “simplest” equilibrium is periodic with period two. We argue that this implies that all known methods to prove existence of an equilibrium payoff in multi-player stochastic games are therefore bound to fail in general, and provide some geometric intuition for this phenomenon. Received: October 2001     

On a noisy-silent-versus-silent duel with equal accuracy functions

This paper deals with the noisy-silent-versus-silent duel with equal accuracy functions. Player I has a gun with two bullets and player II has a gun with one bullet. The first bullet of player I is noisy, the second bullet of player I is silent, and the bullet of player II is silent. Each player can fire their bullets at any time in [0, 1] aiming at his opponent. The accuracy function ist for both players. If player I hits player II, not being hit himself before, the payoff of the duel is +1; if player I is hit by player II, not hitting player II before, the payoff is –1. The optimal strategies and the value of the game are obtained. Although optimal strategies in past works concerning games of timing does not depend on the firing moments of the players, the optimal strategy obtained for player II depends explicitly on the firing moment of player I's noisy bullet.     

Stochastic Differential Games with Multiple Modes and a Small Parameter

Abstract

Two persons stochastic differential games with multiple modes where the system is driven by a wideband noise is considered. The state of the system at time t is given by a pair (x ^ε(t), θ^ε(t)), where θ^ε(t) takes values in S = {1, 2,…, N} and ε is a small parameter. The discrete component θ^ε(t) describes various modes of the system. The continuous component x ^ε(t) is governed by a “controlled process” with drift vector which depends on the discrete component θ^ε (t). Thus, the state of the system, x ^ε(t), switches from one random path to another at random times as the mode θ^ε(t) changes. The discrete component θ^ε (t) is a “controlled Markov chain” with transition rate matrix depending on the continuous component. Both zero-sum and nonzero-sum games will be considered. In a zero-sum game, player I is trying to maximize certain expected payoff over his/her admissible strategies, where as player II is trying to minimize the same over his/her admissible strategies. This kind of game typically occurs in a pursuit-evation problem where an interceptor tries to destroy a specific target. Due to swift manuaring of the evador and the corresponding reaction by the interceptor, the trajectory keep switching rapidly at random times. We will show that the process (x ^ε(t), θ^ε(t)) converges to a process whose evolution is given by a “controlled diffusion process” with switching random paths. We will also establish the existence of randomized δ -optimal strategies for both players.     

Preferred coalitions in cooperative differential games

There are many interesting situations which can be described by anN-person general-sum differential game. Such games are characterized by the fact that the strategy of each player depends upon reasonable assumptions about the strategies of the remaining players; and, thus, these games cannot be considered asN uncoupled optimal control problems. In such cases, we say that the game is not strictly competitive, but involves a mutual interest which makes it possible for all of the players to reduce their costs by cooperating with one another, provided the resulting agreement can be enforced. When cooperation is allowed and there are more than two players, there is always the question of whether all possible subcoalitions will be formed with equal ease. This work considers the situation in which a particular subcoalition is preferred. A theory of general-sum games with preferred coalitions is presented, together with constructive examples of alternative approaches which are unsatisfactory.     

Convex semi-infinite games

This paper introduces a generalization of semi-infinite games. The pure strategies for player I involve choosing one function from an infinite family of convex functions, while the set of mixed strategies for player II is a closed convex setC inR ⁿ. The minimax theorem applies under a condition which limits the directions of recession ofC. Player II always has optimal strategies. These are shown to exist for player I also if a certain infinite system verifies the property of Farkas-Minkowski. The paper also studies certain conditions that guarantee the finiteness of the value of the game and the existence of optimal pure strategies for player I.Many thanks are due to the referees for their detailed comments.     

Two-noisy-versus-one-silent duel with equal accuracy functions

This paper deals with the two-noisy-versus-one-silent duel which is still open, as pointed out by Styszyński (Ref. 1). Player I has a noisy gun with two bullets, and player II has a silent gun with one bullet. Each player fires his bullets aiming at his opponent at any time in [0, 1]. The accuracy function (the probability that one player hits his opponent if he fires at timet) isp(t)=t for each player. If player I hits player II, without being hit himself before, the payoff of the duel is +1; if player I is hit by player II, without hitting player II before, the payoff is taken to be ?1. In this paper, we determine the optimal strategies and the value of the game. The strategy for player II depends explicitly on the firing moment of player I's first shot.     

On stochastic games with additive reward and transition structure

In this paper, we introduce a new class of two-person stochastic games with nice properties. For games in this class, the payoffs as well as the transitions in each state consist of a part which depends only on the action of the first player and a part dependent only on the action of the second player.For the zero-sum games in this class, we prove that the orderfield property holds in the infinite-horizon case and that there exist optimal pure stationary strategies for the discounted as well as the undiscounted payoff criterion. For both criteria also, finite algorithms are given to solve the game. An example shows that, for nonzero sum games in this class, there are not necessarily pure stationary equilibria. But, if such a game possesses a stationary equilibrium point, then there also exists a stationary equilibrium point which uses in each state at most two pure actions for each player.     

Static search games played over graphs and general metric spaces

We define a general game which forms a basis for modelling situations of static search and concealment over regions with spatial structure. The game involves two players, the searching player and the concealing player, and is played over a metric space. Each player simultaneously chooses to deploy at a point in the space; the searching player receiving a payoff of 1 if his opponent lies within a predetermined radius r of his position, the concealing player receiving a payoff of 1 otherwise. The concepts of dominance and equivalence of strategies are examined in the context of this game, before focusing on the more specific case of the game played over a graph. Methods are presented to simplify the analysis of such games, both by means of the iterated elimination of dominated strategies and through consideration of automorphisms of the graph. Lower and upper bounds on the value of the game are presented and optimal mixed strategies are calculated for games played over a particular family of graphs.     

Feedback strategies with finite memory in differential games

It is shown that, in differential games, strategies can be defined for the players in such a way that their controls depend, for each timet, on a finite section of the past of the trajectoryx(t). In particular,s-delay,r-memory strategies can be defined as in the Varaiya-Lin approach. It is shown that, for deterministic differential games with terminal payoff, the upper and lower values of the game so defined, are independent of the lengthr of the memory. Lettingr 0, a feedback strategy is obtained which depends only on the present (and infinitesimal past) of the trajectoryx(t).     

Probabilities of Pure Nash Equilibria in Matrix Games when the Payoff Entries of One Player Are Randomly Selected

The Nash equilibrium in pure strategies represents an important solution concept in nonzero sum matrix games. Existence of Nash equilibria in games with known and with randomly selected payoff entries have been studied extensively. In many real games, however, a player may know his own payoff entries but not the payoff entries of the other player. In this paper, we consider nonzero sum matrix games where the payoff entries of one player are known, but the payoff entries of the other player are assumed to be randomly selected. We are interested in determining the probabilities of existence of pure Nash equilibria in such games. We characterize these probabilities by first determining the finite space of ordinal matrix games that corresponds to the infinite space of matrix games with random entries for only one player. We then partition this space into mutually exclusive spaces that correspond to games with no Nash equilibria and with r Nash equilibria. In order to effectively compute the sizes of these spaces, we introduce the concept of top-rated preferences minimal ordinal games. We then present a theorem which provides a mechanism for computing the number of games in each of these mutually exclusive spaces, which then can be used to determine the probabilities. Finally, we summarize the results by deriving the probabilities of existence of unique, nonunique, and no Nash equilibria, and we present an illustrative example.     

Correlated equilibrium payoffs and public signalling in absorbing games

An absorbing game is a repeated game where some action combinations are absorbing, in the sense that whenever they are played, there is a positive probability that the game terminates, and the players receive some terminal payoff at every future stage.  We prove that every multi-player absorbing game admits a correlated equilibrium payoff. In other words, for every ε>0 there exists a probability distribution p _ε over the space of pure strategy profiles that satisfies the following. With probability at least 1−ε, if a pure strategy profile is chosen according to p _ε and each player is informed of his pure strategy, no player can profit more than ε in any sufficiently long game by deviating from the recommended strategy. Received: April 2001/Revised: June 4, 2002     

On pure conjectural equilibrium with non-manipulable information

An information structure in a non-cooperative game determines the signal that each player observes as a function of the strategy profile. Such information structure is called non-manipulable if no player can gain new information by changing his strategy. A Conjectural Equilibrium (CE) (Battigalli in Unpublished undergraduate dissertation, 1987; Battigalli and Guaitoli 1988; Decisions, games and markets, 1997) with respect to a given information structure is a strategy profile in which each player plays a best response to his conjecture about his opponents’ play and his conjecture is not contradicted by the signal he observes. We provide a sufficient condition for the existence of pure CE in games with a non-manipulable information structure. We then apply this condition to prove existence of pure CE in two classes of games when the information that players have is the distribution of strategies in the population. This work is based on a chapter from my Ph.D. dissertation written at the School of Mathematical Sciences of Tel-Aviv University under the supervision of Prof. Ehud Lehrer. I am grateful to Ehud Lehrer as well as to Pierpaolo Battigalli, Yuval Heller, two anonymous referees, an Associate Editor and the Editor for very helpful comments and references.     

The diameter game

A large class of Positional Games are defined on the complete graph on n vertices. The players, Maker and Breaker, take the edges of the graph in turns, and Maker wins iff his subgraph has a given — usually monotone — property. Here we introduce the d‐diameter game, which means that Maker wins iff the diameter of his subgraph is at most d. We investigate the biased version of the game; i.e., when the players may take more than one, and not necessarily the same number of edges, in a turn. Our main result is that we proved that the 2‐diameter game has the following surprising property: Breaker wins the game in which each player chooses one edge per turn, but Maker wins as long as he is permitted to choose 2 edges in each turn whereas Breaker can choose as many as (1/9)n^1/8/(lnn)^3/8. In addition, we investigate d‐diameter games for d ≥ 3. The diameter games are strongly related to the degree games. Thus, we also provide a generalization of the fair degree game for the biased case. © 2009 Wiley Periodicals, Inc. Random Struct. Alg., 2009     

Numerical solutions to coupled-constraint (or generalised Nash) equilibrium problems

This paper is about games where the agents face constraints in the combined strategy space (unlike in standard games where the action sets are defined separately for each player) and about computational methods for solutions to such games. The motivation examples for such games include electricity generation problems with transmission capacity constraints, environmental management to control pollution and internet switching to comply to buffers of bounded capacity. In each such problem a regulator may aim at compliance to standards or quotas through taxes or charges. The relevant solution concept for these games has been known under several names like generalised Nash equilibrium, coupled constraint equilibrium and more. Existing numerical methods converging to such an equilibrium will be explained. Application examples of use of NIRA, which is a suite of Matlab routines that implement one of the methods, will be provided.      

Existence of optimal strategies in Markov games with incomplete information

The existence of a value and optimal strategies is proved for the class of two-person repeated games where the state follows a Markov chain independently of players’ actions and at the beginning of each stage only Player 1 is informed about the state. The results apply to the case of standard signaling where players’ stage actions are observable, as well as to the model with general signals provided that Player 1 has a nonrevealing repeated game strategy. The proofs reduce the analysis of these repeated games to that of classical repeated games with incomplete information on one side. This research was supported in part by Israeli Science Foundation grants 382/98, 263/03, and 1123/06, and by the Zvi Hermann Shapira Research Fund.