Forecast Horizon for a Class of Dynamic Games

In theory, a Markov perfect equilibrium of an infinite-horizon nonstationary dynamic game requires from the players the ability to forecast an infinite amount of data. In this paper, we prove that early strategic decisions are decoupled effectively from the tail game in nonstationary dynamic games with discounting and uniformly bounded rewards. This decoupling is formalized by the notion of a forecast horizon. In words, the first-period equilibrium strategies are invariant with respect to changes in the game parameters for periods beyond the forecast horizon. We illustrate our results in the context of dynamic games of exploitation of a common pool resource and make use of the rather natural monotonicity properties of finite-horizon equilibria.     

Periodic stopping games

Stopping games (without simultaneous stopping) are sequential games in which at every stage one of the players is chosen, who decides whether to continue the interaction or stop it, whereby a terminal payoff vector is obtained. Periodic stopping games are stopping games in which both of the processes that define it, the payoff process as well as the process by which players are chosen, are periodic and do not depend on the past choices. We prove that every periodic stopping game without simultaneous stopping, has either periodic subgame perfect ϵ-equilibrium or a subgame perfect 0-equilibrium in pure strategies. This work is part of the master thesis of the author done under the supervision of Prof. Eilon Solan. I am thankful to Prof. Solan for his inspiring guidance. I also thank two anonymous referees of the International Journal of Game Theory for their comments.     

A basic searchlight game

A searchlight game is a two-person zero-sum dynamic game of the pursuit-evasion type in which at least one of the two players has a searchlight. A searchlight can be flashed a given number of times within a fixed time period and the objective is to catch the opponent in the region illuminated by the flash. Olsder and Papavassilopoulos instituted the study of these games and, in this paper, we supplement their results, obtaining a closed formula for the value and optimal strategies for the players in their basic game.     

A dynamic solution concept for abstract games

Several solution concepts have been defined for abstract games. Some of these are the core, due to Gillies and Shapley, the Von Neumann-Morgenstern stable sets, and the subsolutions due to Roth. These solution concepts are rather static in nature. In this paper, we propose a new solution concept for abstract games, called the dynamic solution, that reflects the dynamic aspects of negotiation among the players. Some properties of the dynamic solution are studied. Also, the dynamic solution of abstract games arising fromn-person cooperative games in characteristic function form is investigated.This research was supported by the Office of Naval Research under Contract No. N00014-75-C-0678, by the National Science Foundation under Grants Nos. MPS-75-02024 and MCS-77-03984 at Cornell University, by the United States Army under Contract No. DAAG-29-75-C-0024, and by the National Science Foundation under Grant No. MCS-75-17385-A01 at the University of Wisconsin. The author is grateful to Professor W. F. Lucas under whose guidance the research was conducted.     

Approximation of Noncooperative Semi-Markov Games

An approximation of a general V-ergodic semi-Markov game with Borel state space by discrete-state space strongly-ergodic games is studied. The standard expected ratio-average criterion as well as the expected time-average criterion are considered. New theorems on the existence of ∊-equilibria are given.Communicated by D. A. CarlsonThe authors thank an anonymous referee for constructive comments. This work is supported by MEiN Grant 1P03A 01030.     

多目标的随机结盟对策的ZS-值

本文研究的是多目标随机结盟对策的问题，是将单目标的随机结盟对策的ZS-值拓展到多目标的随机结盟对策上，同时考虑了局中人对不同目标的偏好程度，从而，给出了多目标随机结盟对策的ZS-值的定义，并讨论了该值的性质及定理。     

A game-theoretic taxonomy of social dilemmas

Both social psychology and experimental economics empirically investigate social dilemmas. However, these two disciplines sometimes use different notions for very similar scenarios. While it is irrelevant for economists whether an experimental public-good game is conceptualised as a take-some or give-some game – i.e., whether something is conceptualised as produced or extracted – it is not irrelevant for some psychologists: they grasp public-goods games as “give-some” games. And whereas most economists define social dilemmas in reference to a taxonomy of goods, some psychologists think that dominant strategies are a necessary attribute. This paper presents a taxonomy that relies on a formal game-theoretic analysis of social dilemmas, which integrates and clarifies both approaches. Because this taxonomy focuses on the underlying incentive structure, it facilitates the evaluation of experimental results from both social psychology and experimental economics.     

On some families of cooperative fuzzy games

In a fuzzy cooperative game the players may choose to partially participate in a coalition. A fuzzy coalition consists of a group of participating players along with their participation level. The characteristic function of a fuzzy game specifies the worth of each such coalition. This paper introduces well-known properties of classical cooperative games to the theory of fuzzy games, and studies their interrelations. It deals with convex games, exact games, games with a large core, extendable games and games with a stable core.     

Conditional Viability for Impulse Differential Games

We introduce in this paper the concept of “impulse evolutionary game”. Examples of evolutionary games are usual differential games, differentiable games with history (path-dependent differential games), mutational differential games, etc. Impulse evolutionary systems and games cover in particular “hybrid systems” as well as “qualitative systems”. The conditional viability kernel of a constrained set (with a target) is the set of initial states such that for all strategies (regarded as continuous feedbacks) played by the second player, there exists a strategy of the first player such that the associated run starting from this initial state satisfies the constraints until it hits the target. This paper characterizes the concept of conditional viability kernel for “qualitative games” and of conditional valuation function for “qualitative games” maximinimizing an intertemporal criterion. The theorems obtained so far about viability/capturability issues for evolutionary systems, conditional viability for differential games and about impulse and hybrid systems are used to provide characterizations of conditional viability under impulse evolutionary games.     

Subgame Consistent Cooperative Solutions in Stochastic Differential Games

Subgame consistency is a fundamental element in the solution of cooperative stochastic differential games. In particular, it ensures that: (i) the extension of the solution policy to a later starting time and to any possible state brought about by the prior optimal behavior of the players would remain optimal; (ii) all players do not have incentive to deviate from the initial plan. In this paper, we develop a mechanism for the derivation of the payoff distribution procedures of subgame consistent solutions in stochastic differential games with transferable payoffs. The payoff distribution procedure of the subgame consistent solution can be identified analytically under different optimality principles. Demonstration of the use of the technique for specific optimality principles is shown with an explicitly solvable game. For the first time, analytically tractable solutions of cooperative stochastic differential games with subgame consistency are derived.     

The Genesis of Differential Games in Light of Isaacs’ Contributions

Rufus P. Isaacs joined the RAND Corporation⁴, Santa Monica, California in 1948 and started to develop the theory of dynamic games in the early 1950s. Until winter 1954/55, when Isaacs left the RAND Corporation, he investigated two player, zero-sum dynamic games of the classic pursuit-evasion type. Prior to 1965, Isaacs published his theory only in internal RAND papers and research memoranda. In his first RAND paper (Ref. 1), Isaacs sketched the basic ideas of zero-sum dynamic game theory. The ideas already included rudimentary precursors of the maximum principle, dynamic programming, and backward analysis. At the end of 1954 and the beginning of 1955, Isaacs summarized his research in four research memoranda (Refs. 3--6), which ten years later formed the basis of his famous book on Differential Games (Ref. 7). This paper surveys Isaacs research with an emphasis on the early years of dynamic games. The readers are kindly invited to discuss the authors point of view. Comments and statements sent to the author will be summarized and published later.This paper is dedicated to the memory of Professor Rufus Philip Isaacs on the occasion of the 50th birthday of differential game theory. Isaacs, the acknowledged father of differential game theory (today called mainly theory of dynamic games),finished his first working paper at the RAND Corporation on November 17, 1951 (Ref.1). The author thanks Isaacs widow Rose B. Isaacs of Towson, Maryland, Leonard D. Berkovitz (Purdue University), Wendell H. Fleming (Brown University), George Leitmann (University of California, Berkeley), Valerii S. Patsko (Urals Branch of the Russian Academy of Sciences, Ekaterinburg), Leon A. Petrosyan (St. Petersburg University), and Varvara L. Turova (Center of Advanced European Studies and Research, Bonn) for very helpful information. Special thanks go to Katja Steinborn of Klein-K\{o}ris/Berlin for the careful translation of Russian sources. RAND is the acronym for Research and New Development. A common joke is that it stands for Research and {\it No} Development; see Ref.2. Today, the RAND Corporation considers itself as a nonprofit institution that helps improve policy and decisionmaking through research and analysis; see www.rand.org. Communicated by L. D. Berkovitz     

Totally monotonic games and flow games

Equivalences between totally balanced games and flow games, and between monotonic games and pseudoflow games are well-known. This paper shows that for every totally monotonic game there exists an equivalent flow game and that for every monotonic game, there exists an equivalent flow-based secondary market game.     

A note on dynamic Stackelberg games with leaders in turn

Recently, a model of dynamic Stackelberg games with leaders in turn has been proposed, and dynamic Stackelberg games with leaders in turn have been exploited under a feedback information structure. This paper characterizes dynamic Stackelberg games with leaders in turn under other information structures, both closed-loop and open-loop information structures. Explicit solutions are given for linear-quadratic systems under an open-loop information structure for dynamic Stackelberg games with leaders in turn.     

Static and Dynamic Equilibria in Games With Continuum of Players

This paper is a study of a general class of deterministic dynamic games with an atomless measure space of players and an arbitrary time space. The payoffs of the players depend on their own strategy, a trajectory of the system and a function with values being finite dimensional statistics of static profiles. The players' available decisions depend on trajectories of the system.The paper deals with relations between static and dynamic open-loop equilibria as well as their existence. An equivalence theorem is proven and theorems on the existence of a dynamic equilibrium are shown as consequences.     

Sequential Stackelberg equilibria in two-person games

The concept of sequential Stackelberg equilibrium is introduced in the general framework of dynamic, two-person games defined in the Denardo contracting operator formalism. A relationship between this solution concept and the sequential Nash equilibrium for an associated extended game is established. This correspondence result, which can be related to previous results obtained by Baar and Haurie (1984), is then used for studying the existence of such solutions in a class of sequential games. For the zero-sum case, the sequential Stackelberg equilibrium corresponds to a sequential maxmin equilibrium. An algorithm is proposed for the computation of this particular case of equilibrium.This research was supported by SSHRC Grant No. 410-83-1012, NSERC Grant No. A4952, and FCAR Grants Nos. 86-CE-130 and EQ-0428.The authors thank T. R. Bielecki and J. A. Filar, who pointed out some mistakes and helped improving the paper.At the time of this research, this author was with GERMA, Ecole Mohammedia d'Ingénieurs, Rabat, Morocco.     

On linear stochastic differential games with average cost criterions

In this paper, we consider scalar linear stochastic differential games with average cost criterions. We solve the dynamic programming equations for these games and give the synthesis of saddle-point and Nash equilibrium solutions.The authors wish to thank A. Ichikawa for providing the initial impetus and helpful advice.     

Solution concepts in continuous-kernel multicriteria games

This paper considers nonzero-sum multicriteria games with continuous kernels. Solution concepts based on the notions of Pareto optimality, equilibrium, and security are extended to these games. Separate necessary and sufficient conditions and existence results are presented for equilibrium, Pareto-optimal response, and Pareto-optimal security strategies of the players.This paper is based partially on research supported by the Council of Scientific and Industrial Research, India, through a Research Associateship Grant to the first author.The authors are grateful to two anonymous referees for suggesting useful changes and pointing out some errors in a previous draft.     

Minimarg and maximarg operators

Two operators on the set ofn-person cooperative games are introduced, the minimarg operator and the maximarg operator. These operators can be seen as dual to each other. Some nice properties of these operators are given, and classes of games for which these operators yield convex (respectively, concave) games are considered. It is shown that, if these operators are applied iteratively on a game, in the limit one will yield a convex game and the other a concave game, and these two games will be dual to each other. Furthermore, it is proved that the convex games are precisely the fixed points of the minimarg operator and that the concave games are precisely the fixed points of the maximarg operator.     

Preferred coalitions in cooperative differential games

There are many interesting situations which can be described by anN-person general-sum differential game. Such games are characterized by the fact that the strategy of each player depends upon reasonable assumptions about the strategies of the remaining players; and, thus, these games cannot be considered asN uncoupled optimal control problems. In such cases, we say that the game is not strictly competitive, but involves a mutual interest which makes it possible for all of the players to reduce their costs by cooperating with one another, provided the resulting agreement can be enforced. When cooperation is allowed and there are more than two players, there is always the question of whether all possible subcoalitions will be formed with equal ease. This work considers the situation in which a particular subcoalition is preferred. A theory of general-sum games with preferred coalitions is presented, together with constructive examples of alternative approaches which are unsatisfactory.     

Separable and low-rank continuous games

In this paper, we study nonzero-sum separable games, which are continuous games whose payoffs take a sum-of-products form. Included in this subclass are all finite games and polynomial games. We investigate the structure of equilibria in separable games. We show that these games admit finitely supported Nash equilibria. Motivated by the bounds on the supports of mixed equilibria in two-player finite games in terms of the ranks of the payoff matrices, we define the notion of the rank of an n-player continuous game and use this to provide bounds on the cardinality of the support of equilibrium strategies. We present a general characterization theorem that states that a continuous game has finite rank if and only if it is separable. Using our rank results, we present an efficient algorithm for computing approximate equilibria of two-player separable games with fixed strategy spaces in time polynomial in the rank of the game. This research was funded in part by National Science Foundation grants DMI-0545910 and ECCS-0621922 and AFOSR MURI subaward 2003-07688-1.