Dynamically stable cooperative solutions in randomly furcating differential games

The paradigm of randomly furcating differential games incorporates stochastic elements via randomly branching payoffs in differential games. This paper considers dynamically stable cooperative solutions in randomly furcating differential games. Analytically tractable payoff distribution procedures contingent upon specific random events are derived. This new approach widens the application of cooperative differential game theory to problems where future environments are not known with certainty.     

Subgame Consistent Cooperative Solutions in Stochastic Differential Games

Subgame consistency is a fundamental element in the solution of cooperative stochastic differential games. In particular, it ensures that: (i) the extension of the solution policy to a later starting time and to any possible state brought about by the prior optimal behavior of the players would remain optimal; (ii) all players do not have incentive to deviate from the initial plan. In this paper, we develop a mechanism for the derivation of the payoff distribution procedures of subgame consistent solutions in stochastic differential games with transferable payoffs. The payoff distribution procedure of the subgame consistent solution can be identified analytically under different optimality principles. Demonstration of the use of the technique for specific optimality principles is shown with an explicitly solvable game. For the first time, analytically tractable solutions of cooperative stochastic differential games with subgame consistency are derived.     

Subgame Consistent Solutions for Cooperative Stochastic Dynamic Games

In cooperative games over time with uncertainty, a stringent condition (subgame consistency) is required for a dynamically stable solution. In particular, a cooperative solution is subgame consistent if an extension of the solution policy to a situation with a later starting time and any feasible state brought about by prior optimal behavior would remain optimal. This paper derives an analytically tractable payoff distribution procedure leading to the realization of subgame consistent solutions in cooperative stochastic dynamic games. This is the first time that subgame consistent solutions in discrete-time dynamic games under uncertainty are provided.     

Subgame Consistent Solutions of a Cooperative Stochastic Differential Game with Nontransferable Payoffs

Subgame consistency is a fundamental element in the solution of cooperative stochastic differential games. In particular, it ensures that the extension of the solution policy to a later starting time and any possible state brought about by the prior optimal behavior of the players would remain optimal. Recently, mechanisms for the derivation of subgame consistent solutions in stochastic cooperative differential games with transferable payoffs have been found. In this paper, subgame consistent solutions are derived for a class of cooperative stochastic differential games with nontransferable payoffs. The previously intractable subgame consistent solution for games with nontransferable payoffs is rendered tractable.This research was supported by the Research Grant Council of Hong Kong, Grant HKBU2056/99H and by Hong Kong Baptist University, Grant FRG/02-03/II16.Communicated by G. Leitmann     

Nash and Stackelberg Differential Games

A large class of stochastic differential games for several players is considered in this paper.The class includes Nash differential games as well as Stackelberg differential games.A mix is possible.The...     

Computing payoff allocations in the approximate core of linear programming games in a privacy-preserving manner

We investigate privacy-preserving ways of allocating payoffs among players participating in a joint venture, using tools from cooperative game theory and differential privacy. In particular, we examine linear programming games, an important class of cooperative games that model a myriad of payoff sharing problems, including those from logistics and network design. We show that we can compute a payoff allocation in the approximate core of these games in a way that satisfies joint differential privacy.     

Subgame Consistent Cooperative Solution of Dynamic Games with Random Horizon

In cooperative dynamic games, a stringent condition—that of subgame consistency—is required for a dynamically stable cooperative solution. In particular, under a subgame-consistent cooperative solution an extension of the solution policy to a subgame starting at a later time with a state brought about by prior optimal behavior will remain optimal. This paper extends subgame-consistent solutions to dynamic (discrete-time) cooperative games with random horizon. In the analysis, new forms of the Bellman equation and the Isaacs–Bellman equation in discrete-time are derived. Subgame-consistent cooperative solutions are obtained for this class of dynamic games. Analytically tractable payoff distribution mechanisms, which lead to the realization of these solutions, are developed. This is the first time that subgame-consistent solutions for cooperative dynamic games with random horizon are presented.     

Sensitive equilibria for ergodic stochastic games with countable state spaces

We consider stochastic games with countable state spaces and unbounded immediate payoff functions. Our assumptions on the transition structure of the game are based on a recent work by Meyn and Tweedie [19] on computable bounds for geometric convergence rates of Markov chains. The main results in this paper concern the existence of sensitive optimal strategies in some classes of zero-sum stochastic games. By sensitive optimality we mean overtaking or 1-optimality. We also provide a new Nash equilibrium theorem for a class of ergodic nonzero-sum stochastic games with denumerable state spaces.     

Stochastic games with non-observable actions

We examine n-player stochastic games. These are dynamic games where a play evolves in stages along a finite set of states; at each stage players independently have to choose actions in the present state and these choices determine a stage payoff to each player as well as a transition to a new state where actions have to be chosen at the next stage. For each player the infinite sequence of his stage payoffs is evaluated by taking the limiting average. Normally stochastic games are examined under the condition of full monitoring, i.e. at any stage each player observes the present state and the actions chosen by all players. This paper is a first attempt towards understanding under what circumstances equilibria could exist in n-player stochastic games without full monitoring. We demonstrate the non-existence of -equilibria in n-player stochastic games, with respect to the average reward, when at each stage each player is able to observe the present state, his own action, his own payoff, and the payoffs of the other players, but is unable to observe the actions of them. For this purpose, we present and examine a counterexample with 3 players. If we further drop the assumption that the players can observe the payoffs of the others, then counterexamples already exist in games with only 2 players.     

Two and three person games: A local study

Using the tools of differential geometry two-person games in normal form and their “ordinary” points, i.e. the points which are not equilibria in any sense, are studied. The concept of reversibility if defined and characterized in terms of the derivatives of the payoff functions. Reversible points appear as those points at which the behavior may become cooperative. In the second part of the paper, three-person games in normal form are considered. All the concepts defined depend only on the preference preorderings associated with the payoff functions and do not depend on the metric of the strategy spaces.     

收益模糊合作对策Shapley值的公理化

研究一类收益模糊的合作对策,这类对策联盟的模糊收益值可以用一个闭区间的形式来表示,本文定义了一个拓展的闭区间空间和一些闭区间线性运算算子,证明了这类对策的Shapley值可以用承载性、可替代性和可加性进行了公理化.     

Stochastic differential games: Occupation measure based approach

A new approach based on occupation measures is introduced for studying stochastic differential games. For two-person zero-sum games, the existence of values and optimal strategies for both players is established for various payoff criteria. ForN-person games, the existence of equilibria in Markov strategies is established for various cases.     

Stationary,completely mixed and symmetric optimal and equilibrium strategies in stochastic games

In this paper, we address various types of two-person stochastic games—both zero-sum and nonzero-sum, discounted and undiscounted. In particular, we address different aspects of stochastic games, namely: (1) When is a two-person stochastic game completely mixed? (2) Can we identify classes of undiscounted zero-sum stochastic games that have stationary optimal strategies? (3) When does a two-person stochastic game possess symmetric optimal/equilibrium strategies? Firstly, we provide some necessary and some sufficient conditions under which certain classes of discounted and undiscounted stochastic games are completely mixed. In particular, we show that, if a discounted zero-sum switching control stochastic game with symmetric payoff matrices has a completely mixed stationary optimal strategy, then the stochastic game is completely mixed if and only if the matrix games restricted to states are all completely mixed. Secondly, we identify certain classes of undiscounted zero-sum stochastic games that have stationary optima under specific conditions for individual payoff matrices and transition probabilities. Thirdly, we provide sufficient conditions for discounted as well as certain classes of undiscounted stochastic games to have symmetric optimal/equilibrium strategies—namely, transitions are symmetric and the payoff matrices of one player are the transpose of those of the other. We also provide a sufficient condition for the stochastic game to have a symmetric pure strategy equilibrium. We also provide examples to show the sharpness of our results.     

A fundamental study for partially defined cooperative games

The payoff of each coalition has been assumed to be known precisely in the conventional cooperative games. However, we may come across situations where some coalitional values remain unknown. This paper treats cooperative games whose coalitional values are not known completely. In the cooperative games it is assumed that some of coalitional values are known precisely but others remain unknown. Some complete games associated with such incomplete games are proposed. Solution concepts are studied in a special case where only values of the grand coalition and singleton coalitions are known. Through the investigations of solutions of complete games associated with the given incomplete game, we show a focal point solution suggested commonly from different viewpoints.     

Remarks on sensitive equilibria in stochastic games with additive reward and transition structure

A class of stochastic games with additive reward and transition structure is studied. For zero-sum games under some ergodicity assumptions 1-equilibria are shown to exist. They correspond to so-called sensitive optimal policies in dynamic programming. For a class of nonzero-sum stochastic games with nonatomic transitions nonrandomized Nash equilibrium points with respect to the average payoff criterion are also obtained. Included examples show that the results of this paper can not be extented to more general payoff or transition structure.     

On Nikaido-Isoda type theorems for discounted stochastic games

We present a class of countable state space stochastic games with discontinuous payoff functions satisfying some assumptions similar to the ones of Nikaido and Isoda for one-stage games. We prove that these games possess stationary equilibria. We show that after adding some concavity assumptions these equilibria are nonrandomized. Further, we present an example of input (or production) dynamic game satisfying the assumptions of our model. We give a closed-form solution for this game.     

An operator solution of stochastic games

A class of zero-sum, two-person stochastic games is shown to have a value which can be calculated by transfinite iteration of an operator. The games considered have a countable state space, finite action spaces for each player, and a payoff sufficiently general to include classical stochastic games as well as Blackwell’s infiniteG _δ games of imperfect information. Research supported by National Science Foundation Grants DMS-8801085 and DMS-8911548.     

有限合作博弈的Shapley分配

以Myerson关于有限合作的图博弈模型为基础,结合经典合作博弈的相关结论,建立了有限合作博弈的Shapley分配,讨论了分配的相关性质.同时在支付函数满足链递增性的假设下,进一步研究了有限合作关系变化对收益分配的影响,给出了相关的研究结论.     

凸随机合作对策的核心

本文将凸性扩展到随机合作对策中,从而得到凸随机合作对策具有超可加性与非空的核心,且凸随机合作对策的核心满足Minkowski和与Minkowski差.