On differential games with a feedback nash equilibrium

This note provides a lemma on differential games which possess a feedback Nash equilibrium (FNE). In particular, it shows that (i) a class of games with a degenerate FNE can be constructucted from every game which has a nondegenerate FNE and (ii) a class of games with a nondegenerate FNE can be constructed from every game which has a degenerate FNE.The author would like to thank an anonymous referee for invaluable comments and suggestions.     

A BSDE approach to Nash equilibrium payoffs for stochastic differential games with nonlinear cost functionals

In this paper, we study Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games via the theory of backward stochastic differential equations. We obtain an existence theorem and a characterization theorem of Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games with nonlinear cost functionals defined with the help of doubly controlled backward stochastic differential equations. Our results extend former ones by Buckdahn et al. (2004) [3] and are based on a backward stochastic differential equation approach.     

Existence of nash equilibria for constrained stochastic games

In this paper, we consider constrained noncooperative N-person stochastic games with discounted cost criteria. The state space is assumed to be countable and the action sets are compact metric spaces. We present three main results. The first concerns the sensitivity or approximation of constrained games. The second shows the existence of Nash equilibria for constrained games with a finite state space (and compact actions space), and, finally, in the third one we extend that existence result to a class of constrained games which can be “approximated” by constrained games with finitely many states and compact action spaces. Our results are illustrated with two examples on queueing systems, which clearly show some important differences between constrained and unconstrained games.Mathematics Subject Classification (2000): Primary: 91A15. 91A10; Secondary: 90C40     

On Nikaido-Isoda type theorems for discounted stochastic games

We present a class of countable state space stochastic games with discontinuous payoff functions satisfying some assumptions similar to the ones of Nikaido and Isoda for one-stage games. We prove that these games possess stationary equilibria. We show that after adding some concavity assumptions these equilibria are nonrandomized. Further, we present an example of input (or production) dynamic game satisfying the assumptions of our model. We give a closed-form solution for this game.     

On purification of equilibrium in Bayesian games and expost Nash equilibrium

Treating games of incomplete information, we demonstrate that the existence of an ex post stable strategy vector implies the existence of an approximate Bayesian equilibrium in pure strategies that is also expost stable. Through examples we demonstrate the ‘bounds obtained on the approximation’ are tight. The main results of this paper first appeared in University of Warwick Department of Economics Discussion Paper #710. 2004.     

Learning algorithms for repeated bimatrix Nash games with incomplete information

The purpose of this paper is to study a particular recursive scheme for updating the actions of two players involved in a Nash game, who do not know the parameters of the game, so that the resulting costs and strategies converge to (or approach a neighborhood of) those that could be calculated in the known parameter case. We study this problem in the context of a matrix Nash game, where the elements of the matrices are unknown to both players. The essence of the contribution of this paper is twofold. On the one hand, it shows that learning algorithms which are known to work for zero-sum games or team problems can also perform well for Nash games. On the other hand, it shows that, if two players act without even knowing that they are involved in a game, but merely thinking that they try to maximize their output using the learning algorithm proposed, they end up being in Nash equilibrium.This research was supported in part by NSF Grant No. ECS-87-14777.     

Randomized stopping games and Markov market games

We study nonzero-sum stopping games with randomized stopping strategies. The existence of Nash equilibrium and ɛ-equilibrium strategies are discussed under various assumptions on players random payoffs and utility functions dependent on the observed discrete time Markov process. Then we will present a model of a market game in which randomized stopping times are involved. The model is a mixture of a stochastic game and stopping game. Research supported by grant PBZ-KBN-016/P03/99.     

On linear-quadratic Gaussian continuous-time Nash games

Two classes of linear-quadratic Gaussian continuous-time Nash games are considered. Their main characteristic is that the -fields with respect to which the control actions of the players have to be measurable at each instance of time are not affected by the past controls of the players. We show that, if a solution exists, then there exists a solution linear in the information, and also show how to construct all the solutions. Several conditions guaranteeing the existence of a unique solution are also given.This work was supported in part by the United States Air Force, Office of Scientific Research, under Grants Nos. AFOSR-80-0171 and AFOSR-82-0174.     

On the saddle-point solution of a class of stochastic differential games

This paper deals with the saddle-point solution of a class of stochastic differential games described by linear state dynamics and quadratic objective functionals. The information structure of the problem is such that both players have access to a common noisy linear measurement of the state and they are permitted to utilize only this information in constructing their controls. The saddle-point solution of such differential game problems has been discussed earlier in Ref. 1, but the conclusions arrived there are incorrect, as is explicitly shown in this paper. We extensively discuss the role of information structure on the saddle-point solution of such stochastic games (specifically within the context of an illustrative discrete-time example) and then obtain the saddle-point solution of the problem originally formulated by employing an indirect approach.This work was done while the author was on sabbatical leave at Twente University of Technology, Department of Applied Mathematics, Enschede, Holland, from Applied Mathematics Division, Marmara Scientific and Industrial Research Institute, Gebze, Kocaeli, Turkey.     

Uniqueness of Nash equilibrium for linear-convex stochastic differential games

The uniqueness of Nash equilibria is shown for a class of stochastic differential games where the dynamic constraints are linear in the control variables. The result is applied to an oligopoly.This paper benefitted from comments by two anonymous referees and by L. Blume and C. Simon.     

On the saddle-point stability for a class of dynamic games

In this paper, we study the stability properties of the class of capital accumulation games introduced by Fershtman and Muller (Ref. 1). Both discrete and continuous time versions are discussed. It is shown that the open-loop Nash equilibrium solutions for both games are characterized by a general saddle-point property, a result best known from the turnpike literature in optimal growth theory. In the case of zero discount rates, an even stronger result can be derived: As long as the Hessian matrix of the instantaneous profit functions has a quasidominant diagonal, no pure imaginary roots are possible.The authors thank J. Boyd III, G. Feichtinger, S. Jørgensen, and G. Schwann for helpful comments. The first author acknowledges financial support from the Natural Science and Engineering Research Council of Canada, Grant No. OGP-0037342.     

A note on nonzero-sum differential games with bargaining solution

The extension of Nash's bargaining solution to differential games is discussed. It is shown that a closed-loop solution verifies very stringent necessary conditions and that an open-loop solution can present serious weakness from a normative point of view.This research has been supported by the Canada Council (S73-0935) and the Ministère de l'Education du Québec (DGES).     

Correlated equilibrium payoffs and public signalling in absorbing games

An absorbing game is a repeated game where some action combinations are absorbing, in the sense that whenever they are played, there is a positive probability that the game terminates, and the players receive some terminal payoff at every future stage.  We prove that every multi-player absorbing game admits a correlated equilibrium payoff. In other words, for every ε>0 there exists a probability distribution p _ε over the space of pure strategy profiles that satisfies the following. With probability at least 1−ε, if a pure strategy profile is chosen according to p _ε and each player is informed of his pure strategy, no player can profit more than ε in any sufficiently long game by deviating from the recommended strategy. Received: April 2001/Revised: June 4, 2002     

Iterative computation of noncooperative equilibria in nonzero-sum differential games with weakly coupled players

We study the Nash equilibria of a class of two-person nonlinear, deterministic differential games where the players are weakly coupled through the state equation and their objective functionals. The weak coupling is characterized in terms of a small perturbation parameter . With =0, the problem decomposes into two independent standard optimal control problems, while for 0, even though it is possible to derive the necessary and sufficient conditions to be satisfied by a Nash equilibrium solution, it is not always possible to construct such a solution. In this paper, we develop an iterative scheme to obtain an approximate Nash solution when lies in a small interval around zero. Further, after requiring strong time consistency and/or robustness of the Nash equilibrium solution when at least one of the players uses dynamic information, we address the issues of existence and uniqueness of these solutions for the cases when both players use the same information, either closed loop or open loop, and when one player uses open-loop information and the other player uses closed-loop information. We also show that, even though the original problem is nonlinear, the higher (than zero) order terms in the Nash equilibria can be obtained as solutions to LQ optimal control problems or static quadratic optimization problems.This research was supported in part by the US Department of Energy under Grant DE-FG-02-88-ER-13939.Paper presented at the 29th IEEE Conference on Decision and Control, Honolulu, Hawaii, 1990.     

Directed graphical structure,Nash equilibrium,and potential games

This paper considers the directed graphical structure of a game, called influence structure, where a directed edge from player $i$ to player $j$ indicates that player $i$ may be able to affect $j$’s payoff via his unilateral change of strategies. We give a necessary and sufficient condition for the existence of pure-strategy Nash equilibrium of games having a directed graph in terms of the structure of that graph. We also discuss the relationship between the structure of graphs and potential games.     

On participation games with complete information

We analyze a class of two-candidate voter participation games under complete information that encompasses as special cases certain public good provision games. We characterize the Nash equilibria of these games as stationary points of a non-linear programming problem, the objective function of which is a Morse function (onethat does not admit degenerate critical points) for almost all costs of participation. We use this fact to establish that, outside a closed set of measure zero of participation costs, all equilibria of these games are regular (an alternative to the result of De Sinopoli and Iannantuoni in Econ Theory 25(2):477–486, 2005). One consequence of regularity is that the equilibria of these games are robust to the introduction of (mild) incomplete information. Finally, we establish the existence of monotone Nash equilibria, such that players with higher participation cost abstain with (weakly) higher probability.      

Cooperative equilibria in discounted stochastic sequential games

This paper addresses the problem of computation of cooperative equilibria in discounted stochastic sequential games. The proposed approach contains as a special case the method of Green and Porter (developed originally for repeated oligopoly games), but it is more general than the latter in the sense that it generates nontrivial equilibrium solutions for a much larger class of dynamic games. This fact is demonstrated on two examples, one concerned with duopolistic economics and the other with fishery management.     

Existence of stationary equilibrium strategies in non-zero sum discounted stochastic games with uncountable state space and state-independent transitions

Non-zero sum discounted stochastic games with uncountable state space and state in-dependent transitions have stationary equilibrium strategies.     

Regularity of Nash payoffs of Markovian nonzero-sum stochastic differential games

In this paper we deal with the problem of existence of a smooth solution of the Hamilton–Jacobi–Bellman–Isaacs (HJBI for short) system of equations associated with nonzero-sum stochastic differential games. We consider the problem in unbounded domains either in the case of continuous generators or for discontinuous ones. In each case we show the existence of a smooth solution of the system. As a consequence, we show that the game has smooth Nash payoffs which are given by means of the solution of the HJBI system and the stochastic process which governs the dynamic of the controlled system.