Sufficient conditions for Nash equilibria inN-person games over reflexive Banach spaces

Sufficient conditions are obtained for the existence of Nash equilibrium points inN-person games when the strategy sets are closed, convex subsets of reflexive Banach spaces. These conditions require that each player's cost functional is convex in that player's strategy, weakly continuous in the strategies of the other players, weakly lower semicontinuous in all strategies, and furthermore satisfies a coercivity condition if any of the strategy sets is unbounded. The result is applied to a class of linear-quadratic differential games with no information, to prove that equilibrium points exist when the duration of these games is sufficiently small.This work was supported by a Commonwealth of Australia, Postgraduate Research Award.     

A class of trilinear differential games

This paper characterizes a class ofN-person, general sum differential games for which the optimal strategies only depend upon remaining playing time. Such strategies can be easily characterized and determined, and the optimal play can be easily analyzed.We acknowledge the helpful comments of G. Leitmann and an anonymous referee.     

N-person differential games governed by semilinear stochastic evolution systems

In this paper the problem ofN-person infinite-dimensional stochastic differential games governed by semilinear stochastic evolution control systems is discussed. First the minimax principle which is the necessary condition for the existence of open-loop Nash equilibrium is proved. Then the necessary and sufficient conditions of open-loop and closed-loop Nash equilibrium for linear quadratic infinite-dimensional stochastic differential games are derived.     

A new approach toN-person,nonzero-sum,linear differential games

It is shown that there exist equilibrium strategies forn-person, nonero-sum, linear differential games if the cost to each player is convex. The approach used is believed to be novel, and is based on a theorem of Fan.This research was supported by the National Research Council of Canada under Grant No. A-7790.     

On equilibrium points of diagonaln-person games

In this paper, we compute explicitly the equilibrium points of diagonaln-person games when all of them have the same number of strategies. This number is arbitrary. A wide generalization of two-person games is immediately obtained.The author is grateful to Professor Joel Cohen who visited IMASL during the winter of 1987 and commented on the paper.     

Tractable classes of nonzero-sum open-loop Nash differential games: Theory and examples

This paper identifies some classes ofN-person nonzero-sum differential games that are tractable, in the sense that open-loop Nash strategies can be determined, either explicitly or qualitatively in terms of a phase-diagram portrait. The classes are characterized by conditions imposed on the Hamiltonians. Also, the underlying game structures needed to satisfy these conditions are characterized.The authors wish to thank V. Kaitala, Helsinki University of Technology, and the referees.     

Deterministic Time-inconsistent Optimal Control Problems - an Essentially Cooperative Approach

A general deterministic time-inconsistent optimal control problem is formulated for ordinary differential equations. To find a time-consistent equilibrium value function and the corresponding time-consistent equilibrium control, a non-cooperative N-person differential game (but essentially cooperative in some sense) is introduced. Under certain conditions, it is proved that the open-loop Nash equilibrium value function of the N -person differential game converges to a time-consistent equilibrium value function of the original problem, which is the value function of a time-consistent optimal control problem. Moreover, it is proved that any optimal control of the time-consistent limit problem is a time-consistent equilibrium control of the original problem.     

An exponential differential game which admits a simple Nash solution

This paper deals with a class ofN-person nonzero-sum differential games where the control variables enter into the state equations as well as the payoff functionals in an exponential way. Due to the structure of the game, Nash-optimal controls are easily determined. The equilibrium in open-loop controls is also a closed-loop equilibrium. An example of optimal exploitation of an exhaustible resource is presented.The helpful comments of Professor Y. C. Ho and Dipl. Ing. E. Dockner are gratefully acknowledged.     

Mixed strategy solutions forN-person quadratic games

Mixed strategy -equilibrium points are given forN-person games with cost functions consisting of quadratic, bilinear, and linear terms and strategy spaces consisting of closed balls in Hilbert spaces. The results are applied to linear-quadratic differential games with no information and quadratic integral constraints on the control functions.This work was supported by a Commonwealth of Australia, Postgraduate Research Award.     

Existence and Uniqueness of Open-Loop Stackelberg Equilibria in Linear-Quadratic Differential Games

We present existence and uniqueness results for a hierarchical or Stackelberg equilibrium in a two-player differential game with open-loop information structure. There is a known convexity condition ensuring the existence of a Stackelberg equilibrium, which was derived by Simaan and Cruz (Ref. 1). This condition applies to games with a rather nonconflicting structure of their cost criteria. By another approach, we obtain here new sufficient existence conditions for an open-loop equilibrium in terms of the solvability of a terminal-value problem of two symmetric Riccati differential equations and a coupled system of Riccati matrix differential equations. The latter coupled system appears also in the necessary conditions, but contrary to the above as a boundary-value problem. In case that the convexity condition holds, both symmetric equations are of standard type and admit globally a positive-semidefinite solution. But the conditions apply also to more conflicting situations. Then, the corresponding Riccati differential equations may be of H-type. We obtain also different uniqueness conditions using a Lyapunov-type approach. The case of time-invariant parameters is discussed in more detail and we present a numerical example.     

Cone Concavity and Multiple-Payoff Constrained n-Person Games

This paper investigates special cases of abstract economies, i.e., n-person games with multiple payoff functions. Dominances with certain convex cones and interactive strategies are introduced in such game settings. Gradients of payoff functions are involved to establish certain Lagrange or Kuhn–Tucker conditions which may lead to some algorithms to actually compute an equilibrium. Sufficient and necessary conditions for such multiple payoff constrained n-person games are obtained.     

Equilibrium points in specialn-person games

The set of Nash equilibria is computed for some generalized games. It is also studied for a subclass of standardn-person games.The authors acknowledge the support of CONICET (Consejo de Investigaciones Cientificas y Tecnicas de la Republica Argentina). The first author acknowledges the support from TWAS (Third World Academy of Sciences), Grant No. 86-33.     

Stochastic differential games: Occupation measure based approach

A new approach based on occupation measures is introduced for studying stochastic differential games. For two-person zero-sum games, the existence of values and optimal strategies for both players is established for various payoff criteria. ForN-person games, the existence of equilibria in Markov strategies is established for various cases.     

Denumerable state stochastic games with limiting average payoff

We study stochastic games with countable state space, compact action spaces, and limiting average payoff. ForN-person games, the existence of an equilibrium in stationary strategies is established under a certain Liapunov stability condition. For two-person zero-sum games, the existence of a value and optimal strategies for both players are established under the same stability condition.The authors wish to thank Prof. T. Parthasarathy for pointing out an error in an earlier version of this paper. M. K. Ghosh wishes to thank Prof. A. Arapostathis and Prof. S. I. Marcus for their hospitality and support.     

Preferred coalitions in cooperative differential games

There are many interesting situations which can be described by anN-person general-sum differential game. Such games are characterized by the fact that the strategy of each player depends upon reasonable assumptions about the strategies of the remaining players; and, thus, these games cannot be considered asN uncoupled optimal control problems. In such cases, we say that the game is not strictly competitive, but involves a mutual interest which makes it possible for all of the players to reduce their costs by cooperating with one another, provided the resulting agreement can be enforced. When cooperation is allowed and there are more than two players, there is always the question of whether all possible subcoalitions will be formed with equal ease. This work considers the situation in which a particular subcoalition is preferred. A theory of general-sum games with preferred coalitions is presented, together with constructive examples of alternative approaches which are unsatisfactory.     

Asymptotic Analysis of Linear Feedback Nash Equilibria in Nonzero-Sum Linear-Quadratic Differential Games

In this paper, we discuss nonzero-sum linear-quadratic differential games. For this kind of games, the Nash equilibria for different kinds of information structures were first studied by Starr and Ho. Most of the literature on the topic of nonzero-sum linear-quadratic differential games is concerned with games of fixed, finite duration; i.e., games are studied over a finite time horizon t _f. In this paper, we study the behavior of feedback Nash equilibria for t _f.In the case of memoryless perfect-state information, we study the so-called feedback Nash equilibrium. Contrary to the open-loop case, we note that the coupled Riccati equations for the feedback Nash equilibrium are inherently nonlinear. Therefore, we limit the dynamic analysis to the scalar case. For the special case that all parameters are scalar, a detailed dynamical analysis is given for the quadratic system of coupled Riccati equations. We show that the asymptotic behavior of the solutions of the Riccati equations depends strongly on the specified terminal values. Finally, we show that, although the feedback Nash equilibrium over any fixed finite horizon is generically unique, there can exist several different feedback Nash equilibria in stationary strategies for the infinite-horizon problem, even when we restrict our attention to Nash equilibria that are stable in the dynamical sense.     

Some interesting properties of maximin strategies

Since the seminal paper of Nash (1950) game theoretic literature has focused mostly on equilibrium and not on maximin (minimax) strategies. We study the properties of these strategies in non-zero-sum strategic games that possess (completely) mixed Nash equilibria. We find that under certain conditions maximin strategies have several interesting properties, some of which extend beyond 2-person strategic games. In particular, for n-person games we specify necessary and sufficient conditions for maximin strategies to yield the same expected payoffs as Nash equilibrium strategies. We also show how maximin strategies may facilitate payoff comparison across Nash equilibria as well as refine some Nash equilibrium strategies.     

A class of differential games with state-dependent closed-loop feedback solutions

In this paper, a class ofN-person, nonzero-sum differential games with state-dependent closed-loop feedback solutions is presented. In particular, the system of Hamilton-Jacobi equations for a closed-loop feedback solution turns out to be a set ofN-independent linear equations with viscosity solutions.The helpful comments of an anonymous referee are gratefully acknowledged.     

A class of differential games for which the closed-loop and open-loop Nash equilibria coincide

It is well known that, in general, Nash equilibria in open-loop strategies do not coincide with those in closed-loop strategies. This note identifies a class of differential games in which the Nash equilibrium in closed-loop strategies is degenerate, in the sense that it depends on time only. Consequently, the closed-loop equilibrium is also an equilibrium in open-loop strategies.The helpful comments of Professors Y. C. Ho, G. Leitmann, H. Y. Wan, Jr., and an anonymous referee are gratefully acknowledged.     

Open-loop Nash equilibrium of N-person nonzero sum linear-quadratic differential games with magnitude restraints

We prove the existence of an open-loop Nash equilibrium of an N-person nonzero sum linear-quadratic differential game with bounded controllers. Due to the method employed, the computational method of [4, Section 5] can be used to approximate the equilibrium costs.