Nash Equilibria of Risk-Sensitive Nonlinear Stochastic Differential Games

This paper considers a class of risk-sensitive stochastic nonzero-sum differential games with parametrized nonlinear dynamics and parametrized cost functions. The parametrization is such that, if all or some of the parameters are set equal to some nominal values, then the differential game either becomes equivalent to a risk-sensitive stochastic control (RSSC) problem or decouples into several independent RSSC problems, which in turn are equivalent to a class of stochastic zero-sum differential games. This framework allows us to study the sensitivity of the Nash equilibrium (NE) of the original stochastic game to changes in the values of these parameters, and to relate the NE (generally difficult to compute and to establish existence and uniqueness, at least directly) to solutions of RSSC problems, which are relatively easier to obtain. It also allows us to quantify the sensitivity of solutions to RSSC problems (and thereby nonlinear H-control problems) to unmodeled subsystem dynamics controlled by multiple players.     

New Method to Characterize Subgame Perfect Nash Equilibria in Differential Games

In this paper, we present a method for computing Nash equilibria in feedback strategies. This method gives necessary and sufficient conditions to characterize subgame perfect equilibria by means of a system of quasilinear partial differential equations. This characterization allows one to know explicitly the solution of the game in some cases. In other cases, this approach makes a qualitative study easier. We apply this method to nonrenewable resource games.     

Nash Equilibria in Noncooperative Predator-Prey Games

A noncooperative game governed by a distributed-parameter predator-prey system is considered, assuming that two players control initial conditions for predator and prey, respectively. Existence of a Nash equilibrium is shown under the condition that the desired population profiles and the environmental carrying capacity for the prey are sufficiently small. A conceptual approximation algorithm is proposed and analyzed. Finally, numerical simulations are performed, too.     

On Coincidence of Feedback Nash Equilibria and Stackelberg Equilibria in Economic Applications of Differential Games

The scope of the applicability of the feedback Stackelberg equilibrium concept in differential games is investigated. First, conditions for obtaining the coincidence between the stationary feedback Nash equilibrium and the stationary feedback Stackelberg equilibrium are given in terms of the instantaneous payoff functions of the players and the state equations of the game. Second, a class of differential games representing the underlying structure of a good number of economic applications of differential games is defined; for this class of differential games, it is shown that the stationary feedback Stackelberg equilibrium coincides with the stationary feedback Nash equilibrium. The conclusion is that the feedback Stackelberg solution is generally not useful to investigate leadership in the framework of a differential game, at least for a good number of economic applications This paper was presented at the 8th Viennese Workshop on Optimal Control, Dynamic Games, and Nonlinear Dynamics: Theory and Applications in Economics and OR/MS, Vienna, Austria, May 14–16, 2003, at the Seminar of the Instituto Complutense de Analisis Economico, Madrid, Spain, June 20, 2003, and at the Sevilla Workshop on Dynamic Economics and the Environment, Sevilla, Spain, July 2–3, 2003. The author is grateful to the participants in these sessions, in particular F.J. Andre and J. Ruiz, for their comments. Five referees provided particularly helpful suggestions. Financial support from the Ministerio de Ciencia y Tecnologia under Grant BEC2000-1432 is gratefully acknowledged.     

Asymptotic Analysis of Linear Feedback Nash Equilibria in Nonzero-Sum Linear-Quadratic Differential Games

In this paper, we discuss nonzero-sum linear-quadratic differential games. For this kind of games, the Nash equilibria for different kinds of information structures were first studied by Starr and Ho. Most of the literature on the topic of nonzero-sum linear-quadratic differential games is concerned with games of fixed, finite duration; i.e., games are studied over a finite time horizon t _f. In this paper, we study the behavior of feedback Nash equilibria for t _f.In the case of memoryless perfect-state information, we study the so-called feedback Nash equilibrium. Contrary to the open-loop case, we note that the coupled Riccati equations for the feedback Nash equilibrium are inherently nonlinear. Therefore, we limit the dynamic analysis to the scalar case. For the special case that all parameters are scalar, a detailed dynamical analysis is given for the quadratic system of coupled Riccati equations. We show that the asymptotic behavior of the solutions of the Riccati equations depends strongly on the specified terminal values. Finally, we show that, although the feedback Nash equilibrium over any fixed finite horizon is generically unique, there can exist several different feedback Nash equilibria in stationary strategies for the infinite-horizon problem, even when we restrict our attention to Nash equilibria that are stable in the dynamical sense.     

Identification of Efficient Subgame-Perfect Nash Equilibria in a Class of Differential Games1

We present a method for the characterization of subgame-perfect Nash equilibria being Pareto efficient in a class of differential games. For that purpose, we propose a new approach based on new necessary and sufficient conditions for computing subgame-perfect Nash equilibria.     

A Qualitative Characterization of Symmetric Open-Loop Nash Equilibria in Discounted Infinite Horizon Differential Games

The local stability, steady state comparative statics, and local comparative dynamics of symmetric open-loop Nash equilibria for the ubiquitous class of discounted infinite horizon differential games are investigated. It is shown that the functional forms and values of the parameters specified in a differential game are crucial in determining the local stability of a steady state and, in turn, the steady state comparative statics and local comparative dynamics. A simple sufficient condition for a steady state to be a local saddle point is provided. The power and reach of the results are demonstrated by applying them to two well-known differential games.     

On Existence of Nash Equilibria of Games with Constraints on Multistrategies

In this paper, sufficient conditions are given, which are less restrictivethan those required by the Arrow–Debreu–Nash theorem, on theexistence of a Nash equilibrium of an n-player game {₁, . . . , Y_n,f₁, . . . , f_n} in normal form with a nonempty closedconvex constraint C on the set Y=i Y_i of multistrategies. Theith player has to minimize the function fi with respect to the ithvariable. We consider two cases.In the first case, Y is a real Hilbert space and the loss function class isquadratic. In this case, the existence of a Nash equilibrium is guaranteedas a simple consequence of the projection theorem for Hilbert spaces. In thesecond case, Y is a Euclidean space, the loss functions are continuous, andf_i is convex with respect to the ith variable. In this case, the techniqueis quite particular, because the constrained game is approximated with asequence of free games, each with a Nash equilibrium in an appropriatecompact space X. Since X is compact, there exists a subsequence of theseNash equilibrium points which is convergent in the norm. If thelimit point is in C and if the order of convergence is greater than one,then this is a Nash equilibrium of the constrained game.     

Nash and Stackelberg Differential Games

A large class of stochastic differential games for several players is considered in this paper.The class includes Nash differential games as well as Stackelberg differential games.A mix is possible.The...     

Nash Equilibria in a Differential Game of Economic Growth

The present work studies a dynamic game of economic growth with two phases or periods. In the first phase, a political process exists where an institutional framework is fixed, that is, limits to the workers share in the national income, minimum limits of consumption by capitalists, and discretionality in investment are specified. This framework conditions the actions of the players (capitalists and workers). In the second phase, the Nash equilibria of the game are calculated. Lastly, the sensitivity of the results with respect to the institutional parameters is analyzed for a given scenario.     

Open and Closed Loop Nash Equilibria in Games with a Continuum of Players

In this paper, the problem of relations between closed loop and open loop Nash equilibria is examined in the environment of discrete time dynamic games with a continuum of players and a compound structure encompassing both private and global state variables. An equivalence theorem between these classes of equilibria is proven, important implications for the calculation of these equilibria are derived and the results are presented on models of a common ecosystem exploited by a continuum of players. An example of an analogous game with finitely many players is also presented for comparison.     

Robust Equilibria in Indefinite Linear-Quadratic Differential Games

Equilibria in dynamic games are formulated often under the assumption that the players have full knowledge of the dynamics to which they are subject. Here, we formulate equilibria in which players are looking for robustness and take model uncertainty explicitly into account in their decisions. Specifically, we consider feedback Nash equilibria in indefinite linear-quadratic differential games on an infinite time horizon. Model uncertainty is represented by a malevolent input which is subject to a cost penalty or to a direct bound. We derive conditions for the existence of robust equilibria in terms of solutions of sets of algebraic Riccati equations.     

Large-Scale Dynamics of Mean-Field Games Driven by Local Nash Equilibria

We introduce a new mean field kinetic model for systems of rational agents interacting in a game-theoretical framework. This model is inspired from non-cooperative anonymous games with a continuum of players and Mean-Field Games. The large time behavior of the system is given by a macroscopic closure with a Nash equilibrium serving as the local thermodynamic equilibrium. An application of the presented theory to a social model (herding behavior) is discussed.     

Conditional Viability for Impulse Differential Games

We introduce in this paper the concept of “impulse evolutionary game”. Examples of evolutionary games are usual differential games, differentiable games with history (path-dependent differential games), mutational differential games, etc. Impulse evolutionary systems and games cover in particular “hybrid systems” as well as “qualitative systems”. The conditional viability kernel of a constrained set (with a target) is the set of initial states such that for all strategies (regarded as continuous feedbacks) played by the second player, there exists a strategy of the first player such that the associated run starting from this initial state satisfies the constraints until it hits the target. This paper characterizes the concept of conditional viability kernel for “qualitative games” and of conditional valuation function for “qualitative games” maximinimizing an intertemporal criterion. The theorems obtained so far about viability/capturability issues for evolutionary systems, conditional viability for differential games and about impulse and hybrid systems are used to provide characterizations of conditional viability under impulse evolutionary games.     

Constructions of Nash Equilibria in Stochastic Games of Resource Extraction with Additive Transition Structure

A class of N-person stochastic games of resource extraction with discounted payoffs in discrete time is considered. It is assumed that transition probabilities have special additive structure. It is shown that the Nash equilibria and corresponding payoffs in finite horizon games converge as horizon goes to infinity. This implies existence of stationary Nash equilibria in the infinite horizon case. In addition the algorithm for finding Nash equilibria in infinite horizon games is discussed     

Zero-Sum Differential Games Involving Hybrid Controls

We study a zero-sum differential game with hybrid controls in which both players are allowed to use continuous as well as discrete controls. Discrete controls act on the system at a given set interface. The state of the system is changed discontinuously when the trajectory hits predefined sets, an autonomous jump set A or a controlled jump set C, where one controller can choose to jump or not. At each jump, the trajectory can move to a different Euclidean space. One player uses all the three types of controls, namely, continuous controls, autonomous jumps, and controlled jumps; the other player uses continuous controls and autonomous jumps. We prove the continuity of the associated lower and upper value functions V⁻ and V⁺. Using the dynamic programming principle satisfied by V⁻ and V⁺, we derive lower and upper quasivariational inequalities satisfied in the viscosity sense. We characterize the lower and upper value functions as the unique viscosity solutions of the corresponding quasivariational inequalities. Lastly, we state an Isaacs like condition for the game to have a value This work was partially supported by Grants DRDO 508 and ISRO 050 to the Non-linear Studies Group, Indian Institute of Science. The first author is a University Grant Commission Research Fellow and the financial support is gratefully acknowledged. The authors thank Prof. M.K. Ghosh, Department of Mathematics, Indian Institute of Science, for introducing the problem and thank the referee for useful suggestions.     

On Nash Equilibria for Noncooperative Games Governed by the Burgers Equation

Existence of a Nash equilibrium in a noncooperative game governed by the one-dimensional Burgers equation, proposed in the case of pointwise controls in Ref. 1, is proved under data qualifications that guarantee the diffusion term in the Burgers’ equation to be dominant enough with respect to the uniform convexity of the payoffs. This work was partly supported by Grants 201/03/0934 (GA čR) and MSM 0021620839 (MšMT čR). Inspiring discussions with Angel M. Ramos are acknowledged.     

Redefinition of Belief Distorted Nash Equilibria for the Environment of Dynamic Games with Probabilistic Beliefs

In this paper, a new concept of equilibrium in dynamic games with incomplete or distorted information is introduced. In the games considered, players have incomplete information about crucial aspects of the game and formulate beliefs about the probabilities of various future scenarios. The concept of belief distorted Nash equilibrium combines optimization based on given beliefs and self-verification of those beliefs. Existence and equivalence theorems are proven, and this concept is compared to existing ones. Theoretical results are illustrated using several examples: extracting a common renewable resource, a large minority game, and a repeated Prisoner’s Dilemma.