Robust Equilibria in Indefinite Linear-Quadratic Differential Games

Equilibria in dynamic games are formulated often under the assumption that the players have full knowledge of the dynamics to which they are subject. Here, we formulate equilibria in which players are looking for robustness and take model uncertainty explicitly into account in their decisions. Specifically, we consider feedback Nash equilibria in indefinite linear-quadratic differential games on an infinite time horizon. Model uncertainty is represented by a malevolent input which is subject to a cost penalty or to a direct bound. We derive conditions for the existence of robust equilibria in terms of solutions of sets of algebraic Riccati equations.     

On nonunique closed-loop Nash equilibria for a class of differential games with a unique and degenerated feedback solution

In this paper, we derive essentially nonunique closed-loop Nash equilibria for a class of nonzero-sum differential games with a unique and degenerated feedback Nash equilibrium.     

On the Selection of One Feedback Nash Equilibrium in Discounted Linear-Quadratic Games

We study a selection method for a Nash feedback equilibrium of a one-dimensional linear-quadratic nonzero-sum game over an infinite horizon. By introducing a change in the time variable, one obtains an associated game over a finite horizon T > 0 and with free terminal state. This associated game admits a unique solution which converges to a particular Nash feedback equilibrium of the original problem as the horizon T goes to infinity.     

Algorithms for computing Nash equilibria in deterministic LQ games

In this paper we review a number of algorithms to compute Nash equilibria in deterministic linear quadratic differential games. We will review the open-loop and feedback information case. In both cases we address both the finite and the infinite-planning horizon.     

A BSDE approach to Nash equilibrium payoffs for stochastic differential games with nonlinear cost functionals

In this paper, we study Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games via the theory of backward stochastic differential equations. We obtain an existence theorem and a characterization theorem of Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games with nonlinear cost functionals defined with the help of doubly controlled backward stochastic differential equations. Our results extend former ones by Buckdahn et al. (2004) [3] and are based on a backward stochastic differential equation approach.     

Linear–quadratic stochastic two-person nonzero-sum differential games: Open-loop and closed-loop Nash equilibria

In this paper, we consider a linear–quadratic stochastic two-person nonzero-sum differential game. Open-loop and closed-loop Nash equilibria are introduced. The existence of the former is characterized by the solvability of a system of forward–backward stochastic differential equations, and that of the latter is characterized by the solvability of a system of coupled symmetric Riccati differential equations. Sometimes, open-loop Nash equilibria admit a closed-loop representation, via the solution to a system of non-symmetric Riccati equations, which could be different from the outcome of the closed-loop Nash equilibria in general. However, it is found that for the case of zero-sum differential games, the Riccati equation system for the closed-loop representation of an open-loop saddle point coincides with that for the closed-loop saddle point, which leads to the conclusion that the closed-loop representation of an open-loop saddle point is the outcome of the corresponding closed-loop saddle point as long as both exist. In particular, for linear–quadratic optimal control problem, the closed-loop representation of an open-loop optimal control coincides with the outcome of the corresponding closed-loop optimal strategy, provided both exist.     

Separable and low-rank continuous games

In this paper, we study nonzero-sum separable games, which are continuous games whose payoffs take a sum-of-products form. Included in this subclass are all finite games and polynomial games. We investigate the structure of equilibria in separable games. We show that these games admit finitely supported Nash equilibria. Motivated by the bounds on the supports of mixed equilibria in two-player finite games in terms of the ranks of the payoff matrices, we define the notion of the rank of an n-player continuous game and use this to provide bounds on the cardinality of the support of equilibrium strategies. We present a general characterization theorem that states that a continuous game has finite rank if and only if it is separable. Using our rank results, we present an efficient algorithm for computing approximate equilibria of two-player separable games with fixed strategy spaces in time polynomial in the rank of the game. This research was funded in part by National Science Foundation grants DMI-0545910 and ECCS-0621922 and AFOSR MURI subaward 2003-07688-1.     

A general characterization of the mean field limit for stochastic differential games

The mean field limit of large-population symmetric stochastic differential games is derived in a general setting, with and without common noise, on a finite time horizon. Minimal assumptions are imposed on equilibrium strategies, which may be asymmetric and based on full information. It is shown that approximate Nash equilibria in the n-player games admit certain weak limits as n tends to infinity, and every limit is a weak solution of the mean field game (MFG). Conversely, every weak MFG solution can be obtained as the limit of a sequence of approximate Nash equilibria in the n-player games. Thus, the MFG precisely characterizes the possible limiting equilibrium behavior of the n-player games. Even in the setting without common noise, the empirical state distributions may admit stochastic limits which cannot be described by the usual notion of MFG solution.     

Optimal allocation of drug control efforts: A differential game analysis

The present paper considers a dynamic nonzero-sum game between drug dealers and the authorities. Although the game is neither linear-quadratic nor degenerate, in the sense that the closed-loop equilibria coincide with the open-loop equilibria, we are able to calculate explicitly a stationary feedback Nash equilibrium of that game. In a numerical example, we determine the optimal allocation of governmental efforts between treatment and law enforcement minimizing the total discounted cost stream in the equilibrium. Moreover, we provide sensitivity analyses with respect to the efficiency parameters of both competitors. Our results show that a farsighted authority should attack the drug problem from the demand side and put much effort in treatment measures and the improvement of the efficiency of the treatment.This research was supported by the Austrian Science Foundation under Contract P9112-SOZ. We would like to thank A. Luhmer and E. J. Dockner for helpful comments.     

Existence and Uniqueness of Open-Loop Stackelberg Equilibria in Linear-Quadratic Differential Games

We present existence and uniqueness results for a hierarchical or Stackelberg equilibrium in a two-player differential game with open-loop information structure. There is a known convexity condition ensuring the existence of a Stackelberg equilibrium, which was derived by Simaan and Cruz (Ref. 1). This condition applies to games with a rather nonconflicting structure of their cost criteria. By another approach, we obtain here new sufficient existence conditions for an open-loop equilibrium in terms of the solvability of a terminal-value problem of two symmetric Riccati differential equations and a coupled system of Riccati matrix differential equations. The latter coupled system appears also in the necessary conditions, but contrary to the above as a boundary-value problem. In case that the convexity condition holds, both symmetric equations are of standard type and admit globally a positive-semidefinite solution. But the conditions apply also to more conflicting situations. Then, the corresponding Riccati differential equations may be of H-type. We obtain also different uniqueness conditions using a Lyapunov-type approach. The case of time-invariant parameters is discussed in more detail and we present a numerical example.     

Constructions of Nash Equilibria in Stochastic Games of Resource Extraction with Additive Transition Structure

A class of N-person stochastic games of resource extraction with discounted payoffs in discrete time is considered. It is assumed that transition probabilities have special additive structure. It is shown that the Nash equilibria and corresponding payoffs in finite horizon games converge as horizon goes to infinity. This implies existence of stationary Nash equilibria in the infinite horizon case. In addition the algorithm for finding Nash equilibria in infinite horizon games is discussed     

Nonzero-sum differential games

The theory of differential games is extended to the situation where there areN players and where the game is nonzero-sum, i.e., the players wish to minimize different performance criteria. Dropping the usual zero-sum condition adds several interesting new features. It is no longer obvious what should be demanded of asolution, and three types of solutions are discussed:Nash equilibrium, minimax, andnoninferior set of strategies. For one special case, the linear-quadratic game, all three of these solutions can be obtained by solving sets of ordinary matrix differential equations. To illustrate the differences between zero-sum and nonzero-sum games, the results are applied to a nonzero-sum version of a simple pursuit-evasion problem first considered by Ho, Bryson, and Baron (Ref. 1).Negotiated solutions are found to exist which give better results forboth players than the usualsaddle-point solution. To illustrate that the theory may find interesting applications in economic analysis, a problem is outlined involving the dividend policies of firms operating in an imperfectly competitive market.This research was supported by Joint Services Electronics Contracts Nos. N00014-67-A-0298-0006, 0005, 0008 and by NASA Grant No. NGR 22-007-068.     

Selection of a correlated equilibrium in Markov stopping games

This paper deals with an extension of the concept of correlated strategies to Markov stopping games. The Nash equilibrium approach to solving nonzero-sum stopping games may give multiple solutions. An arbitrator can suggest to each player the decision to be applied at each stage based on a joint distribution over the players’ decisions according to some optimality criterion. This is a form of equilibrium selection. Examples of correlated equilibria in nonzero-sum games related to the best choice problem are given. Several concepts of criteria for selecting a correlated equilibrium are used.     

Two Different Approaches to Nonzero-Sum Stochastic Differential Games

We make the link between two approaches to Nash equilibria for nonzero-sum stochastic differential games: the first one using backward stochastic differential equations and the second one using strategies with delay. We prove that, when both exist, the two notions of Nash equilibria coincide.     

Infinite horizon noncooperative differential games

For a noncooperative differential game, the value functions of the various players satisfy a system of Hamilton-Jacobi equations. In the present paper, we consider a class of infinite horizon games with nonlinear costs exponentially discounted in time. By the analysis of the value functions, we establish the existence of Nash equilibrium solutions in feedback form and provide results and counterexamples on their uniqueness and stability.     

Nonzero-sum non-stationary discounted Markov game model

The goal of this paper is provide a theory of K-person non-stationary Markov games with unbounded rewards, for a countable state space and action spaces. We investigate both the finite and infinite horizon problems. We define the concept of strong Nash equilibrium and present conditions for both problems for which strong Nash or Nash equilibrium strategies exist for all players within the Markov strategies, and show that the rewards in equilibrium satisfy the optimality equations.     

On stochastic games in economics

In this paper we show that many results on equilibria in stochastic games arising from economic theory can be deduced from the theorem on the existence of a correlated equilibrium due to Nowak and Raghavan. Some new classes of nonzero-sum Borel state space discounted stochastic games having stationary Nash equilibria are also presented. Three nontrivial examples of dynamic stochastic games arising from economic theory are given closed form solutions. Research partially supported by MNSW grant 1 P03A 01030.     

Existence and uniqueness of a Nash equilibrium feedback for a simple nonzero-sum differential game

Existence and uniqueness of a Nash equilibrium feedback is established for a simple class nonzero-sum differential games on the line.     

On a class of nonzero-sum,linear-quadratic differential games

A class of two-player, nonzero-sum, linear-quadratic differential games is investigated for Nash equilibrium solutions when both players use closed-loop control and when one or both of the players are required to use open-loop control. For three formulations of the game, necessary and sufficient conditions are obtained for a particular strategy set to be a Nash equilibrium strategy set. For a fourth formulation of the game, where both players use open-loop control, necessary and sufficient conditions for the existence of a Nash equilibrium strategy set are developed. Several examples are presented in order to illustrate the differences between this class of differential games and its zero-sum analog.This research was supported by the National Science Foundation under Grant No. GK-3341.