On the saddle-point solution of a class of stochastic differential games

This paper deals with the saddle-point solution of a class of stochastic differential games described by linear state dynamics and quadratic objective functionals. The information structure of the problem is such that both players have access to a common noisy linear measurement of the state and they are permitted to utilize only this information in constructing their controls. The saddle-point solution of such differential game problems has been discussed earlier in Ref. 1, but the conclusions arrived there are incorrect, as is explicitly shown in this paper. We extensively discuss the role of information structure on the saddle-point solution of such stochastic games (specifically within the context of an illustrative discrete-time example) and then obtain the saddle-point solution of the problem originally formulated by employing an indirect approach.This work was done while the author was on sabbatical leave at Twente University of Technology, Department of Applied Mathematics, Enschede, Holland, from Applied Mathematics Division, Marmara Scientific and Industrial Research Institute, Gebze, Kocaeli, Turkey.     

On the uniqueness of Nash strategies for a class of analytic differential games

The uniqueness of Nash equilibria is shown for the case where the data of the problem are analytic functions and the admissible strategy spaces are restricted to analytic functions of the current state and time.This work was supported in part by the Joint Services Electronics Program (US Army, US Navy, and US Air Force) under Contract No. DAAB-07-72-C-0259, in part by the National Science Foundation under Grant No. ENG-74-20091, and in part by the Department of Energy, Electric Energy Systems Division under Contract No. US ERDA EX-76-C-01-2088.     

Informational uniqueness of closed-loop Nash equilibria for a class of nonstandard dynamic games

This paper discusses an extension of the currently available theory of noncooperative dynamic games to game models whose state equations are of order higher than one. In a discrete-time framework, it first elucidates the reasons why the theory developed for first-order systems is not applicable to higher-order systems, and then presents a general procedure to obtain an informationally unique Nash equilibrium solution in the presence of random disturbances. A numerical example solved in the paper illustrates the general approach.Dedicated to G. LeitmannResearch that led to this paper was supported in part by the Office of Naval Research under Contract No N00014-82-K-0469 and in part by the U.S. Air Force under Grant No. AFOSR-84-0054.     

On differential games with a feedback nash equilibrium

This note provides a lemma on differential games which possess a feedback Nash equilibrium (FNE). In particular, it shows that (i) a class of games with a degenerate FNE can be constructucted from every game which has a nondegenerate FNE and (ii) a class of games with a nondegenerate FNE can be constructed from every game which has a degenerate FNE.The author would like to thank an anonymous referee for invaluable comments and suggestions.     

Carathéodory's method for a class of dynamic games

The method of equivalent variational methods, originally due to Carathéodory for free problems in the calculus of variations is extended to investigate feedback Nash equilibria for a class of n-person differential games. Both the finite-horizon and infinite-horizon cases are considered. Examples are given to illustrate the presented results.     

On nash equilibrium solutions in nonzero-sum stochastic games with complete information

Two-person nonzero-sum stochastic games with complete information are considered. It is shown that it is sufficient to search the equilibrium solutions in a class of deterministic strategy pairs — the so-calledintimidation strategy pairs. Furthermore, properties of the set of all equilibrium losses of such strategy pairs are proved.     

On Nikaido-Isoda type theorems for discounted stochastic games

We present a class of countable state space stochastic games with discontinuous payoff functions satisfying some assumptions similar to the ones of Nikaido and Isoda for one-stage games. We prove that these games possess stationary equilibria. We show that after adding some concavity assumptions these equilibria are nonrandomized. Further, we present an example of input (or production) dynamic game satisfying the assumptions of our model. We give a closed-form solution for this game.     

Some thoughts on saddle-point conditions and information structures in zero-sum differential games

For a very simple two-stage, linear-quadratic, zero-sum difference game with dynamic information structure, we show that (i) there exist nonlinear saddle-point strategies which require the same existence conditions as the well-known linear, closed-loop, no-memory solution and (ii) there exist both linear and nonlinear saddle-point strategies which require more stringent conditions than the unique open-loop solution. We then discuss the implication of this result with respect to the existence of saddle points in zero-sum differential games for different information patterns.     

Sufficient conditions for Nash bargaining in differential games

Sufficient conditions for Nash bargaining in differential games are given. These conditions are compared with the sufficient conditions given by Liu (Ref. 1).     

Strong stability of Nash equilibria in load balancing games

We study strong stability of Nash equilibria in load balancing games of m(m 2)identical servers,in which every job chooses one of the m servers and each job wishes to minimize its cost,given by the workload of the server it chooses.A Nash equilibrium(NE)is a strategy profile that is resilient to unilateral deviations.Finding an NE in such a game is simple.However,an NE assignment is not stable against coordinated deviations of several jobs,while a strong Nash equilibrium(SNE)is.We study how well an NE approximates an SNE.Given any job assignment in a load balancing game,the improvement ratio(IR)of a deviation of a job is defined as the ratio between the pre-and post-deviation costs.An NE is said to be aρ-approximate SNE(ρ1)if there is no coalition of jobs such that each job of the coalition will have an IR more thanρfrom coordinated deviations of the coalition.While it is already known that NEs are the same as SNEs in the 2-server load balancing game,we prove that,in the m-server load balancing game for any given m 3,any NE is a(5/4)-approximate SNE,which together with the lower bound already established in the literature yields a tight approximation bound.This closes the final gap in the literature on the study of approximation of general NEs to SNEs in load balancing games.To establish our upper bound,we make a novel use of a graph-theoretic tool.     

不确定条件下n人非合作博弈均衡点集的通有稳定性

基于经典博弈模型的Nash均衡点集的通有稳定性和具有不确定参数的n人非合作博弈均衡点的概念,探讨了具有不确定参数博弈的均衡点集的通有稳定性.参照Nash均衡点集稳定性的统一模式,构造了不确定博弈的问题空间和解空间,并证明了问题空间是一个完备度量空间,解映射是上半连续的,且解集是紧集（即usco（upper semicontinuous and compact-valued）映射）,得到不确定参数博弈模型的解集通有稳定性的相关结论.     

A BSDE approach to Nash equilibrium payoffs for stochastic differential games with nonlinear cost functionals

In this paper, we study Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games via the theory of backward stochastic differential equations. We obtain an existence theorem and a characterization theorem of Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games with nonlinear cost functionals defined with the help of doubly controlled backward stochastic differential equations. Our results extend former ones by Buckdahn et al. (2004) [3] and are based on a backward stochastic differential equation approach.     

On purification of equilibrium in Bayesian games and expost Nash equilibrium

Treating games of incomplete information, we demonstrate that the existence of an ex post stable strategy vector implies the existence of an approximate Bayesian equilibrium in pure strategies that is also expost stable. Through examples we demonstrate the ‘bounds obtained on the approximation’ are tight. The main results of this paper first appeared in University of Warwick Department of Economics Discussion Paper #710. 2004.     

Interactive economic dynamics and differential games

This survey reviews the applications of differential game theory in analyzing issues in the economic literature. The needs of the economic discipline are juxtaposed with the merits of various existing types of differential games. Suggestions are also made as to areas holding great promise for future research.The authors are grateful to Prof. George Leitmann for suggestions to their final draft, which improved the clarity of certain assumptions in keeping with the literature.     

Advertising in a Differential Oligopoly Game

We illustrate a differential oligopoly game where firms compete à la Cournot in homogeneous goods in the market phase and invest in advertising activities aimed at increasing the consumers reservation price. Such investments produce external effects, characterizing the advertising activity as a public good. We derive the open-loop and closed-loop Nash equilibria, and show that the properties of the equilibria depend on the curvature of the market demand function. The comparative assessment of these equilibria shows that the firms advertising efforts are larger in the open-loop equilibrium than in the closed-loop equilibrium. We also show that a cartel involving all the firms, setting both output levels and advertising efforts, may produce a steady state where the social welfare level is higher than the social welfare levels associated with both open-loop and closed-loop noncooperative settings.     

A solution for noncooperative games

In this paper, we study solutions of strict noncooperative games that are played just once. The players are not allowed to communicate with each other. The main ingredient of our theory is the concept of rationalizing a set of strategies for each player of a game. We state an axiom based on this concept that every solution of a noncooperative game is required to satisfy. Strong Nash solvability is shown to be a sufficient condition for the rationalizing set to exist, but it is not necessary. Also, Nash solvability is neither necessary nor sufficient for the existence of the rationalizing set of a game. For a game with no solution (in our sense), a player is assumed to recourse to a standard of behavior. Some standards of behavior are examined and discussed.This work was sponsored by the United States Army under Contract No. DAAG29-75-C-0024 and by the National Science Foundation under Grant No. MCS-75-17385-A01. The author is grateful to J. C. Harsanyi for his comments and to S. M. Robinson for suggesting the problem.     

On the stability of the solution for multiobjective generalized games with the payoffs perturbed

This paper studies the stability of weakly Pareto-Nash and Pareto-Nash equilibrium for multiobjective generalized games with the payoff perturbed. Using a simple characterization of the weakly Pareto-Nash solution, we obtain a generic continuous result concerning weakly Pareto-Nash solution mapping. Examples are given to show that Pareto-Nash equilibrium mapping is neither upper semicontinuous nor lower semicontinuous. Through seeking the sub-mapping, we prove that most multiobjective generalized games have at least one essential Pareto-Nash solution.     

On a class of differential games without saddle-point solutions

The minimax solution of a linear regulator problem is considered. A model representing a game situation in which the first player controls the dynamic system and selects a suitable, minimax control strategy, while the second player selects the aim of the game, is formulated. In general, the resulting differential game does not possess a saddle-point solution. Hence, the minimax solution for the player controlling the dynamic system is sought and obtained by modifying the performance criterion in such a way that (a) the minimax strategy remains unchanged and (b) the modified game possesses a saddle-point solution. The modification is achieved by introducing a regularization procedure which is a generalization of the method used in an earlier paper on the quadratic minimax problem. A numerical algorithm for determining the nonlinear minimax strategy in feedback form, in which Pagurek's result on open-loop and closed-loop sensitivity is used to nontrivially simplify the computational aspects of the problem, is presented and applied on a simple example.