Dynamic feedback Stackelberg games with non-unique solutions

Stackelberg games, which was originally introduced by Stackelberg, are widely applied in such fields as economics, management, politics and behavioral sciences. Stackelberg games can be modelled as a bi-level optimization problem. There exists an extensive literature about static bi-level optimization problems. However, the studies on dynamic bi-level optimization problems are fairly scarce in spite of the importance in explaining and predicting some phenomena rationally. In this paper, we consider discrete time dynamic Stackelberg games with feedback information. In general, the lower-level strategies are non-unique in practice. For a unique solution, dynamic programming algorithms have been presented with multiple players. We revisit dynamic programming for feedback information dynamic Stackelberg games with non-unique lower-level solution. First, we define some kind of solutions related to the decisions styles. Then, we analyze them, respectively. Moreover, dynamic programming algorithm is successful in solving solve feedback information dynamic Stackelberg games with non-unique lower-level solutions.     

Discrete time dynamic multi-leader–follower games with stage-depending leaders under feedback information

Discrete time dynamic Stackelberg games with alternating leaders are recently brought forward by and dynamic programming algorithms are extended to discrete time dynamic Stackelberg games of two players with alternating leaders under feedback information structure. In many practical problems, there are multiple leaders and multiple followers. Moreover, the positions of leaders and followers may change at some stages. We aim to extend the results of discrete time dynamic Stackelberg games with alternating leaders to multi-leader–follower games and to obtain a new type of game, dynamic multi-leader–follower game with stage-depending leaders. To simplify the problem, all players in the model are divided into two groups. At each stage, players in one group act as leaders and the players in other group are followers. In the subsequent stage, the positions may go to the contrary. Actually, whether the players in some group act as leaders or not at some stage, depends on the information at the previous stage(s). Furthermore, dynamic programming algorithms are extended to dynamic multi-leader–follower game with stage-depending leaders under feedback information structure in this paper.     

Sequential Stackelberg equilibria in two-person games

The concept of sequential Stackelberg equilibrium is introduced in the general framework of dynamic, two-person games defined in the Denardo contracting operator formalism. A relationship between this solution concept and the sequential Nash equilibrium for an associated extended game is established. This correspondence result, which can be related to previous results obtained by Baar and Haurie (1984), is then used for studying the existence of such solutions in a class of sequential games. For the zero-sum case, the sequential Stackelberg equilibrium corresponds to a sequential maxmin equilibrium. An algorithm is proposed for the computation of this particular case of equilibrium.This research was supported by SSHRC Grant No. 410-83-1012, NSERC Grant No. A4952, and FCAR Grants Nos. 86-CE-130 and EQ-0428.The authors thank T. R. Bielecki and J. A. Filar, who pointed out some mistakes and helped improving the paper.At the time of this research, this author was with GERMA, Ecole Mohammedia d'Ingénieurs, Rabat, Morocco.     

Discrete time dynamic Stackelberg games with the leaders in turn

In many dynamic Stackelberg games, the leader changes at each stage. A new type of dynamic Stackelberg game is initially put forward in this paper and is called dynamic Stackelberg games with the leaders in turn, in which players act as the leaders in turn. There exist extremely comprehensive applications for dynamic Stackelberg games with the leaders in turn. On the one hand, in this work we aim to establish models for a new type of game, dynamic Stackelberg games of multiple players with leaders in turn, which are induced from some economic and political phenomena, which play exceedingly important roles in many fields. On the other hand, we hope to extend dynamic programming algorithms to the new model under feedback information structure.     

Stackelberg strategies in linear-quadratic stochastic differential games

This paper obtains the Stackelberg solution to a class of two-player stochastic differential games described by linear state dynamics and quadratic objective functionals. The information structure of the problem is such that the players make independent noisy measurements of the initial state and are permitted to utilize only this information in constructing their controls. Furthermore, by the very nature of the Stackelberg solution concept, one of the players is assumed to know, in advance, the strategy of the other player (the leader). For this class of problems, we first establish existence and uniqueness of the Stackelberg solution and then relate the derivation of the leader's Stackelberg solution to the optimal solution of a nonstandard stochastic control problem. This stochastic control problem is solved in a more general context, and its solution is utilized in constructing the Stackelberg strategy of the leader. For the special case Gaussian statistics, it is shown that this optimal strategy is affine in observation of the leader. The paper also discusses numerical aspects of the Stackelberg solution under general statistics and develops algorithms which converge to the unique Stackelberg solution.This work was performed while the second author was on sabbatical leave at the Department of Applied Mathematics, Twente University of Technology, Enschede, Holland.     

Pricing problems with a continuum of customers as stochastic Stackelberg games

The pricing problem where a company sells a certain kind of product to a continuum of customers is considered. It is formulated as a stochastic Stackelberg game with nonnested information structure. The inducible region concept, recently developed for deterministic Stackelberg games, is extended to treat the stochastic pricing problem. Necessary and sufficient conditions for a pricing scheme to be optimal are derived, and the pricing problem is solved by first delineating its inducible region, and then solving a constrained optimal control problem.The research work reported here as supported in part by the National Science Foundation under Grant ECS-81-05984, Grant ECS-82-10673, and by the Air Force Office of Scientific Research under AFOSR Grant 80-0098.     

A note on clemhout and Wan's dynamic games of common property resources

Recently, Clemhout and Wan (Ref. 1) provided solutions to a class of stochastic differential game models concerning common property resources. However, they only established closed-loop strategies for the infinite-horizon problem using the Kushner test. In this paper, we provide closed-loop feedback solutions to their game in a finite-time horizon with deterministic evolution dynamics.The helpful comments of an anonymous referee are gratefully acknowledged.     

A note on nonzero-sum differential games with bargaining solution

The extension of Nash's bargaining solution to differential games is discussed. It is shown that a closed-loop solution verifies very stringent necessary conditions and that an open-loop solution can present serious weakness from a normative point of view.This research has been supported by the Canada Council (S73-0935) and the Ministère de l'Education du Québec (DGES).     

A dynamic solution concept for abstract games

Several solution concepts have been defined for abstract games. Some of these are the core, due to Gillies and Shapley, the Von Neumann-Morgenstern stable sets, and the subsolutions due to Roth. These solution concepts are rather static in nature. In this paper, we propose a new solution concept for abstract games, called the dynamic solution, that reflects the dynamic aspects of negotiation among the players. Some properties of the dynamic solution are studied. Also, the dynamic solution of abstract games arising fromn-person cooperative games in characteristic function form is investigated.This research was supported by the Office of Naval Research under Contract No. N00014-75-C-0678, by the National Science Foundation under Grants Nos. MPS-75-02024 and MCS-77-03984 at Cornell University, by the United States Army under Contract No. DAAG-29-75-C-0024, and by the National Science Foundation under Grant No. MCS-75-17385-A01 at the University of Wisconsin. The author is grateful to Professor W. F. Lucas under whose guidance the research was conducted.     

A note on two-person zero-sum communicating stochastic games

For undiscounted two-person zero-sum communicating stochastic games with finite state and action spaces, a solution procedure is proposed that exploits the communication property, i.e., working with irreducible games over restricted strategy spaces. The proposed procedure gives the value of the communicating game with an arbitrarily small error when the value is independent of the initial state.     

A note on repeated games with non-monotonie value

We show that even when the information structure is independent of the state of nature, the value of then-stage zero-sum game with incomplete information is not necessarily monotonie with respect to the length of the game. More precisely, we give an example of such ann-stage game in whichV ₁ >V ₂ <V ₃.I am very grateful to Ehud Lehrer who introduced this question to me.     

Performance versus informativeness in linear-quadratic Gaussian noncooperative games

In this paper, we study the impact of informativeness on the performance of linear quadratic Gaussian Nash and Stackelberg games. We first show that, in two-person static Nash games, if one of the players acquires more information, then this extra information is beneficial to him, provided that it is orthogonal to both players' information. A special case is that when one of the players is informationally stronger than the other, then any new information is beneficial to him. We then show that a similar result holds for dynamic Nash games. In the dynamic games, the players use strategies that are linear functions of the current estimates of the state, generated by two Kalman filters. The same properties are proved to hold in static and feedback Stackelberg games as well.This work was partially supported by the US Air Force Office of Scientific Research under Grant No. AFOSR-82-0174.     

A note on isomorphism and strategic equivalence of cooperative games

In this note, we will give several examples to illustrate that two essential games which are isomorphic are not necessarily S-equivalent when the cores of both games are “small” or empty. In other words, we show that whether two isomorphic games are S-equivalent can not be justified in terms of the “size” of the core.     

A note on continuous dependence of solutions of dynamic equations on time scales

We give a precise formulation and a proof as constructive as possible of the widely accepted claim that solutions of a dynamic equation depend continuously on the base time scale. Our approach to this problem is via Euler polygons which opens possibilities for development of numerical analysis of dynamic equations on time scales.     

A note on oscillation criteria for second-order neutral dynamic equations on isolated time scales

The principal goal of this paper is to amend oscillation results obtained in the recent paper by Saker and O’Regan (2011) [9].     

A dynamic programming algorithm for dynamic lot size models with piecewise linear costs

We propose a new algorithm for dynamic lot size models (LSM) in which production and inventory cost functions are only assumed to be piecewise linear. In particular, there are no assumptions of convexity, concavity or monotonicity. Arbitrary capacities on both production and inventory may occur, and backlogging is allowed. Thus the algorithm addresses most variants of the LSM appearing in the literature. Computational experience shows it to be very effective on NP-hard versions of the problem. For example, 48 period capacitated problems with production costs defined by eight linear segments are solvable in less than 2.5 minutes of Vax 8600 cpu time.     

Common resources, optimality and taxes in dynamic games with increasing number of players

In the paper we examine the problem of exploitation of a common renewable resource. We use two kinds of models of this problem: games with finitely many players and games with a continuum of players. Equilibria in both cases are calculated and the payoffs are compared with payoffs in the situation in which each player behaves as a single owner of the resource. Various concepts of optimality are considered: optimality in the sense of property, Pareto optimality, maximization of a social welfare function of specific type and environmental sustainability. Another issue is the problem of enforcement of assumed profiles by so-called “linear” tax systems. Special attention is paid to the comparison of games with finitely many players and their continuum-of-players limit game.     

Max-min controllability in pursuit games with norm-bounded controls

In this article, we consider max-min controllability in linear pursuit games with norm-bounded controls. Our approach is based on the separation theorem of disjoint compact convex sets in Euclidean space. Necessary and sufficient conditions for max-min controllability are given in terms of an explicit relative controllability expression which, in a sense, is a comparison between the control capabilities of the competing parties. Minimal time and optimal norm problems are investigated.     

On the stability of evolutionary dynamics in games with incomplete information

In an interaction it is possible that one agent has features it is aware of but the opponent is not. These features (e.g. cost, valuation or fighting ability) are referred to as the agent’s type. The paper compares two models of evolution in symmetric situations of this kind. In one model the type of an agent is fixed and evolution works on strategies of types. In the other model every agent adopts with fixed probabilities both types, and type-contingent strategies are exposed to evolution. It is shown that the dynamic stability properties of equilibria may differ even when there are only two types and two strategies. However, in this case the dynamic stability properties are generically the same when the payoff of a player does not depend directly on the type of the opponent. Examples illustrating these results are provided.     

A dynamic approach to the Shapley value based on associated games

We propose a dynamic process leading to the Shapley value of TU games or any solution satisfying Inessential Game (IG) and Continuity (CONT), based on a modified version of Hamiache's notion of an associated game. The authors are very grateful to William Thomson and two anonymous referees for valuable comments which much improve the paper. They provide better statements and proofs of several major results than the original ones.