Evolution of cooperation in the spatial public goods game with the third-order reputation evaluation

In this letter, in order to deeply explore the role of individual reputation in the evolutionary game dynamics, we present a new third-order reputation evaluation model to discuss the evolution of cooperation in the spatial public goods game. In the current model, we should not only consider the strategy (cooperation, C or defection, D) of a focal player, but also take his own reputation and his opponent's reputation status into account. Among them, the individual reputation will be divided into being good and bad according to the specified threshold, and the good player will be endowed with the more influential strategy transfer ability, which further helps to create the clusters of cooperative and good players within the population and then fosters the cooperation. A large plethora of experimental simulation results indicate that four rules under the third-order reputation mechanism can lead to the promotion of cooperation when compared to the traditional public goods game model. The current work is conductive to a better understanding of the persistence and emergence of collective cooperation in real-world systems.     

Fitness of others' evaluation effect promotes cooperation in spatial public goods game

Payoff-driven strategy updating rule has always been adopted as a classic mechanism, but up to now, there have been a great many of researches on considering other forms of strategy updating rules, among which pursuing high fitness is one of the most direct and conventional motivations in the decision-making using game theory. But there are few or no researches on fitness from the perspective of others' evaluation. In view of this, we propose a new model in which the evaluation effect with fitness-driven strategy updating rule is taken into consideration, and introduce an evaluation coefficient to present the degree of others' evaluation on individual's behavior. The cooperative individuals can get positive evaluation, otherwise defective individuals get negative evaluation, and the degree of evaluation is related to the number of neighbors who have the same strategy of individual. Through numerical simulation, we find that the evaluation effect of others can enhance the network reciprocity, thus promoting the cooperation. For a strong dilemma, the higher evaluation coefficient can greatly weaken the cooperation dilemma; for a weak one, the higher evaluation coefficient can make cooperator clusters spread faster, however, there is no significant difference in the level of cooperation in the final stable state among different evaluation coefficients. The cooperation becomes more flourish as the number of fitness-driven individuals increases, when all individuals adopt fitness-driven strategy updating rule, the cooperators can quickly occupy the whole population. Besides, we demonstrate the robustness of the results on the WS small-world network, ER random network, and BA scale-free network.     

Reputation-based strategy persistence promotes cooperation in spatial social dilemma

Understanding the emergence and maintenance of cooperation in social dilemma has received a lot of attention. In previous research, many scholars found that the reputation mechanism can promote cooperation, and the variation of reputation is consistent. However, in reality, according to both one's current action and past experiences, every individual's impression from others is modified to varying extent everyday. In other words, the length of duration of the same performance influences the diverse scale of their own reputation fluctuation. Therefore, a reputation-based strategy persistence mechanism, in which the increment of current reputation is determined by the persistence of last strategy, is proposed. Moreover, we introduce a parameter α to illustrate the impact of strategy persistence on reputation variation. The results of simulation show that the new mechanism paves the way for cooperation in evolutionary game, and the smaller α is, the better the mechanism performs.     

Role of memory effect in the evolution of cooperation based on spatial prisoner's dilemma game

We investigate the impact of memory effect on the evolution of cooperation in the spatial prisoner's dilemma game, in which each player will record his own strategies during the previous M game rounds (here, M is also named as the memory length). At each time step, each individual will update his current strategy according to the Fermi-like probability which will be multiplied by a pre-factor, and this factor will be correlated with the fraction of previous strategy states identical with the individual strategy to be updated. The numerical simulation results demonstrate that the memory length will largely influence the cooperation level at the stationary state, and it is clearly shown that the intermediate value of M will optimally favor the emergence of cooperation and the dynamical evolution, and characteristic patterns also support these conclusions. In addition, we depict the full cooperation phase diagrams and find that the cooperation region will be broadened under the case of moderate M values. The current results also indicate that the limited memory may be enough for us to design the effective promotion mechanism and further understand the emergency of cooperation taking place upon many networked populations.     

The effect of recommended role models in prisoner’s dilemma game

Previous studies concerning the prisoner’s dilemma game on graphs conventionally assume that individuals select role models from their replacement graphs at random. We propose a extended prisoner’s dilemma game model to study the impact of recommended role models on the evolution of cooperation in a homogeneous population. Individuals are endowed with the capacity to recommend the ones they imitated in the past to their neighbors for strategy updating. Numerical simulations show that cooperation can be improved significantly when recommendation is allowed. Our results might be helpful in explaining the widespread cooperation in the real world.     

Evolution of cooperation in lattice population with adaptive interaction intensity

We study the evolutionary Prisoner’s Dilemma game among individuals endowed with adaptively interaction intensity. Individuals adjust their interaction intensity according to the rules “payoff increase-high intensity, payoff decrease-low intensity”: if an individual’s payoff increases compared with that in the previous generation, he raises his interaction intensity; otherwise, he reduces the probability of interaction. We find that if individuals can adjust their interaction intensity with a proper scale, cooperation can be promoted. Interestingly, individuals with low interaction intensity usually hold the boundary of cooperator cluster. Such spatial distribution can alleviate the exploitation from defectors to cooperators since the interaction between cooperators and defectors is weakened. We hope our work can yield some insight into investigation of the evolution of cooperation in structured population.     

Reputation-based co-evolutionary model promotes cooperation in prisoner's dilemma game

Indirect reciprocity is a fascinating topic in the field of social cooperation. In this paper, we propose a novel updating strategy based on the critical reputation-aware calculation. The joint of reputation allows players to make decisions not only on current payoffs but also from a third party, which improves the status of cooperators in the prisoner's dilemma game and provides a possibility for surviving. Experiments show that the discrepancies in initial fitness caused by reputation will support cooperators in occupying a high proportion in communities. Interestingly, we find that the massive scale of reputation fluctuation helps to enhance the cooperative effect, and newly name this character as “quasi-time lag”. The simulations show that the promotion of our proposed mechanism is effective and robust on different network topologies. This work provides a new perspective for the study of the cooperative game.     

Impacts of memory on a regular lattice for different population sizes with asynchronous update in spatial snowdrift game

Memory is an important factor on the evolution of cooperation in spatial structure. For evolutionary biologists, the problem is often how cooperation acts can emerge in an evolving system. In the case of snowdrift game, it is found that memory can boost cooperation level for large cost-to-benefit ratio r, while inhibit cooperation for small r. Thus, how to enlarge the range of r for the purpose of enhancing cooperation becomes a hot issue recently. This paper addresses a new memory-based approach and its core lies in: Each agent applies the given rule to compare its own historical payoffs in a certain memory size, and take the obtained maximal one as virtual payoff. In order to get the optimal strategy, each agent randomly selects one of its neighbours to compare their virtual payoffs, which can lead to the optimal strategy. Both constant-size memory and size-varying memory are investigated by means of a scenario of asynchronous updating algorithm on regular lattices with different sizes. Simulation results show that this approach effectively enhances cooperation level in spatial structure and makes the high cooperation level simultaneously emerge for both small and large r. Moreover, it is discovered that population sizes have a significant influence on the effects of cooperation.     

Evolution of cooperation in a heterogeneous population with influential individuals

Influential individuals are introduced and integrated with the public goods game (PGG) to investigate their influence on the emergence and evolution of cooperation. In the model, some influential individuals whose behaviors can be controlled by us are introduced into a homogeneous population on a square lattice. The influential individuals can play three kinds of roles: I. exemplar, II. supervisor with the power to punish defectors, and III. supervisor with the power to reward cooperative co-players. It is found that the existence of influential individuals who play Role I turns out to be detrimental to cooperation and that the larger the number of influential individuals is, the more difficult it is for cooperation to be maintained. For those playing supervisory roles, both punishment and reward are found to be effective ways for the influential individuals to promote and stabilize cooperative behavior. By comparing the critical costs and the mean payoffs for a low multiplication factor under the role of punishment and the role of reward, it is found that reward is a more effective intervention measure than punishment for influential individuals seeking to improve cooperation and that reward leads to a higher mean payoff.     

Effects of Dimers on Cooperation in the Spatial Prisoner's Dilemma Game

We investigate the evolutionary prisoner's dilemma game in structured populations by introducing dimers, which are defined as that two players in each dimer always hold a same strategy. We find that influences of dimers on cooperation depend on the type of dimers and the population structure. For those dimers in which players interact with each other, the cooperation level increases with the number of dimers though the cooperation improvement level
depends on the type of network structures. On the other hand, the dimers, in which there are not mutual interactions, will not do any good to the cooperation level in a single community, but interestingly, will improve the cooperation level in a population with two communities. We explore the relationship between dimers and self-interactions and find that the effects of dimers are similar to that of self-interactions. Also, we find that the dimers, which are established over two communities in a multi-community network, act as one type of interaction through which information between communities is communicated by the requirement that two players in a dimer hold a same strategy.     

Promoting cooperation by local contribution under stochastic win-stay-lose-shift mechanism

We introduce a stochastic win-stay-lose-shift (WSLS) mechanism into evolutionary Prisoner’s Dilemma on small-world networks. At each time step, after playing with all its immediate neighbors, each individual gets a score to evaluate its performance in the game. The score is a linear combination of an individual’s total payoff (i.e., individual gain from the group) and local contribution to its neighbors (i.e., individual donation to the group). If one’s actual score is not larger than its desired score aspiration, it switches current strategy to the opposite one with the probability depending on the difference between the two scores. Under this stochastic WSLS regime, we assume that each focal individual gains its fixed score aspiration under the condition of full cooperation in its neighborhood, and find that cooperation is significantly enhanced under some certain parameters of the model by studying the evolution of cooperation. We also explore the influences of different values of learning rate and intensity of deterministic switch on the evolution of cooperation. Simulation results show that cooperation level monotonically increases with the relative weight of the local contribution to the score. For much low intensity of deterministic switch, cooperation is to a large extent independent of learning rate, and full cooperation can be reached when relative weight is not less than 0.5. Otherwise, cooperation level is affected by the value of learning rate. Besides, we find that the cooperation level is not sensitive to the topological parameters. To explain these simulation results, we provide corresponding analytical results based on mean-field approximation, and find out that simulation results are in close agreement with the analytical ones. Our work may be helpful in understanding the cooperative behavior in social systems based on this stochastic WSLS mechanism.     

Reputation-based network selection mechanism using game theory

Current and future wireless environments are based on the coexistence of multiple networks supported by various access technologies deployed by different operators. As wireless network deployments increase, their usage is also experiencing a significant growth. In this heterogeneous multi-technology multi-application multi-terminal multi-user environment users will be able to freely connect to any of the available access technologies. Network selection mechanisms will be required in order to keep mobile users “always best connected” anywhere and anytime. In such a heterogeneous environment, game theory techniques can be adopted in order to understand and model competitive or cooperative scenarios between rational decision makers. In this work we propose a theoretical framework for combining reputation-based systems, game theory and network selection mechanism. We define a network reputation factor which reflects the network’s previous behaviour in assuring service guarantees to the user. Using the repeated Prisoner’s Dilemma game, we model the user–network interaction as a cooperative game and we show that by defining incentives for cooperation and disincentives against defecting on service guarantees, repeated interaction sustains cooperation.     

Tolerance-based punishment in continuous public goods game

Altruistic punishment for defectors is considered as a key motive for the explanation of cooperation. However, there is no clear border between the cooperative and defective behaviors in a continuous strategy game. We propose a model to study the effect of punishment on the evolution of cooperation in continuous public goods game, wherein individuals have the traits to punish the co-players based on social tolerance. We show that a reasonable punishment with a uniform tolerance can spur individuals to make more investments. Additionally, for a fixed punishment cost and a fixed fine, a moderate value of tolerance can result in the best promotion of cooperation. Furthermore, we investigate the coevolutionary dynamics of investment and tolerance. We find that the population splits into two branches: high-tolerance individuals who make high investments and low-tolerance individuals who make low investments. A dynamic equilibrium is achieved between these two types of individuals. Our work extends punishment to continuous cooperative behaviors and the results may enhance the understanding of altruistic punishment in the evolution of human cooperation.     

The mechanism of alliance promotes cooperation in the spatial multi-games

In reality, individuals often tend to enhance their competitiveness by forming alliances with the partners sharing the same view. Motivated by this phenomenon, we propose a novel model considering the mechanism of alliance to investigate the evolution of cooperation in the spatial multi-games, in which the intensity of alliance could be adjusted by a parameter μ. In detail, the focal individual will contribute the ratio μ of his own payoff as a cost of the alliance, and then expect to gain the equal portion of average benefits of the neighbors holding the same strategy, which means that the individual fitness can be tuned by the intensity of alliance. Through extensive numerical simulations, one could find that the mechanism of alliance can significantly promote the prosperity of cooperation. Moreover, the larger the value of μ, the stronger the intensity of alliance, which could lead to the higher the level of cooperation. In particular, the evolutionary dynamics presents a complex situation when the co-changes of the intensity of alliance μ and sucker's payoff δ are commonly considered. Furthermore, we also verify the robustness of the proposed mechanism by using the diversity of the intensity of alliance and different network topologies. The current results are conducive to comprehending the emergence and persistence of cooperation within the real-world population.     

A 2-stage strategy updating rule promotes cooperation in the prisoner's dilemma game

In this study,we propose a spatial prisoner’s dilemma game model with a 2-stage strategy updating rule,and focus on the cooperation behavior of the system.In the first stage,i.e.,the pre-learning stage,a focal player decides whether to update his strategy according to the pre-learning factor β and the payoff difference between himself and the average of his neighbors.If the player makes up his mind to update,he enters into the second stage,i.e.,the learning stage,and adopts a strategy of a randomly selected neighbor according to the standard Fermi updating rule.The simulation results show that the cooperation level has a non-trivial dependence on the pre-learning factor.Generally,the cooperation frequency decreases as the pre-learning factor increases;but a high cooperation level can be obtained in the intermediate region of 3 < β < 1.We then give some explanations via studying the co-action of pre-learning and learning.Our results may sharpen the understanding of the influence of the strategy updating rule on evolutionary games.     

Evolution of cooperation among interacting individuals through molecular dynamics simulations

Using molecular dynamics (MD) simulation and evolutionary game theory, we incorporate the spacial structure of individuals into the study of the behaviors of cooperation, by adopting the prisoner's dilemma and snowdrift game as metaphors of cooperation between unrelated individuals. The results show that the introduction of spacial structure enhances cooperation using the strategy of prisoner's dilemma while does not make much changes to the cooperation if the strategy of snowdrift game is used. It is also found that our model is a meta-phase between regular ring graph model and complex network model. And the “activity of players” T^* we introduced makes our simulation much more closer to real world problems.     

Effects of Inertia on Evolutionary Prisoner's Dilemma Game

Considering the inertia of individuals in real life,we propose a modified Fermi updating rule,where the inertia of players is introduced into evolutionary prisoner's dilemma game(PDG) on square lattices.We mainly focus on how the inertia affects the cooperative behavior of the system.Interestingly,we find that the cooperation level has a nonmonotonic dependence on the inertia:with small inertia,cooperators will soon be invaded by defectors;with large inertia,players are unwilling to change their strategies and the cooperation level remains the same as the initial state;while a moderate inertia can induce the highest cooperation level.Moreover,effects of environmental noise and individual inertia are studied.Our work may be helpful in understanding the emergence and persistence of cooperation in nature and society.     

Integrating the environmental factor into the strategy updating rule to promote cooperation in evolutionary games

Many previous studies have shown that the environment plays an important role for social individuals. In this paper, we integrate the environmental factor, which is defined as the average payoff of all a player's neighbours, with the standard Fermi updating rule by introducing a tunable parameter, ω. It is found that the level of cooperation increases remarkably, and that the cooperators can better resist the invasion of defection with an increase in ω. This interesting phenomenon is then explained from a microscopic view. In addition, the universality of this mechanism is also proved with the help of the small-world network and the random regular graph. This work may be helpful in understanding cooperation behaviour in species from unicellular organisms up to human beings.     

Mechanisms for similarity based cooperation

Cooperation based on similarity has been discussed since Richard Dawkins introduced the term “green beard” effect. In these models, individuals cooperate based on an aribtrary signal (or tag) such as the famous green beard. Here, two different models for such tag based cooperation are analysed. As neutral drift is important in both models, a finite population framework is applied. The first model, which we term “cooperative tags” considers a situation in which groups of cooperators are formed by some joint signal. Defectors adopting the signal and exploiting the group can lead to a breakdown of cooperation. In this case, conditions are derived under which the average abundance of the more cooperative strategy exceeds 50%. The second model considers a situation in which individuals start defecting towards others that are not similar to them. This situation is termed “defective tags”. It is shown that in this case, individuals using tags to cooperate exclusively with their own kind dominate over unconditional cooperators.     

Effects of Inertia on Evolutionary Prisoner's Dilemma Game

Considering the inertia of individuals in real life, we propose a modified Fermi updating rule, where the inertia of players is introduced into evolutionary prisoner's dilemma game (PDG) on square lattices. We mainly focus on how the inertia affects the cooperative behavior of the system. Interestingly, we find that the cooperation level has a nonmonotonic dependence on the inertia: with small inertia, cooperators will soon be invaded by defectors; with large inertia, players are unwilling to change their strategies and the cooperation level remains the same as the initial state; while a moderate inertia can induce the highest cooperation level. Moreover, effects of environmental noise and individual inertia are studied. Our work may be helpful in understanding the emergence and persistence of cooperation in nature and society.