Cautious strategy update promotes cooperation in spatial prisoner’s dilemma game

In the realistic world, individual cautiousness can be often involved or observed when a rational individual makes a decision. However, it remains unclear how such individual cautiousness influences the evolution of cooperative behavior. To this end, we consider a Fermi strategy updating rule, where each individual is assigned a cautiousness index that controls its learning activity, and then study the evolution of cooperation in the spatial prisoner’s dilemma game. Interestingly, it is found that cooperation can be significantly promoted when individuals’ cautiousness is considered. In particular, there exists an optimal range of the degree of cautiousness resulting in the highest cooperation level. The remarkable promotion of cooperation, as well as the emerging phase transition is explained by configurational analysis. The sensitivity of cooperation to initial states with different fractions of cooperators is also discussed. The result illustrates that high densities of cooperators can be established at small initial fractions of cooperators. The detailed mechanism for such phenomenon is explained by analyzing the typical initial configurations.     

Evolutionary prisoner’s dilemma game in flocks

We investigate an evolutionary prisoner’s dilemma game among self-driven agents, where collective motion of biological flocks is imitated through averaging directions of neighbors. Depending on the temptation to defect and the velocity at which agents move, we find that cooperation can not only be maintained in such a system but there exists an optimal size of interaction neighborhood, which can induce the maximum cooperation level. When compared with the case that all agents do not move, cooperation can even be enhanced by the mobility of individuals, provided that the velocity and the size of neighborhood are not too large. Besides, we find that the system exhibits aggregation behavior, and cooperators may coexist with defectors at equilibrium.     

Impact of conformity on the evolution of cooperation in the prisoner’s dilemma game

We present an evolutionary model of the prisoner’s dilemma game taking into account two cognitive mechanisms: (1) payoff-biased strategy transmission and (2) a conformity mechanism involving a tendency to copy the most frequent nearby strategy in a group. Moreover, for two types of conformity, a minority mechanism and a majority rule, a dual process holds whereby the types differ in both the factors that give rise to them and the effects they have. By contrast, a signal process suggests that differences between the two forms of influence are primarily of degree and that fundamental processes are at work in both. We explore the model using both well-mixed and spatially structured populations. When the temptation to defect is low and both conformism and local interactions are present, the system can reach high levels of cooperation or even a full cooperation state. Furthermore, we find a stronger effect of conformity and a higher level of cooperation among the population regardless of the group size. This indicates that conformity follows a signal process. However, when the temptation to defect is rather large, results for the minority influence change non-monotonically with conformism cohesion. This is remarkably different from the results under majority rule, which is considered as support for the dual process.     

The effect of recommended role models in prisoner’s dilemma game

Previous studies concerning the prisoner’s dilemma game on graphs conventionally assume that individuals select role models from their replacement graphs at random. We propose a extended prisoner’s dilemma game model to study the impact of recommended role models on the evolution of cooperation in a homogeneous population. Individuals are endowed with the capacity to recommend the ones they imitated in the past to their neighbors for strategy updating. Numerical simulations show that cooperation can be improved significantly when recommendation is allowed. Our results might be helpful in explaining the widespread cooperation in the real world.     

Promotion of cooperation in aspiration-based spatial prisoner’s dilemma game

We introduce a deterministic aspiration-based learning mechanism into the prisoner’s dilemma game on regular lattices and then investigate the evolution of cooperation for different values of aspiration level A. It is found that the cooperation level exhibits discontinuous phase transition with A and there is a moderate aspiration level that can best favor the cooperative behavior. Besides, the evolution time series show the so-called “ping-pong effect” for both high and low aspiration levels. The evolution of spatial patterns is also investigated. It is found that the cooperator frequency is not sensitive to the initial condition but the evolutionary patterns can be quite different.     

Integrating neighborhoods in the evaluation of fitness promotes cooperation in the spatial prisoner’s dilemma game

A fundamental question of human society is the evolution of cooperation. Many previous studies explored this question via setting spatial background, where players obtain their payoffs by playing game with their nearest neighbors. Another undoubted fact is that the environment plays an important role in the individual development. Inspired by these phenomena, we reconsider the definition of individual fitness which integrates the environment, denoted by the average payoff of all individual neighbors, with the traditional individual payoffs by introducing a selection parameter u. Tuning u equal to zero returns the traditional version, while increasing u bears the influence of environment. We find that considering the environment, i.e., integrating neighborhoods in the evaluation of fitness, promotes cooperation. If we enhance the value of u, the invasion of defection could be resisted better. We also provide quantitative explanations and complete phase diagrams presenting the influence of the environment on the evolution of cooperation. Finally, the universality of this mechanism is testified for different neighborhood sizes, different topology structures and different game models. Our work may shed light on the emergence and persistence of cooperation in our life.     

Coevolutionary,coexisting learning and teaching agents model for prisoner’s dilemma games enhancing cooperation with assortative heterogeneous networks

Unlike other natural network systems, assortativity can be observed in most human social networks, although it has been reported that a social dilemma situation represented by the prisoner’s dilemma favors dissortativity to enhance cooperation. We established a new coevolutionary model for both agents’ strategy and network topology, where teaching and learning agents coexist. Remarkably, this model enables agents’ enhancing cooperation more than a learners-only model on a time-frozen scale-free network and produces an underlying assortative network with a fair degree of power-law distribution. The model may imply how and why assortative networks are adaptive in human society.     

Elimination mechanism promotes cooperation in coevolutionary prisoner’s dilemma games

We propose an elimination mechanism in the study of the evolutionary prisoner’s dilemma games on evolving networks. It assumes that after each round of playing, players whose payoffs are below a certain threshold will be eliminated from the game and the same number of new nodes will be added to the network to maintain the size of the network constant. Numerical results show that moderate values of elimination threshold can result in a maximum cooperation level in the evolutionary prisoner’s dilemma game. Moreover, the elimination mechanism can make the network structure evolve into a high heterogeneity in degree distribution, which is considered to be helpful in promoting cooperation in evolutionary games. The present study may provide new insight for understanding the evolution of cooperation in light of the law ‘survival of the fittest’ in nature.     

Age-related vitality of players promotes the evolution of cooperation in the spatial prisoner’s dilemma game

Within most real biological or social systems, age plays an important role in the vitality of individuals. For instance, individuals become more and more weak with age, while young individuals may prosper even under poor living conditions. In this paper, we find that aging as a coevolutionary process promotes cooperation more effectively than quenched heterogeneous distributions of age. By studying the average age of defectors and cooperators along the boundaries separating the domains of the two strategies, we reveal the significance of coevolutionary rules for the successful evolution of cooperation amongst selfish and unrelated individuals.     

Promotion of cooperation by aspiration-induced migration

In this paper, we study an aspiration-induced migration model, in which each individual plays the prisoner’s dilemma game with those being within a circle of radius r centered on himself/herself. An individual will migrate to a randomly chosen place with the velocity v if his/her payoff is below the aspiration level. We report that cooperative behavior is favored when the aspiration level and interaction radius are moderate, and the migration velocity is slow.     

Evolution of cooperation among mobile agents with heterogenous view radii

In this paper, we study cooperative behavior among mobile agents; the agents have heterogenous view radii and they play the prisoner’s dilemma game with those being within their vision fields. It is found that the cooperation level is remarkably promoted when the heterogeneity of view radii is considered, and the degree distribution of the system is investigated to explain this interesting phenomenon. Moreover, we report that the cooperative behavior is best favored by low density, moderate view radius, and small moving speed. Our findings may be helpful in understanding cooperative behavior in natural and social systems consisting of mobile agents.     

Memory-based evolutionary game on small-world network with tunable heterogeneity

Most papers about evolutionary games on graph assume agents have no memory. Yet, in the real world, interaction history can also affect an agent’s decision. So we introduce a memory-based agent model and investigate the Prisoner’s Dilemma game on a Heterogeneous Newman-Watts small-world network based on a Genetic Algorithm, focusing on heterogeneity’s role in the emergence of cooperative behaviors. In contrast with previous results, we find that a different heterogeneity parameter domain range imposes an entirely different impact on the cooperation fraction. In the parameter range corresponding to networks with extremely high heterogeneity, the decrease in heterogeneity greatly promotes the proportion of cooperation strategy, while in the remaining parameter range, which relates to relatively homogeneous networks, the variation of heterogeneity barely affects the cooperation fraction. Also our study provides a detailed insight into the microscopic factors that contribute to the performance of cooperation frequency.     

Evolutionary prisoner’s dilemma game on weighted scale-free networks

This paper investigates the evolutionary prisoner’s dilemma on weighted scale-free networks. The weighted networks are generated by adopting Barabási-Albert scale-free network and assigning link weight with w_ij=(k_i×k_j)^β. Simulation results show that the cooperation frequency has a strong dependence on β. The value of β which is associated with the maximal cooperation frequency has been sought out. Moreover, Gini coefficient and Pareto exponent of the system’s wealth distribution are investigated. The inequality of wealth distribution is minimized at β≈−1.     

Adjusting learning motivation to promote cooperation

An evolutionary prisoner’s dilemma game with players adjusting their learning motivation is studied. At each time step, each player can adjust his/her learning motivation according to the difference between the current payoff and payoff aspiration. Greater payoff aspiration means stronger learning motivation, and vice versa. We find that the density of cooperation in a spatial prisoner’s dilemma game is enhanced when the learning motivation mechanism is considered. Meanwhile, we show that proper noise can not only induce the highest cooperation level but also can maintain the cooperation phenomenon even though there is more temptation to defect.     

Role of memory effect in the evolution of cooperation based on spatial prisoner's dilemma game

We investigate the impact of memory effect on the evolution of cooperation in the spatial prisoner's dilemma game, in which each player will record his own strategies during the previous M game rounds (here, M is also named as the memory length). At each time step, each individual will update his current strategy according to the Fermi-like probability which will be multiplied by a pre-factor, and this factor will be correlated with the fraction of previous strategy states identical with the individual strategy to be updated. The numerical simulation results demonstrate that the memory length will largely influence the cooperation level at the stationary state, and it is clearly shown that the intermediate value of M will optimally favor the emergence of cooperation and the dynamical evolution, and characteristic patterns also support these conclusions. In addition, we depict the full cooperation phase diagrams and find that the cooperation region will be broadened under the case of moderate M values. The current results also indicate that the limited memory may be enough for us to design the effective promotion mechanism and further understand the emergency of cooperation taking place upon many networked populations.     

Evolution of cooperation among mobile agents

We study the effects of mobility on the evolution of cooperation among mobile players, which imitate collective motion of biological flocks and interact with neighbors within a prescribed radius R. Adopting the the prisoner’s dilemma game and the snowdrift game as metaphors, we find that cooperation can be maintained and even enhanced for low velocities and small payoff parameters, when compared with the case that all agents do not move. But such enhancement of cooperation is largely determined by the value of R, and for modest values of R, there is an optimal value of velocity to induce the maximum cooperation level. Besides, we find that intermediate values of R or initial population densities are most favorable for cooperation, when the velocity is fixed. Depending on the payoff parameters, the system can reach an absorbing state of cooperation when the snowdrift game is played. Our findings may help understanding the relations between individual mobility and cooperative behavior in social systems.     

Other-regarding preference and the evolutionary prisoner’s dilemma on complex networks

Prevailing models of the evolutionary prisoner’s game on networks always assume that agents are pursuing their own profit maximization. But the results from experimental games show that many agents have other-regarding preference. In this paper, we study the emergence of cooperation from the prisoner’s dilemma game on complex networks while some agents exhibit other-regarding preference such as inequality aversion, envious and guilty emotions. Contrary to common ideas, the simulation results show that the existence of inequality aversion agents does not promote cooperation emergence on a BA (Barabási and Albert) scale-free network in most situations. If the defection attraction is big and agents exhibit strong preference for inequality aversion, the frequency of cooperators will be lower than in situations where no inequality aversion agents exist. In some cases, the existence of the inequality agents will even induce the frequency of cooperators to zero, a feature which is not observed in previous research on the prisoner’s dilemma game when the underlying interaction topology is a BA scale-free network. This means that if an agent cares about equality too much, it will be difficult for cooperation to emerge and the frequency of cooperators will be low on BA networks. The research on the effect of envy or guilty emotions on the emergence of cooperation in the prisoner’s dilemma game on BA networks obtains similar results, though some differences exist. However, simulation results on a WS (Watts and Strogatz) small-world network display another scenario. If agents care about the inequality of agents very much, the WS network favors cooperation emergence in the prisoners’ dilemma game when other-regarding agents exist. If the agent weight on other-regarding is lowered, the cooperation frequencies emerging on a WS network are not much different from those in situations without other-regarding agents, although the frequency of cooperators is lower than those of the situation without other-regarding preference agents sometimes. All the simulation results imply that inequality aversion and its variations can have important effects on cooperation emergence in the prisoner’s dilemma game, and different network topologies have different effects on cooperation emergence in the prisoner’s dilemma game played on complex networks.     

Individual’s strategy characterized by local topology conditions in prisoner’s dilemma on scale-free networks

We introduce a “gradient” to find out the defectors, and further a “topology potential” to characterize the individual’s strategy preference in the prisoner’s dilemma on scale-free networks. It is shown that the cooperators typically locate on the nodes with high topology potential and the defectors are mainly found on the nodes with small topology potential. A critical topology potential is found for the nodes where cooperators are nip and tuck with defectors. So the information of node’s degree, gradient and topology potential together can predict individual’s strategy decision in the prisoner’s dilemma on the complex networks.     

The effect of asymmetric payoff mechanism on evolutionary networked prisoner’s dilemma game

In social and biological systems, there are obvious individual divergence and asymmetric payoff phenomenon due to the strength, power and influence differences. In this paper, we introduce an asymmetric payoff mechanism to evolutionary Prisoner’s Dilemma Game (PDG) on scale-free networks. The co-effects of individual diversity and asymmetric payoff mechanism on the evolution of cooperation and the wealth distribution under different updating rules are investigated. Numerical results show that the cooperation is highly promoted when the hub nodes are favored in the payoff matrix, which seems to harm the interest of the majority. But the inequality of social wealth distribution grows with the unbalanced payoff rule. However, when the node difference is eliminated in the learning strategy, the asymmetric payoff rule will not affect the cooperation level. Our work may sharpen the understanding of the cooperative behavior and wealth inequality in the society.     

Statistical mechanics approach to a reinforcement learning model with memory

We introduce a two-player model of reinforcement learning with memory. Past actions of an iterated game are stored in a memory and used to determine player’s next action. To examine the behaviour of the model some approximate methods are used and confronted against numerical simulations and exact master equation. When the length of memory of players increases to infinity the model undergoes an absorbing-state phase transition. Performance of examined strategies is checked in the prisoner’ dilemma game. It turns out that it is advantageous to have a large memory in symmetric games, but it is better to have a short memory in asymmetric ones.