Fixation of competing strategies when interacting agents differ in the time scale of strategy updating

A commonly used assumption in evolutionary game theory is that natural selection acts on individuals in the same time scale; e.g., players use the same frequency to update their strategies. Variation in learning rates within populations suggests that evolutionary game theory may not necessarily be restricted to uniform time scales associated with the game interaction and strategy adaption evolution. In this study, we remove this restricting assumption by dividing the population into fast and slow groups according to the players' strategy updating frequencies and investigate how different strategy compositions of one group influence the evolutionary outcome of the other's fixation probabilities of strategies within its own group. Analytical analysis and numerical calculations are performed to study the evolutionary dynamics of strategies in typical classes of two-player games (prisoner's dilemma game, snowdrift game, and stag-hunt game). The introduction of the heterogeneity in strategy-update time scales leads to substantial changes in the evolution dynamics of strategies. We provide an approximation formula for the fixation probability of mutant types in finite populations and study the outcome of strategy evolution under the weak selection. We find that although heterogeneity in time scales makes the collective evolutionary dynamics more complicated, the possible long-run evolutionary outcome can be effectively predicted under technical assumptions when knowing the population composition and payoff parameters.