Coevolution of nonlinear group interactions and strategies in well-mixed and structured populations

In microbial populations and human societies, the rule of nonlinear group interactions strongly affects the intraspecific evolutionary dynamics, which leads to the variation of the strategy composition eventually. The consequence of such variation may retroact to the rule of the interactions. This correlation indicates that the rule of nonlinear group interactions may coevolve with individuals' strategies. Here, we develop a model to investigate such coevolution in both well-mixed and structured populations. In our model, positive and negative correlations between the rule and the frequency of cooperators are considered, with local and global information. When the correlation refers to the global information, we show that in well-mixed populations, the coevolutionary outcomes cover the scenarios of defector dominance, coexistence, and bi-stability. Whenever the population structure is considered, its impact on the coevolutionary dynamics depends on the type of the correlation: with a negative (positive) correlation, population structure promotes (inhibits) the evolution of cooperation. Furthermore, when the correlation is based on the more accessible local information, we reveal that a negative correlation pushes cooperators into a harsh situation whereas a positive one lowers the barriers for cooperators to occupy the population. All our analytical results are validated by numerical simulations. Our results shed light on the power of the coevolution of nonlinear group interactions and evolutionary dynamics on generating various evolutionary outcomes, implying that the coevolutionary framework may be more appropriate than the traditional cases for understanding the evolution of cooperation in both structureless and structured populations.