Evolution of state-dependent strategies in stochastic games

Area of Science:

• Evolutionary Game Theory
• Behavioral Ecology
• Social Evolution

Background:

• Individual behavior shapes interaction environments, driving behavioral evolution.
• Cognitive species can perceive environmental changes and adapt strategies accordingly.

Purpose of the Study:

• To model environmental feedback with state-dependent strategies.
• To analyze how differentiating strategies across environment states impacts evolutionary outcomes.

Main Methods:

• Utilized the theory of stochastic games and evolutionary dynamics.
• Developed a model where behaviors modify the environment state.

Main Results:

• State-dependent strategies outperform state-independent strategies (e.g., Win-Stay, Lose-Shift) when environmental changes are slow.
• Delayed environmental feedback allows state-dependent strategies to exploit simpler strategies.
• Cooperation levels increase with faster environment switching rates and decrease otherwise.

Conclusions:

• Perceiving and adapting to distinct environmental states enhances individual survival and social prosperity.
• State-dependent strategies are advantageous in dynamic environments, influencing cooperation levels based on environmental change rates.