Related Experiment Video
Updated: Jun 18, 2025

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
Risk preference as an outcome of evolutionarily adaptive learning mechanisms: An evolutionary simulation under
Shogo Homma1,2,3, Masanori Takezawa1,4,5
1Department of Behavioral Science, Graduate School of Humanities and Human Sciences, Hokkaido University, Sapporo, Hokkaido, Japan.
This study shows that evolved learning rates in reinforcement learning (RL) lead to flexible risk preferences. Agents developed a higher positive than negative learning rate, enabling adaptive behavior across different reward scenarios.
Area of Science:
- Cognitive Science
- Behavioral Economics
- Computational Neuroscience
Background:
- Cognitive and learning mechanisms underpin complex behaviors.
- Reinforcement learning (RL) models use distinct rules for positive and negative reward prediction errors.
- Risk preference exhibits both domain-specific and domain-general characteristics.
Purpose of the Study:
- To investigate the evolution of learning bias in relation to risk preference.
- To explore how different learning rules contribute to domain-specific and domain-general risk behaviors.
- To model the adaptive mechanisms underlying complex decision-making under risk.
Main Methods:
- Simulated the evolution of positive and negative learning rates in agents.
- Exposed agents to diverse risky environments with varying reward structures.
- Analyzed evolved learning rates and resulting behavioral patterns.
Main Results:
- The positive learning rate consistently evolved to be higher than the negative learning rate.
- Evolved agents demonstrated flexible reward-seeking and risk-averse behaviors based on task type.
- Simulated agents exhibited behavioral patterns consistent with prospect theory.
Conclusions:
- Evolved learning biases can explain the dual nature of risk preference (domain-specific and domain-general).
- A higher positive than negative learning rate facilitates adaptive behavior in varied risky contexts.
- The proposed framework of innate learning constraints offers insights into complex behavioral phenomena.
Related Concept Videos
Criticisms of the Evolutionary Perspective
Evolutionary psychology provides one explanation for these findings, suggesting...
Evolutionary Psychology
Instinctive Drift
Natural Selection and Adaptation
Beyond physical adaptations,...
Natural Selection and Mating Preferences
Females, due to their biological roles in conception, pregnancy, and nursing,...
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...

