Related Experiment Video
Updated: May 16, 2026
08:24
The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
Published on: August 25, 2023
Retrospective revaluation in sequential decision making: a tale of two systems
Samuel J Gershman1, Arthur B Markman2, A Ross Otto2
1Department of Psychology and Princeton Neuroscience Institute, Princeton University.
Journal of Experimental Psychology. General
|December 13, 2012
Summary
Human decision-making involves two systems: model-free and model-based. Contrary to a competitive view, these systems cooperate, with the model-based system training the model-free system for better goal-directed behavior.
Area of Science:
- Cognitive Neuroscience
- Behavioral Economics
- Computational Psychiatry
Background:
- Decision-making theories propose two systems: model-free (habitual) and model-based (goal-directed).
- The interaction between these systems is debated, with some evidence suggesting competition and other evidence suggesting integration.
- Understanding this interaction is crucial for explaining complex human and animal behavior.
Purpose of the Study:
- To investigate the interaction between model-free and model-based decision-making systems in humans.
- To test whether decision-making reflects a competitive or cooperative architecture.
- To elucidate the functional roles of each system in guiding behavior.
Main Methods:
- Four behavioral experiments were conducted.
- A retrospective revaluation design was employed to assess value-based learning.
- A cognitive load manipulation was used to probe the reliance on different decision-making systems.
Main Results:
- Human decisions were more consistent with a cooperative architecture than a competitive one.
- The model-free system appeared to control overt behavior.
- The model-based system was shown to train the model-free system through simulation and experience replay.
Conclusions:
- Decision-making in humans is characterized by a cooperative interplay between model-free and model-based systems.
- The model-based system plays a crucial role in updating and refining the model-free system's control over behavior.
- This cooperative architecture provides a more nuanced understanding of goal-directed behavior and learning.
Related Concept Videos
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:09Decision Making: P-value Method
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
01:37Reason and Intuition
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the brain can only use...
01:12Hindsight Biases
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
01:20Decision Making
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
01:34Woodward–Hoffmann Selection Rules and Microscopic Reversibility
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...