The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity
Clay B Holroyd1, Michael G H Coles1
1U Illinois.
Psychological Review
|October 11, 2002
Summary
This study unifies the mesencephalic dopamine system for reinforcement learning and the anterior cingulate cortex
Area of Science:
- Neuroscience
- Cognitive Science
- Computational Neuroscience
Background:
- Adaptive behaviors are crucial for survival and are guided by neural systems.
- Reinforcement learning and error processing are key components of adaptive behavior.
- The anterior cingulate cortex (ACC) and mesencephalic dopamine system are implicated in these processes.
Purpose of the Study:
- To propose a unified account of two neural systems involved in adaptive behaviors.
- To investigate the role of the mesencephalic dopamine system and ACC in reinforcement learning and error processing.
- To explore the generation and function of the error-related negativity (ERN).
Main Methods:
- Computational modeling to simulate neural processes.
- Psychophysiological experimentation using reaction-time tasks.
- Analysis of event-related brain potentials, specifically the ERN.
Main Results:
- The study proposes that the ERN is generated by a negative reinforcement learning signal.
- This signal is conveyed from the mesencephalic dopamine system to the ACC.
- The ACC utilizes this signal to adjust performance.
Conclusions:
- A unified model linking dopamine-mediated reinforcement learning and ACC-based error processing is presented.
- The ERN serves as a crucial indicator of error detection and performance adjustment.
- This framework advances our understanding of the neural basis of adaptive behavior.
Related Concept Videos
Neural Regulation
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Instinctive Drift
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
Role of Neurotransmitters in Memory
Neurotransmitters are integral to the brain's communication system, enabling neurons to transmit signals across synapses. This chemical exchange underpins various cognitive functions, including memory processes. The role of neurotransmitters in memory is multifaceted, influencing the encoding, consolidation, and retrieval of memories through their action on different neural circuits.
Glutamate and Synaptic Plasticity
Glutamate, the brain's main excitatory neurotransmitter, is critical for...
Glutamate and Synaptic Plasticity
Glutamate, the brain's main excitatory neurotransmitter, is critical for...
Attention-Deficit/Hyperactivity Disorder
Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder characterized by persistent inattention, hyperactivity, and impulsivity. It affects approximately 5-8% of children globally, with around 60-70% of cases persisting into adulthood. ADHD has significant implications for educational attainment, social interactions, and occupational success.
Diagnostic Criteria and Symptoms
To diagnose ADHD, symptoms must manifest before age 12 and be evident across multiple settings.
Diagnostic Criteria and Symptoms
To diagnose ADHD, symptoms must manifest before age 12 and be evident across multiple settings.


