Related Experiment Video
Updated: Apr 4, 2026
09:13
A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
Published on: May 3, 2012
15.0K
Two spatiotemporally distinct value systems shape reward-based learning in the human brain
Elsa Fouragnan1, Chris Retzler1,2, Karen Mullinger3,4
1Institute of Neuroscience &Psychology, University of Glasgow, 58 Hillhead Street, Glasgow G12 8QB, UK.
Nature Communications
|September 9, 2015
Summary
Researchers discovered two interacting brain systems that encode decision outcomes. An early system handles negative outcomes and alertness, while a later system learns from rewards, with their interaction guiding avoidance learning.
Area of Science:
- Neuroscience
- Cognitive Science
- Decision Science
Background:
- Understanding the neural basis of decision-making and learning from outcomes is crucial for survival.
- The specific brain systems encoding different decision outcomes and their interactions remain largely unknown.
Purpose of the Study:
- To investigate the spatiotemporal dynamics of neural value systems encoding decision outcomes.
- To elucidate the interaction between distinct value systems and their role in adaptive behavior.
Main Methods:
- Coupled single-trial electroencephalography (EEG) with simultaneous functional magnetic resonance imaging (fMRI).
- Analyzed neural activity in response to various decision outcomes.
Main Results:
- Identified two interacting value systems: an early system (negative outcomes, arousal, motor preparation) and a later system (reward network modulation).
- The early system downregulates the later system following negative outcomes via thalamic interaction with the ventral striatum.
- The strength of this thalamostriatal coupling predicted avoidance learning and switching behavior.
Conclusions:
- Two distinct but interacting neural systems underpin the encoding of decision outcomes.
- The thalamostriatal pathway plays a critical role in integrating outcome information for adaptive learning and behavioral adjustments.
Related Concept Videos
01:01Neuroplasticity
2.5K
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
2.5K
01:25Neural Circuits
3.3K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
3.3K
01:08Timing and Consequences on Behavior
701
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
701
01:12Observational Learning
1.2K
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1.2K
01:21Cognitive Learning
1.6K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.6K
01:15Functional Brain Systems: Limbic System
9.1K
The limbic system, often called the "emotional brain," is a complex set of structures located deep within the brain. The intricate network of the limbic system supports a wide range of psychological functions, from emotional regulation to memory formation and sensory processing. This functional brain region encompasses specific parts of the diencephalon and the cerebrum, integrating the higher mental functions of the cerebral cortex with the primitive emotional responses of the deep brain...
9.1K