Related Experiment Video
Updated: Jun 22, 2026
09:01
The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents
Published on: July 8, 2015
Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game.
Hyojung Seo1, Dominic J Barraclough, Daeyeol Lee
1Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut 06510, USA.
Summary
Neurons in the lateral intraparietal cortex (LIP) adaptively update action-outcome associations. These findings reveal how LIP neurons contribute to flexible decision-making in changing environments by signaling value differences and sums.
Area of Science:
- Neuroscience
- Cognitive Science
- Computational Neuroscience
Background:
- Lateral intraparietal cortex (LIP) neurons integrate sensory, motor, and memory signals.
- LIP neurons encode evidence accumulation for action selection, often linked to reward prediction.
- Dynamic environments necessitate updating action desirabilities based on past choices and outcomes.
Purpose of the Study:
- Investigate if LIP neurons encode signals for adaptive decision-making strategy updates.
- Examine LIP neuronal activity during a dynamic matching-pennies game.
- Determine the role of LIP in updating action-outcome associations.
Main Methods:
- Computer-simulated matching-pennies game.
- Reinforcement learning algorithm to estimate value functions.
- Trial-by-trial analysis of LIP neuronal activity.
Main Results:
- 18% of LIP neurons showed activity reflecting the difference in value functions between targets before choice.
- A higher fraction of LIP neurons encoded signals related to the sum of value functions (state value or average reward).
- LIP neurons also encoded information about previous choices, similar to prefrontal cortex neurons.
Conclusions:
- LIP neurons contribute to adaptive decision-making by encoding value-based signals.
- The posterior parietal cortex, including LIP, may support updating action-outcome associations.
- These findings shed light on neural mechanisms for flexible behavioral adaptation.
Related Concept Videos
01:12Observational Learning
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
01:23Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
01:21Cognitive Learning
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
01:27Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
01:23Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...