Related Experiment Video
Updated: Jul 4, 2025

11:20
Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning
Published on: June 2, 2014
12.0K
Dynamics Learning Rate Bias in Pigeons: Insights from Reinforcement Learning and Neural Correlates
Fuli Jin1,2, Lifang Yang1,2, Long Yang1,2
1School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou 450001, China.
Animals : an Open Access Journal From MDPI
|February 10, 2024
Summary
Pigeons exhibit a dynamic learning strategy, shifting their learning rate bias from negative to positive during a probabilistic task. This behavioral change correlates with neural activity in the striatum, offering insights into animal reinforcement learning.
Area of Science:
- Neuroscience
- Cognitive Science
- Animal Behavior
Background:
- Reinforcement learning research shows animals process reward prediction errors differently.
- Learning rate bias is observed in humans and animals, but its dynamic changes during learning remain unclear.
Purpose of the Study:
- To investigate dynamic changes in learning rate bias during a probabilistic learning task in pigeons.
- To explore the relationship between behavioral learning strategies and neural activity in the avian striatum.
Main Methods:
- Recorded behavioral choices and local field potentials (LFPs) in pigeon striatum during a probabilistic learning task.
- Applied reinforcement learning models with and without learning rate bias to fit behavioral data and estimate option values.
- Analyzed correlations between striatal LFP power and model-estimated option values.
Main Results:
- Pigeon learning rate bias shifted from negative to positive throughout the learning process.
- Striatal Gamma power (31-80 Hz) correlated with option values influenced by dynamic learning rate bias.
- Behavioral and neural data support a dynamic learning strategy in pigeons.
Conclusions:
- Pigeons utilize a dynamic learning strategy, adjusting their learning rate bias over time.
- Striatal neural activity, specifically Gamma power, reflects this dynamic learning process.
- Findings provide valuable insights into non-human animal reinforcement learning mechanisms.
Related Concept Videos
Instinctive Drift
221
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
221
Cognitive Learning
243
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
243
Timing and Consequences on Behavior
94
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
94

