Related Experiment Video
Updated: Jul 25, 2025
11:20
Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning
Published on: June 2, 2014
12.0K
State-transition-free reinforcement learning in chimpanzees (Pan troglodytes).
Yutaro Sato1,2, Yutaka Sakai3, Satoshi Hirata4
1Wildlife Research Center, Kyoto University, Kyoto, Japan. sato.yutaro@alumni.u-tokyo.ac.jp.
Learning & Behavior
|June 27, 2023
Summary
Eligibility traces (ET) may support learning from delayed rewards in animals. This study shows two chimpanzees successfully learned tasks, suggesting non-state-transition learning mechanisms are involved in primate cognition.
Area of Science:
- Cognitive science
- Animal behavior
- Neuroscience
Background:
- Learning from delayed outcomes is crucial but challenging.
- Humans utilize eligibility traces (ET) for learning when state transitions are unreliable.
- Previous research has not explored ET-based learning in nonhuman animals.
Purpose of the Study:
- To investigate if nonhuman animals can learn from delayed rewards using mechanisms independent of state transitions.
- To adapt a human behavioral task for assessing eligibility trace learning in chimpanzees.
- To provide empirical evidence for advanced learning strategies in nonhuman primates.
Main Methods:
- A novel touchscreen task was designed for chimpanzees (Pan troglodytes).
- Participants chose between stimuli associated with immediate, delayed, or no reward.
- The task required learning stimulus values to maximize cumulative reward, independent of choice-contingent stimuli.
Main Results:
- Two out of five chimpanzees successfully learned to associate stimuli with delayed rewards.
- Successful learning indicates the involvement of cognitive mechanisms not reliant on state transitions.
- This demonstrates a capacity for sophisticated associative learning in chimpanzees.
Conclusions:
- Chimpanzees possess learning mechanisms that can operate without relying on state transitions, similar to human eligibility trace (ET) systems.
- The developed task is effective for studying delayed reward learning and potential ET mechanisms in nonhuman animals.
- This research expands our understanding of the evolution of learning strategies across species.
Related Concept Videos
01:24Reinforcement Schedules
212
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
212
01:12Observational Learning
222
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
222
01:05Instinctive Drift
254
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
254
01:23Reinforcement
289
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
289
01:14Avoidance Learning and Learned Helplessness
1.8K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.8K
01:21Cognitive Learning
438
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
438