Related Experiment Video
Updated: Jan 12, 2026
11:20
Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning
Published on: June 2, 2014
12.4K
Signatures of reinforcement learning in natural behavior
Catherine A Hartley1,2, Susan L Benear1, Aaron S Heller3
1New York University, Department of Psychology.
Current Directions in Psychological Science
|October 30, 2025
Summary
Reinforcement learning algorithms explain how agents learn rewarding choices from experience. This study extends these models to better understand learning in complex, natural environments and everyday human behaviors.
Area of Science:
- Cognitive Science
- Neuroscience
- Machine Learning
Background:
- Humans learn to achieve desirable outcomes through experience.
- Reinforcement learning (RL) provides formal algorithms for reward-guided learning.
- Current RL models effectively explain behavior in controlled lab settings.
Purpose of the Study:
- To extend reinforcement learning (RL) constructs and algorithms.
- To account for learning in complex, natural environments.
- To bridge the gap between RL theory and real-world human behavior.
Main Methods:
- Operationalizing RL constructs (states, actions, rewards) for naturalistic settings.
- Reviewing empirical studies demonstrating RL signatures in everyday behaviors.
- Analyzing how RL algorithms apply to complex, real-world learning challenges.
Main Results:
- Reinforcement learning principles are applicable beyond controlled environments.
- Evidence suggests RL signatures in diverse human behaviors in natural settings.
- RL models can be extended to explain real-world learning.
Conclusions:
- Reinforcement learning (RL) offers a powerful framework for understanding human learning.
- RL constructs and algorithms can be adapted for complex, natural environments.
- Future research should explore RL's role in everyday decision-making and behavior.
Related Concept Videos
01:28Behaviorism
4.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
4.3K
01:24Reinforcement Schedules
442
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
442
01:24Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
01:23Reinforcement
810
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
810
01:06Law of Effect
2.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
2.4K
01:12Observational Learning
807
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
807