Related Experiment Video
Updated: Oct 2, 2025
08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
21.1K
The Role of Executive Function in Shaping Reinforcement Learning
Milena Rmus1, Samuel D McDougle2, Anne G E Collins1,3
1Department of Psychology, University of California, Berkeley.
Current Opinion in Behavioral Sciences
|February 23, 2022
Summary
Reinforcement learning (RL) models explain some learning, but not complex human decisions. Executive functions (EF) are crucial, potentially enabling flexible RL computations in the brain.
Area of Science:
- Neuroscience
- Cognitive Science
- Computational Neuroscience
Background:
- Reinforcement learning (RL) models offer insights into animal learning and decision-making.
- RL falls short in explaining sophisticated human decision-making aspects like generalization and one-shot learning.
- Executive functions (EF) are implicated in these complex behaviors.
Purpose of the Study:
- To review recent findings on the role of EF in learning.
- To propose a theory integrating EF with RL in the brain.
- To explore implications for understanding neural computations and behavior.
Main Methods:
- Literature review of recent findings on executive functions and learning.
- Theoretical advancement proposing a framework for EF-RL interactions.
- Analysis of implications for interpreting brain and behavior.
Main Results:
- Executive functions are vital for sophisticated learning beyond canonical RL.
- EF potentially provides flexible inputs for RL computations in the brain.
- This integration broadens the applicability of RL in neuroscience.
Conclusions:
- EF plays a critical role in setting the stage for RL computations.
- This framework enhances our understanding of neural mechanisms in decision-making.
- The proposed theory has significant implications for interpreting brain function and behavior.
Related Concept Videos
01:19Role of Shaping in Operant Conditioning
538
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
538
01:21Operant Conditioning
1.8K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.8K
01:06Law of Effect
1.7K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.7K
01:08Timing and Consequences on Behavior
163
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
163
01:24Generalization, Discrimination, and Extinction
861
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
861
01:23Reinforcement
407
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
407