Related Experiment Video
Updated: Jun 16, 2025

07:05
Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
5.9K
The REM effect: How sleep stages influence learning strategies in complex reward-based decision-making
Eleni Kavaliotis1, Justin Mahlberg2, Daniel Bennett1
1School of Psychological Sciences, Monash University, 18 Innovation Walk, Clayton, Victoria 3800, Australia.
Neurobiology of Learning and Memory
|June 14, 2025
Summary
Sleep impacts decision-making strategies. Less REM sleep is linked to more model-based learning, while more REM sleep favors model-free learning, influencing how we evaluate choices.
Area of Science:
- Neuroscience
- Cognitive Psychology
- Sleep Science
Background:
- Model-free (MF) and model-based (MB) learning are key decision-making processes.
- Compulsive behaviors may stem from overreliance on MF learning.
- The role of sleep in modulating MF/MB learning strategies is unknown.
Purpose of the Study:
- To investigate the influence of sleep manipulation on MF and MB learning strategies in healthy adults.
- To explore the relationship between sleep quality and the engagement of distinct learning strategies.
Main Methods:
- 67 healthy adults underwent a week of either sleep restriction (5 hours/night) or well-rested sleep (9 hours/night).
- Participants completed a two-stage reinforcement learning task.
- Mixed-effect logistic regressions and computational modeling were used to analyze learning strategies.
Main Results:
- No significant differences in MF/MB learning were found between sleep conditions.
- Reduced REM sleep correlated with increased MB learning.
- Increased REM sleep correlated with increased MF learning.
- Computational modeling confirmed a negative association between MB learning parameters and REM sleep percentage (τ = -0.22, p = 0.02).
Conclusions:
- REM sleep quantity may influence the dominant learning strategy employed.
- Individuals with less REM sleep might be less adept at evaluating costs and benefits of choices.
- Further research is warranted to elucidate the role of REM sleep in decision-making strategies.
Related Concept Videos
Timing and Consequences on Behavior
87
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
87
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
Cognitive Learning
233
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
233
Primary and Secondary Reinforcers
219
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
219
Reinforcement Schedules
138
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
138
Decision Making
101
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
101

