Related Experiment Video
Updated: Jul 11, 2025
11:17
Extinction Training During the Reconsolidation Window Prevents Recovery of Fear
Published on: August 24, 2012
35.4K
The sequencing of trials during partial reinforcement affects subsequent extinction
1School of Psychology, University of Sydney.
Journal of Experimental Psychology. Animal Learning and Cognition
|November 6, 2023
Summary
The partial reinforcement extinction effect (PREE) is stronger with longer sequences of nonreinforced trials. Uncertainty about reinforcement, not just memory of sequences, drives this effect in associative learning.
Area of Science:
- Behavioral Neuroscience
- Associative Learning
- Animal Behavior
Background:
- The partial reinforcement extinction effect (PREE) describes how inconsistent reinforcement leads to more persistent behavior during extinction.
- Current associative models struggle to explain why partial reinforcement yields stronger extinction resistance than continuous reinforcement.
- A popular theory suggests animals learn to associate nonreinforced (N) trials with subsequent reinforcement (R), promoting generalization during extinction.
Purpose of the Study:
- To test predictions of sequential theory regarding the role of nonreinforced (N) trial sequence length in the partial reinforcement extinction effect (PREE).
- To investigate whether the memory of N-trial sequences or uncertainty about reinforcement is the primary driver of the PREE.
Main Methods:
- Utilized Pavlovian magazine approach conditioning in rats.
- Manipulated the length of nonreinforced (N) trial sequences (short: 1-2 trials; long: 3-5 trials) during conditioning.
- Assessed extinction responding, with some conditions including interruption of long N-sequences with different conditioned stimuli.
Main Results:
- Consistent with sequential theory, longer N-trial sequences (3-5 N trials) produced a stronger PREE than shorter sequences (1-2 N trials).
- No significant PREE was observed in rats trained with short N-trial sequences.
- Interrupting long N-sequences with reinforced trials of a different conditioned stimulus did not alter the subsequent PREE, contrary to sequential theory predictions.
Conclusions:
- The length of nonreinforced (N) trial sequences significantly influences the partial reinforcement extinction effect (PREE).
- Uncertainty about reinforcement, rather than the specific memory of N-trial sequences, appears to be a critical factor in the development of the PREE.
- Findings challenge aspects of sequential theory and highlight the role of uncertainty in associative learning and behavioral persistence.
Related Concept Videos
01:24Generalization, Discrimination, and Extinction
575
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
575
01:24Reinforcement Schedules
160
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
160
01:23Principles of Classical Conditioning
684
Classical conditioning, as described by Ivan Pavlov, is a foundational concept in associative learning, where a neutral stimulus becomes capable of eliciting a conditioned response through association with an unconditioned stimulus. The process of acquisition, where this learning occurs, and the subsequent phenomena of contiguity, contingency, generalization, discrimination, extinction, and spontaneous recovery are crucial for a comprehensive understanding of classical conditioning.
During the...
During the...
684
01:08Timing and Consequences on Behavior
101
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
101
01:06Law of Effect
1.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.4K
01:15Real-World Application of Classical Conditioning
597
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
597