Related Experiment Video
Updated: Aug 10, 2026

09:43
The 5-Choice Serial Reaction Time Task: A Task of Attention and Impulse Control for Rodents
Published on: August 10, 2014
VARIABLES DETERMINING THE EFFECTS OF DELAY IN REINFORCEMENT
Journal of the Experimental Analysis of Behavior
|July 1, 1965
Summary
Researchers found ways to maintain consistent performance with long delays in reinforcement by adjusting delay length, food amount, and fixed-ratio size. These methods also supported complex response chains without gradual delay increases.
Area of Science:
- Behavioral Psychology
- Operant Conditioning
- Animal Behavior
Background:
- Delayed reinforcement poses challenges in maintaining consistent behavioral performance.
- Previous research often required complex procedures or gradual adjustments to manage long reinforcement delays.
Purpose of the Study:
- To discover procedures for maintaining fixed-ratio performance under a 24-hour delay of reinforcement.
- To investigate if these parameters could establish explicit response chains.
- To determine if gradual delay increases were necessary for achieving stable performance.
Main Methods:
- Manipulation of delay length, amount of food reinforcement, and fixed-ratio size.
- Application of discovered parameters to establish response chains.
- Comparison of performance with and without gradual delay increases.
Main Results:
- Successfully maintained fixed-ratio performance despite a 24-hour delay in reinforcement.
- Identified specific parameter manipulations (delay, food amount, ratio size) crucial for this effect.
- Demonstrated that these parameters could establish explicit response chains and did not require gradual delay increases.
Conclusions:
- Effective procedures exist for maintaining consistent performance under significant reinforcement delays.
- Parameter manipulation offers a direct method for managing delayed reinforcement effects.
- Complex behavioral chains can be established with delayed reinforcement without incremental delay adjustments.
Related Concept Videos
Real-World Application of Classical Conditioning
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...

