Related Experiment Video
Updated: Jul 26, 2026

08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
Delayed reinforcement of fixed-ratio performance without mediating exteroceptive conditioned reinforcement
Journal of the Experimental Analysis of Behavior
|September 1, 1978
Summary
Pigeons demonstrated higher response rates when reinforcement was delayed, indicating that the response-reinforcer dependency maintained behavior even without immediate rewards. This suggests learning is robust to temporal gaps in reinforcement schedules.
Area of Science:
- Behavioral science
- Animal cognition
- Operant conditioning
Background:
- Operant conditioning principles often assume a close temporal link between responses and reinforcement.
- Understanding how learning is affected by delayed reinforcement is crucial for behavioral analysis.
- Pigeons are widely used models for studying associative learning and decision-making.
Purpose of the Study:
- To investigate pigeon behavior under fixed-ratio schedules where reinforcement is not immediately presented after response completion.
- To determine if the response-reinforcer dependency can maintain high response rates despite temporal delays.
- To explore the impact of varying fixed-ratio requirements and timeout durations on response rates.
Main Methods:
- Pigeons were subjected to fixed-ratio schedules with alternating time-in and time-out periods.
- Responses during the time-in period accumulated towards the fixed-ratio requirement.
- Reinforcement (grain) was delivered after the fixed-ratio completion, but only at the start of the subsequent time-in period for both experimental and yoked control birds.
Main Results:
- Experimental pigeons consistently exhibited significantly higher response rates compared to their yoked controls across various manipulations.
- This elevated responding occurred even when there was a substantial temporal gap between completing the ratio and receiving the reinforcer.
- The results indicate that the established response-reinforcer contingency was sufficient to maintain behavior.
Conclusions:
- The response-reinforcer dependency effectively controlled pigeon behavior, even in the absence of close temporal contiguity.
- Behavioral control can be maintained by learned contingencies despite significant delays in reinforcement delivery.
- These findings contribute to understanding the resilience of learned behaviors in operant conditioning paradigms.
Related Concept Videos
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Operant Conditioning Intervention
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...

