Related Experiment Video
Updated: Jul 11, 2026

09:12
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
Rats' choices between one and two delayed reinforcers.
1Psychology Department, Southern Connecticut State University, New Haven, Connecticut 06515, USA. mazurj1@southernct.edu
Learning & Behavior
|October 9, 2007
Summary
Rats weigh the number and delay of rewards when making choices. The hyperbolic-decay model accurately predicts their choices, showing rats discount delayed rewards more slowly than pigeons.
Area of Science:
- Behavioral economics
- Animal behavior research
- Decision-making under uncertainty
Background:
- Organisms often face choices between immediate, smaller rewards and delayed, larger rewards.
- Understanding how animals value delayed rewards is crucial for behavioral science.
Purpose of the Study:
- To investigate how rats choose between alternatives with varying numbers and delays of reinforcers.
- To evaluate the predictive accuracy of different mathematical models for delay discounting.
Main Methods:
- Rats made leverpress choices between two alternatives: one offering multiple reinforcers at fixed delays, the other a single reinforcer at an adjusting delay.
- An indifference point was estimated, representing the delay at which both options were equally preferred.
- Data were analyzed using hyperbolic-decay, exponential, and reciprocal delay-discounting models.
Main Results:
- Both the quantity and delay of reinforcers significantly influenced the rats' indifference points.
- The hyperbolic-decay model provided a robust description of the observed choice patterns.
- Alternative models (exponential, reciprocal) and a modified hyperbolic model with an extra parameter showed poorer predictive performance.
Conclusions:
- The hyperbolic-decay model effectively captures how rats value delayed rewards, considering both the number and delay of reinforcers.
- Rats exhibit slower delay discounting rates compared to pigeons, indicating species-specific differences in reward valuation.
Related Concept Videos
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Instinctive Drift
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...

