Related Experiment Video
Updated: Jun 28, 2026
09:12
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
Choice as a function of reinforcer "hold": from probability learning to concurrent reinforcement
1Psychology Department, Reed College, Portland, OR 97202, USA.
Journal of Experimental Psychology. Animal Behavior Processes
|October 29, 2008
Summary
This study examined how the availability of reinforcers influences choices in pigeons. Findings show that choice behavior consistently follows power functions, regardless of reinforcer availability, offering a unified principle for decision-making.
Area of Science:
- Behavioral psychology
- Animal cognition
- Decision-making research
Background:
- Choice behavior is studied using concurrent reinforcement and probability learning procedures.
- Concurrent reinforcement: reinforcers remain available indefinitely.
- Probability learning: reinforcer probabilities are constant and independent of time or responses.
Purpose of the Study:
- To investigate the impact of continued reinforcer availability ('hold') on choice behavior.
- To bridge the gap between theoretical models and real-world decision-making scenarios.
Main Methods:
- Parametric manipulation of the likelihood of continued reinforcer availability ('hold') in pigeons.
- Observation and analysis of pigeons' choice responses under varying 'hold' conditions.
- Application of stochastic models to describe choice emissions and deviations.
Main Results:
- Pigeons' choices varied as power functions of obtained reinforcers across all 'hold' values.
- Stochastic models accurately described choice emissions, with deviations linked to 'hold'.
- A unified set of principles explained choices across a spectrum of reinforcer availability.
Conclusions:
- Choice behavior in pigeons is consistently governed by power functions, irrespective of reinforcer availability.
- The 'hold' parameter effectively models real-world decision-making complexities.
- This research provides a generalized framework for understanding choice across diverse conditions.
Related Concept Videos
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
01:08Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
01:21Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
01:24Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
01:23Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
01:23Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example: