Related Experiment Video
Updated: Aug 7, 2026

08:24
The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
Published on: August 25, 2023
Temporal constraint on choice: Sensitivity and bias in multiple schedules
Journal of the Experimental Analysis of Behavior
|May 1, 1983
Summary
Response allocation in multiple schedules of reinforcement is influenced by both programmed and extraneous reinforcers. The study demonstrates how the balance of these reinforcers affects behavior in different schedule components.
Area of Science:
- Behavioral psychology
- Operant conditioning
- Animal behavior studies
Background:
- Response ratios in multiple schedules of reinforcement are often insensitive to reinforcer ratios.
- Previous models did not fully account for the impact of extraneous reinforcement on behavior allocation.
Purpose of the Study:
- To propose and test an analysis of response allocation in multiple schedules, considering concurrent programmed and extraneous reinforcement.
- To investigate how the reinforcement context, including extraneous reinforcers, modulates response allocation.
Main Methods:
- An experiment was conducted using pigeons responding under a multiple schedule.
- Analog extraneous reinforcement was programmed for an alternative response within each component of the multiple schedule.
Main Results:
- Sensitivity of response and time ratios to reinforcer ratios varied with the rate of extraneous reinforcers.
- Response bias between components was inversely related to the ratios of extraneous reinforcer rates.
- The proposed analysis accurately predicted data from the experiment and previous studies.
Conclusions:
- Behavior allocation in multiple-schedule components is determined by the relative values of concurrently available reinforcers.
- Extraneous reinforcement significantly modulates the effects of programmed reinforcement on response allocation.
- The developed analysis provides a more comprehensive understanding of behavior dynamics in complex reinforcement schedules.
Related Concept Videos
The Anchoring-and-Adjustment Heuristic
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the $2,000...
Hindsight Biases
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Reason and Intuition
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the brain can only use...
Confirmation Biases
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?

