Related Experiment Video
Updated: Aug 5, 2026

11:20
Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning
Published on: June 2, 2014
Pigeons' choices between fixed-ratio and linear or geometric escalating schedules
P Neuman1, W H Ahearn, P N Hineline
1Department of Psychology, Temple University, Philadelphia, Pennsylvania 19122, USA.
Journal of the Experimental Analysis of Behavior
|February 22, 2000
Summary
The sums-of-reciprocals principle accurately describes pigeon choice patterns in diminishing returns scenarios, regardless of schedule escalation type or initial values. This principle highlights how reinforcers are valued based on proximity to choice points.
Area of Science:
- Behavioral Psychology
- Animal Cognition
- Operant Conditioning
Background:
- Investigating principles of choice behavior is crucial for understanding decision-making under varying conditions.
- Previous research explored choice patterns using fixed-ratio and progressive-ratio schedules.
Purpose of the Study:
- To compare the linear-optimality principle with the sums-of-reciprocals principle.
- To assess the generality of the sums-of-reciprocals principle in diminishing returns situations.
- To examine the impact of different escalation patterns and initial values in progressive-ratio schedules.
Main Methods:
- Pigeons made choices between fixed-ratio and progressive-ratio schedules.
- Progressive-ratio schedules featured either constant increments or proportional increments.
- The initial value of the progressive alternative was systematically manipulated.
Main Results:
- Pigeon choice patterns were consistently described by the sums-of-reciprocals principle across various conditions.
- This held true irrespective of the initial/reset value and the type of escalation (linear or proportional).
- One phase showed a deviation, but overall the principle demonstrated strong predictive power.
Conclusions:
- The sums-of-reciprocals principle is a robust descriptor of choice behavior in pigeons facing diminishing returns.
- This principle effectively explains behavior with both fixed-increment and proportional progressive schedules.
- The findings suggest that the valuation of reinforcers is influenced by their relative proximity to the choice point.
Related Concept Videos
Types of Selection
Natural selection influences the frequencies of particular alleles and phenotypes within populations in several different ways. Primarily, natural selection can be directional, stabilizing, or disruptive. Directional selection favors one extreme trait and shifts the population towards that phenotype while selecting against individuals displaying alternate traits. Stabilizing selection favors an intermediate trait with a narrow range of variation. Deviation from the optimal phenotype towards an...
Role of Shaping in Operant Conditioning
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Geometric Sequences
In systems where values diminish by a constant proportion at each stage, the resulting sequence follows a geometric structure. Each new value in the sequence is obtained by applying a fixed multiplier to the preceding term. This regular, proportional decline type is often used to represent processes involving gradual loss, such as energy dissipation or reduction in amplitude over time.When analyzing the total effect of such a process across unlimited iterations, the series of values is referred...

