A quantitative analysis of the behavior maintained by delayed reinforcers.

Area of Science:

• Behavioral Psychology
• Animal Behavior
• Operant Conditioning

Background:

• Reinforcement is a fundamental principle in operant conditioning.
• The temporal relationship between a response and its consequence influences behavior.
• Previous research suggests reinforcement effects can extend beyond the immediately preceding response.

Purpose of the Study:

• To investigate how delays in reinforcement affect response rates in pigeons.
• To determine whether the time elapsed or the number of intervening responses is more critical in delay gradients.
• To examine the mathematical functions that best describe these delay gradients.

Main Methods:

• Pigeons were trained on a sequence of first-key and second-key pecks under random-interval reinforcement.
• Experiments manipulated the number of responses and time delays between responses and reinforcers.
• Delay gradients were analyzed using exponential, hyperbolic, and logarithmic functions.

Main Results:

• Response rates decreased as the delay between responses and reinforcement increased.
• Delay gradients were well-described by exponential, hyperbolic, and logarithmic functions.
• The time elapsed since a response was a more significant factor than the number of intervening responses.

Conclusions:

• Reinforcers influence responses based on their temporal proximity, not solely on the immediately preceding response.
• The contribution of each response to reinforcement is weighted by the time since the response occurred.
• Understanding delay gradients is crucial for designing effective reinforcement schedules and avoiding the maintenance of unwanted behaviors.