Maximizing present value: A model to explain why moderate response rates obtain on variable-interval schedules.

Area of Science:

• Behavioral neuroscience
• Animal behavior

Background:

• Operant conditioning principles govern animal behavior.
• Reinforcement schedules significantly impact response rates.
• The immediacy of reinforcement is a critical factor in learning.

Purpose of the Study:

• To investigate the effect of delayed reinforcement on response rates in Japanese monkeys.
• To examine how altering reinforcement schedules influences behavior under multiple variable-ratio/variable-interval conditions.

Main Methods:

• Two Japanese monkeys were trained on a multiple schedule of reinforcement (variable-ratio/variable-interval).
• Reinforcement schedules were manipulated across three phases, with Phase 2 delaying all rewards until session's end.
• Response rates were recorded for each component of the multiple schedule.

Main Results:

• Variable-ratio response rates remained stable across all phases.
• Variable-interval response rates significantly decreased during Phase 2 when reinforcement was delayed.
• The reduction in variable-interval responding was attributed to the loss of immediate reinforcement.

Conclusions:

• The immediacy of reinforcement plays a crucial role in maintaining response rates, particularly under variable-interval schedules.
• Delayed gratification can lead to decreased behavioral output when immediate rewards are forgone.
• Findings support economic principles of 'maximizing present value' in behavioral decision-making.