Choice in a self-control paradigm: effects of uncertainty

Area of Science:

• Behavioral psychology
• Decision-making science

Background:

• Self-control and impulsiveness are key aspects of human decision-making.
• Reinforcer uncertainty, characterized by unpredictable delays or interruptions in rewards, is a critical factor influencing behavior.

Purpose of the Study:

• To investigate how varying degrees of reinforcer uncertainty affect human self-control and impulsiveness.
• To determine the conditions under which uncertainty influences choice behavior.

Main Methods:

• Four experiments were conducted manipulating uncertainty through the probability and duration of interruptions (timeouts from reinforcement).
• Experiment 1 varied interruption probability; Experiment 2 varied interruption duration.
• Experiment 3 introduced interruptions specifically during the delay to a larger reinforcer; Experiment 4 served as a control without interruptions.

Main Results:

• Participants in Experiments 1 and 2 did not show significantly different impulsiveness compared to the control group (Experiment 4).
• Experiment 3 revealed significantly higher impulsiveness when reinforcement rates were equal, but not when unequal.
• The relative rate of reinforcement was identified as a crucial determinant of choice behavior under uncertainty.

Conclusions:

• Reinforcer uncertainty influences choice behavior primarily through its effect on the relative rate of reinforcement.
• Intermittent interruptions do not necessarily increase impulsiveness unless they alter the overall reinforcement rate.
• The findings highlight the nuanced relationship between uncertainty, reinforcement schedules, and self-control.