Incentive salience attribution under reward uncertainty: A Pavlovian model

Area of Science:

• Behavioral neuroscience
• Learning and memory
• Computational psychology

Background:

• Partial reinforcement acquisition effect (PRAE) describes slower initial learning but higher asymptotic levels of conditioned responses (CRs) under partial reward schedules compared to continuous reinforcement.
• Existing learning models of Pavlovian conditioning do not adequately explain the PRAE.
• The incentive salience hypothesis posits that incentive motivation ('wanting') plays a critical role in behavior control.

Purpose of the Study:

• To explain the partial reinforcement acquisition effect (PRAE) within the framework of the incentive salience hypothesis.
• To investigate the role of reward uncertainty in modulating incentive motivation.
• To develop a computational model that integrates incentive motivation to account for PRAE phenomena.

Main Methods:

• Review of existing literature on partial reinforcement in Pavlovian conditioning.
• Theoretical argument based on the incentive salience hypothesis.
• Development and simulation of a novel computational model.

Main Results:

• Reward uncertainty was demonstrated to have an excitatory effect on incentive motivation.
• The proposed computational model successfully accounts for key features of conditioned responses (CRs) observed under partial reinforcement.
• The model highlights the direct influence of incentive motivation on behavior, complementing traditional learning mechanisms.

Conclusions:

• The incentive salience hypothesis provides a viable explanation for the partial reinforcement acquisition effect (PRAE).
• Incentive motivation, modulated by reward uncertainty, plays a crucial role in controlling behavior during Pavlovian conditioning.
• The developed computational model offers a new perspective on understanding learning and motivation.