Interactions between motor exploration and reinforcement learning.

Area of Science:

• Neuroscience
• Motor Control
• Learning Sciences

Background:

• Motor exploration is crucial for motor learning, especially in reinforcement learning.
• The dynamics of motor exploration during reinforcement learning are not well understood.
• High exploration may be beneficial early but detrimental later in learning.

Purpose of the Study:

• To investigate how motor exploration changes over time during reinforcement learning.
• To determine if motor exploration levels impact subsequent learning.
• To explore the relationship between motor exploration and reinforcement learning.

Main Methods:

• Assessed temporal changes in motor exploration in healthy participants learning a reinforcement-based motor task.
• Defined exploration as trial-to-trial movement variability based on success/failure feedback.
• Used a finger-pointing task with binary success/failure outcomes.

Main Results:

• Motor exploration gradually increased over time during initial task learning.
• Exploration remained low in participants who did not learn the task effectively.
• Elevated exploration persisted after a second training session, enhancing relearning speed.

Conclusions:

• The motor system appears to flexibly upregulate exploration during reinforcement learning, potentially as a learned strategy.
• Motor exploration and reinforcement learning have an interactive relationship.
• Reinforcement tasks can prime exploratory behavior, leading to more efficient future learning.