A progressive ratio task with costly resets reveals adaptive effort-delay tradeoffs

Area of Science:

• Behavioral neuroscience
• Animal behavior
• Reinforcement learning

Background:

• The Progressive Ratio (PR) schedule measures motivation by increasing work for rewards.
• The PR task's breakpoint is a limited measure of motivational value.
• Existing models lack a dynamic optimization component for reinforcer value.

Purpose of the Study:

• To introduce a modified Progressive Ratio task (PRR) that frames reinforcer valuation as an optimization problem.
• To analyze rat behavior in the PRR task, focusing on adaptive reset decisions.
• To compare rat strategies to optimal foraging theory and identify behavioral biases.

Main Methods:

• Rats performed a PR task with an added reset lever to reduce work requirements at a cost (delay).
• Behavioral data on lever presses and reset decisions were collected.
• An optimal strategy for bout length was derived based on reward rate and reset costs.

Main Results:

• Rats utilized the reset lever adaptively, with decisions sensitive to the reset delay cost.
• Rat behavior approximated the derived optimal bout length strategy.
• A systematic bias towards over-harvesting (longer bouts than optimal) was observed.

Conclusions:

• The Progressive Ratio with Reset (PRR) task offers a richer behavioral readout than the standard PR schedule.
• Rats demonstrate adaptive decision-making in response to cost-benefit structures, aligning with optimal foraging principles.
• The PRR task provides a novel platform for studying associative learning and decision-making under changing environmental demands.