Related Experiment Video
Updated: Sep 15, 2025

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
Adaptive reward representations integrate expected uncertainty signals in orbitofrontal cortex
1School of Basic Medical Sciences, Capital Medical University & Chinese Institute for Brain Research, Beijing 100069, China.
None:
Incorporating expected uncertainty into reward evaluation is critical for adaptive learning and behavior. The orbitofrontal cortex (OFC) represents reward attributes, such as delay and magnitude, alongside expected uncertainties about upcoming rewards, serving its established role in both value- and risk-based behaviors. However, the cellular basis of how reward and uncertainty interact remains unclear. To investigate, we trained rats on a task where odor cues predicted sucrose rewards with varying uncertainties in delay or magnitude. Single-unit recordings revealed that many OFC neurons encoded expected uncertainties related to reward delay or magnitude. Population-level analysis showed distinct neural codes for delay and magnitude uncertainties, separate from those for reward delay and magnitude. Signals for each reward attribute and associated uncertainty converged onto the same neurons, reducing the sensitivity of delay and magnitude encoding as uncertainty increased. These findings suggest a cellular-level computation in OFC neurons, whereby uncertainty signals are integrated into attribute-specific reward representations, potentially supporting flexible learning and risk control.
Related Concept Videos
Association Areas of the Cortex
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Timing and Consequences on Behavior
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Uncertainty: Overview
Facial Feedback Hypothesis
Expected Value

