Related Experiment Video
Updated: Jul 18, 2025

Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
Dynamic expectations: Behavioral and electrophysiological evidence of sub-second updates in reward predictions
Déborah Marciano1,2, Ludovic Bellier3, Ida Mayer3,4
1Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA. dvorah.marciano@gmail.com.
Abstract:
Expectations are often dynamic: sports fans know that expectations are rapidly updated as games unfold. Yet expectations have traditionally been studied as static. Here we present behavioral and electrophysiological evidence of sub-second changes in expectations using slot machines as a case study. In Study 1, we demonstrate that EEG signal before the slot machine stops varies based on proximity to winning. Study 2 introduces a behavioral paradigm to measure dynamic expectations via betting, and shows that expectation trajectories vary as a function of winning proximity. Notably, these expectation trajectories parallel Study 1's EEG activity. Studies 3 (EEG) and 4 (behavioral) replicate these findings in the loss domain. These four studies provide compelling evidence that dynamic sub-second updates in expectations can be behaviorally and electrophysiologically measured. Our research opens promising avenues for understanding the dynamic nature of reward expectations and their impact on cognitive processes.
Related Concept Videos
Timing and Consequences on Behavior
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Reinforcement Schedules
Once a behavior is learned,...
Law of Effect
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...

