Related Experiment Video
Updated: Apr 14, 2026

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
Uncertainty and exploration in a restless bandit problem
Maarten Speekenbrink1, Emmanouil Konstantinidis
1Experimental Psychology, University College London.
Abstract:
Decision making in noisy and changing environments requires a fine balance between exploiting knowledge about good courses of action and exploring the environment in order to improve upon this knowledge. We present an experiment on a restless bandit task in which participants made repeated choices between options for which the average rewards changed over time. Comparing a number of computational models of participants' behavior in this task, we find evidence that a substantial number of them balanced exploration and exploitation by considering the probability that an option offers the maximum reward out of all the available options.
More Related Videos
Related Concept Videos
Uncertainty: Overview
Uncertainty: Confidence Intervals
Propagation of Uncertainty from Random Error
Propagation of Uncertainty from Systematic Error
Randomized Experiments
Simple randomization
Simple...
Statically Indeterminate Problem Solving

