Related Experiment Video
Updated: Jul 14, 2026
08:12
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task
Edmund T Rolls1, Ciara McCabe, Jerome Redoute
1University of Oxford, Department of Experimental Psychology, South Parks Road, Oxford OX1 3UD, UK. edmund.rolls@psy.ox.ac.uk
Cerebral Cortex (New York, N.Y. : 1991)
|June 26, 2007
Summary
This study reveals how the brain calculates expected value (EV) and updates it using temporal difference (TD) errors. Different brain regions track EV, outcome, and TD errors during decision-making.
Area of Science:
- Neuroscience
- Cognitive Science
- Decision Science
Background:
- Probabilistic decision-making involves calculating expected value (EV) and updating it with prediction errors.
- Understanding the neural basis of these computations is crucial for deciphering decision processes.
Purpose of the Study:
- To investigate the neural correlates of expected value (EV) and reward magnitude (RM) processing.
- To identify brain regions involved in calculating temporal difference (TD) reward prediction errors.
Main Methods:
- Functional magnetic resonance imaging (fMRI) was used to measure brain activity during a probabilistic decision task.
- Analysis focused on activations related to EV, RM, and TD errors.
Main Results:
- Medial orbitofrontal cortex (mOFC) and pregenual cingulate cortex showed activations correlated with both EV and RM.
- Ventral striatum, midbrain, and inferior frontal gyrus were activated by TD errors, receiving input from the mOFC.
- Anterior insula activity correlated negatively with EV and positively with uncertainty, suggesting a role in risk assessment.
Conclusions:
- The mOFC and associated areas play a key role in representing EV and RM for decision-making.
- Downstream regions process TD errors, facilitating adaptive choice behavior.
- The anterior insula is involved in evaluating expected outcomes and uncertainty, critical for risk-sensitive decisions.
Related Concept Videos
01:15Expected Value
The expected value is known as the "long-term" average or mean. This means that over the long term of experimenting over and over, you would expect this average. The expected average is represented by the symbol μ. It is calculated as follows:In the equation, x is an event, and P(x) is the probability of the event occurring.The expected value has practical applications in decision theory.This text is adapted from Openstax, Introductory Statistics, Section 4.2 Mean or Expected Value and...
01:09Decision Making: P-value Method
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
00:59Propagation of Uncertainty from Random Error
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
01:12Hindsight Biases
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
01:10Propagation of Uncertainty from Systematic Error
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this particular...