Related Experiment Video
Updated: Jun 10, 2026

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
Subjective recalibration of advisors' probability estimates
Yaron Shlomi1, Thomas S Wallsten
1Department of Psychology, University of Maryland, College Park, MD 20742-4411, USA. yshlomi@psyc.umd.edu
Abstract:
Are decision makers sensitive to the statistical properties (i.e., calibration) of probability estimates that they receive from advisors? After specifying the ideal use of such estimates, we derive the roughly ideal forecast consumer (RIFC) and generalize it to account for how humans might use the estimates. We report an experiment in which participants first experienced various advisors by seeing their probability estimates and the associated outcomes and then provided confidence judgments in the presence of the advisors' estimates. The generalized model described the data well and showed that the participants were appropriately sensitive to the statistical properties of the advisors. Models of the individuals were better calibrated than the participants themselves, but still inferior to the RIFC. A detailed description of our model-testing procedure can be found in an appendix to the article.
Related Concept Videos
The Anchoring-and-Adjustment Heuristic
Regression Toward the Mean
The Representativeness Heuristic
Hindsight Biases
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Confidence Coefficient
