Related Experiment Video
Updated: Sep 16, 2025

Experimental Research Examining How People Can Cope with Uncertainty Through Soft Haptic Sensations
Published on: September 16, 2015
An investigation of the convergent validity and test-retest reliability of three uncertainty preference measures
Guangyu Zhu1, Yiyun Shou2,3,4, Michael Smithson2
1School of Medicine and Psychology, The Australian National University, Canberra, ACT, Australia. Guangyu.frank@gmail.com.
Abstract:
Establishing a reliable and valid measure is crucial for ensuring the accuracy and replicability of research findings on risk and uncertainty preference. However, few studies have assessed the reliability and validity of behavioral measures of uncertainty preference. This study examined the convergent validity and test-retest reliability of three commonly used uncertainty preference measures: forced binary choice, certainty equivalent, and matching probability tasks. Experiments 1 (N = 302) and 2 (N = 366) tested the convergent validity and test-retest reliability of one-off assessment of these measures and found that the three measures did not demonstrate satisfactory convergent validity and test-retest reliability for the one-off assessment. Experiment 3 (N = 311) increased the number of repeats to explore whether repeated measurements could enhance convergent validity and test-retest reliability by addressing the attenuation effect of lack of reliability. The convergent validity between certainty equivalent and matching probability improved in the repeated measurement condition. However, the test-retest reliability of the three measures was still not satisfactory in repeated measurement conditions. These findings highlight the measurement issues in the behavioral measures of uncertainty preferences. The potential causes of this low validity and reliability of behavioral measures of uncertainty preference are discussed.
More Related Videos
13:04Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
08:24The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
Published on: August 25, 2023
Related Concept Videos
Uncertainty in Measurement: Accuracy and Precision
Uncertainty: Overview
Reliability and Validity
Self-Report Tests of Personality
Uncertainty: Confidence Intervals
Propagation of Uncertainty from Random Error