Related Experiment Video
Updated: Jul 10, 2026

Experimental Research Examining How People Can Cope with Uncertainty Through Soft Haptic Sensations
Published on: September 16, 2015
Application of generalizability theory confirmed lower reliability of the standard gamble than the feeling
Holger J Schünemann1, Geoff Norman, Milo A Puhan
1Department of Epidemiology, INFORMA Unit/CLARITY Research Group, Italian National Cancer Institute Regina Elena, Via Elio Chianesi 53, 00144 Rome, Italy. schuneh@mcmaster.ca
Objectives:
Recent studies suggest that rating clinical marker states (CMS) does not improve the measurement properties of the standard gamble (SG) and only slightly improves those of the feeling thermometer (FT). The poor intrarater (test-retest) reliability of CMS may explain their meager performance. Further, lack of interrater reliability may compromise the use of CMS in interpreting health state ratings. The aim of this study was to assess the reliability of CMS ratings for the SG and the FT.
Study Design And Setting:
Two similar studies in patients with chronic obstructive pulmonary disease (COPD, n=91) and in patients with gastroesophageal reflux disease (GERD, n=112) provided data for this analysis. Patients rated three different CMS (mild, moderate, and severe disease) twice several weeks apart. We used generalizability theory to calculate reliability coefficients.
Results:
Test-retest reliability for CMS ratings was higher for the FT compared to the SG (COPD: 0.86 vs. 0.67; GERD: 0.86 vs. 0.67). Interrater reliability was much higher for the FT compared to the SG (COPD: 0.78 vs. 0.46; GERD: 0.71 vs. 0.26).
Conclusions:
These results suggest that the markedly poorer reliability of CMS for the SG than the FT is driven largely by poor interrater reliability.
More Related Videos
13:04Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
08:24The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
Published on: August 25, 2023
Related Concept Videos
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Regression Toward the Mean
Fundamental Attribution Error
The Scientific Method
Behrens–Fisher Test
This test is...