Related Experiment Video
Updated: Jan 16, 2026
Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
Means Can Be Deceiving: Comparing and Contrasting Risk Tolerance Estimates From a Discrete-Choice Experiment and a
Jessie Sutphin1, Matthew J Wallace1, Shelby D Reed2
1Preference Evaluation Research (PrefER) Group, Duke Clinical Research Institute, Durham, NC, USA.
Objectives:
This study compared quantitative measures of risk tolerance between 2 preference-elicitation methods: a discrete-choice experiment (DCE) and a probabilistic threshold technique (TT) exercise.
Methods:
A survey offered benefit-risk trade-offs pertaining to devices used in revascularization procedures for peripheral artery disease. Survey design features included alternating the sequence of DCE and TT exercises, testing 2 risk-communication approaches, and using 2 DCE experimental designs. The risk tolerance metric was the maximum-acceptable risk (MAR) increase in 5-year mortality, above an 8% baseline risk, that patients would accept to choose a device offering lower repeat-procedure risks. DCE data were analyzed with mixed-logit models, and TT data were analyzed with interval regressions. Sensitivity analyses were conducted to examine the impacts of survey design features.
Results:
For the full sample (N = 249), MARs from the DCE and TT differed by <1 percentage-point (DCE: 13.0%; TT: 13.8%). MAR estimates were not significantly influenced by the risk-communication approach or experimental design; however, order of DCE and TT mattered. After removing the influence of DCE and TT order, the mean MARs still differed by <1 percentage point (MAR among those completing DCE first [n = 123]: 14.3%; MAR among those completing TT first [n = 126]: 13.7%). Although convergent validity was found at the sample level, discordance (>2 percentage points) between individual-level DCE MAR and TT MAR was observed for approximately half (48.2%) of the sample.
Conclusions:
Although there was concordance between DCE and TT mean MAR estimates at the sample level, at the individual level, only half of the respondents had an absolute difference of 2 percentage-points or less.
Related Concept Videos
01:09Comparing Experimental Results: Student's t-Test
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
01:09Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
01:24Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:17Design Example: Analyzing Capacity Contours for Flood Risk Assessment