Related Experiment Video
Updated: Jul 12, 2026

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
Eliciting stated preferences for health-technology adoption criteria using paired comparisons and recommendation
F Reed Johnson1, Martin Backhouse
1RTI Health Solutions, Research Triangle Institute, RTP, NC 27709, USA. frjohnson@rti.org
Objectives:
The principal aim of this study was to illustrate applying discrete-choice methods for eliciting preferences for technology adoption criteria, including threshold values for cost-effectiveness ratios. A secondary objective was to compare the criteria weights of a sample of industry stakeholders with the results obtained from a study of National Institute for Health and Clinical Excellence (NICE) recommendations.
Methods:
We administered a two-stage stated-preference (SP) question format to a sample of respondents who have expertise in applying economic analysis to technology adoption decisions. We elicited paired comparisons and recommendation judgments for similar criteria from a sample of International Society for Pharmacoeconomics and Outcomes Research members. Respondents evaluated nine pairs of hypothetical drugs, first indicating which drug was "better," then indicating what they would recommend to a reimbursement authority such as the National Health Service. Stated-choice studies often obtain only paired-comparison judgments.
Results:
Parameter estimates from the initial paired-comparison question indicate only incremental cost-effectiveness ratio and number of affected patients influence evaluations. These two factors have identical weights in the second recommendation question, but all four factors were considered in determining the recommendation threshold. Our sample was more willing than NICE to accept trade-offs between cost-effectiveness and other drug features and was less concerned about cost-effectiveness ratios and information uncertainty. Nevertheless, our sample was in agreement with NICE about the importance of the number of patients who would benefit as a criterion for influencing adoption recommendations.
Conclusion:
This study demonstrates that including a question allowing respondents the opportunity to reject both alternatives in a forced-choice paired comparison can be important for obtaining accurate preference estimates. Our results demonstrate that SP methods offer a feasible means of quantifying a broad set of valuations that incorporate the preferences of patient, citizen, payer, and other stakeholder groups.
Related Concept Videos
The Availability Heuristic
Routes of Persuasion
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Pharmacokinetic Models: Comparison and Selection Criterion
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Criteria for Causality: Bradford Hill Criteria - II

