Related Experiment Video
Updated: May 2, 2026
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies
Ivan R Diamond1, Robert C Grant2, Brian M Feldman3
1Child Health Evaluative Sciences Program, The Hospital for Sick Children, 555 University Avenue, Toronto, ON M5G 1X8, Canada; Department of Medical Imaging, The University of Toronto, 263 McCaul Street, 4th Floor, Toronto, ON M5T 1W7, Canada; Institute of Health Policy Management and Evaluation, The University of Toronto, 155 College Street, 4th floor, Toronto, ON M5T 3M7, Canada.
Consensus definitions in Delphi studies are inconsistent and poorly reported. This systematic review highlights the need for improved reporting standards to ensure the reliability of Delphi research findings.
Area of Science:
- Health Sciences
- Social Sciences
Background:
- The Delphi method is a widely used technique for achieving consensus in research.
- Understanding how consensus is defined and applied is crucial for interpreting Delphi study outcomes.
Purpose of the Study:
- To examine the operationalization of consensus in Delphi studies.
- To assess the impact of consensus definitions on study results.
Main Methods:
- Systematic review of 100 English-language Delphi studies published between 2000-2009.
- Data extracted from ISI Web of Science and Scopus databases.
Main Results:
- 98% of studies assessed consensus, but only 72% defined it (64% a priori).
- 75% agreement was the median threshold; consensus was declared in 86% of studies.
- Consensus achievement influenced study termination in only 23% of cases.
Conclusions:
- Definitions and reporting of consensus in Delphi studies are highly variable and often inadequate.
- There is a need for standardized criteria for reporting Delphi study methodologies.
More Related Videos
06:16Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
08:36Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
Related Concept Videos
01:15Data Validation
Key parameters for method validation include:
01:23Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
01:14Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
01:56Ethics in Research
01:34Groupthink