Related Experiment Video
Updated: Dec 10, 2025

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Delphi, non-RAND modified Delphi, RAND/UCLA appropriateness method and a novel group awareness and consensus
1Medialis Ltd, Banbury, UK.
Introduction:
Increasing demand for reliable evidence in patient care and its delivery has necessitated the development of several approaches for generating quality evidence. In particular, the solicitation of expert opinion has been recognised as a reliable data collection method. However, there are variations and limitations in study approaches using expert opinion as a method of data collection, thereby necessitating the development of a standardised, novel consensus method.
Methods:
A systematic literature review was conducted to assess the characteristics of all studies utilising a "Delphi" or "Modified Delphi" methods between January 2008 and December 2018. A search framework was developed, and the review was conducted in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.
Results:
In total, 764 studies met the study inclusion and exclusion criteria and were included in the review. Heterogeneity on core defining characteristics of the constituent study types was observed in this control group. These 764 studies were compared against the four case studies using the Jandhyala method. Four key themes were identified and discussed: Assessment of Forced or Observed consensus, Assessment and reporting of item Awareness and advisor awareness, Minimum expert engagement profile, and Efficiency of Minimum Engagement Profile.
Conclusions:
Existing consensus methodologies have undergone significant modifications by successive authors over time, including ones contradicting core principles where an original method had been defined. The Jandhyala method for generating group consensus and awareness is unique in observing consensus and measuring awareness of subject matter across experts. The Jandhyala method also improves upon the traditional Delphi-style methodologies, through the introduction of new insights into awareness of subject matter in the expert group. A wider application of the Jandhyala method is required to corroborate findings from this research.
More Related Videos
14:43A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting
Published on: January 12, 2018
06:05The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
Published on: February 19, 2021
Related Concept Videos
Social Proof
Groupthink
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Kendall's Coefficient of Concordance
Group Design