Related Experiment Video
Updated: Mar 18, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
New GRADE Evidence-to-Decision Framework for Pairwise and Multiple Comparisons (GRADE Guidance 45)
Jessica Beltran1, Itziar Etxeandia-Ikobaltzeta2, Thomas Piggott3
1Institut de Recerca Sant Pau (IR Sant Pau); Centro Cochrane Iberoamericano; and Department of Paediatrics, Obstetrics, Gynaecology and Preventive Medicine, Universitat Autónoma de Barcelona, Barcelona, Spain (J.B.).
The Grading of Recommendations Assessment, Development and Evaluation (GRADE) evidence-to-decision (EtD) framework has been updated to support multiple health comparisons. This revised framework aids guideline developers in making informed decisions with complex evidence, enhancing health decision-making processes.
Area of Science:
- Health research methodology
- Clinical guideline development
- Evidence-based practice
Background:
- Evidence-based decision-making in healthcare often involves comparing multiple treatment options.
- The original GRADE evidence-to-decision (EtD) framework was designed for pairwise comparisons, limiting its use with network meta-analyses.
- Current GRADE guidance has evolved, necessitating an updated EtD framework.
Purpose of the Study:
- To develop a new EtD framework accommodating multiple comparisons.
- To integrate current GRADE guidance into the EtD framework.
- To improve the structure and usability of the EtD framework for guideline developers.
Main Methods:
- Iterative discussion, feedback, and refinement by the GRADE EtD Project Group and GRADE Working Group.
- Incorporation of experiences and examples from guideline developers and methodological experts.
- Approval of the revised framework by the GRADE Working Group.
Main Results:
- A new EtD framework with two parts: one for pairwise and one for multiple comparisons.
- The framework includes updated components for question definition, assessment (including a "net effect" criterion), and conclusion.
- Examples and presentation suggestions for findings in multiple comparison reviews are provided.
Conclusions:
- The revised GRADE EtD framework effectively addresses multiple comparisons in health decisions.
- The framework enhances the application of GRADE methodology in guideline development involving complex evidence syntheses.
- Further testing across diverse guideline contexts is needed to fully assess usability.
Related Concept Videos
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Sieve Analysis and Grading Curves
Comparing Experimental Results: Student's t-Test
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Quantifying and Rejecting Outliers: The Grubbs Test
