Related Experiment Video
Updated: Jul 24, 2026
A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting
Published on: January 12, 2018
Structured decision-making drives guidelines panels' recommendations "for" but not "against" health interventions
Benjamin Djulbegovic1, Tea Reljic2, Shira Elqayam3
1Department of Supportive Care Medicine, City of Hope, 1500 East Duarte Rd, Duarte, CA, USA; Department of Hematology, City of Hope, 1500 East Duarte Rd, Duarte, CA, USA.
Background And Objectives:
The determinants of guideline panels' recommendations remain uncertain. The objective of this study was to investigate factors considered by members of 8 panels convened by the American Society of Hematology (ASH) to develop guidelines using Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system.
Study Design And Setting:
Web-based survey of the participants in the ASH guidelines panels.
Analysis:
two-level hierarchical, random-effect, multivariable regression analysis to explore the relation between GRADE and non-GRADE factors and strength of recommendations (SOR).
Results:
In the primary analysis, certainty in evidence [OR = 1.83; (95CI% 1.45-2.31)], balance of benefits and harms [OR = 1.49 (95CI% 1.30-1.69)] and variability in patients' values and preferences [OR = 1.47 (95CI% 1.15-1.88)] proved the strongest predictors of SOR. In a secondary analysis, certainty of evidence was associated with a strong recommendation [OR = 3.60 (95% CI 2.16-6.00)] when panel members recommended "for" interventions but not when they made recommendations "against" interventions [OR = 0.98 (95%CI: 0.57-1.8)] consistent with "yes" bias. Agreement between individual members and the group in rating SOR varied (kappa ranged from -0.01 to 0.64).
Conclusion:
GRADE's conceptual framework proved, in general, to be highly associated with SOR. Failure of certainty of evidence to be associated with SOR against an intervention, suggest the need for improvements in the process.
Related Concept Videos
01:11Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care evaluation by...
01:09Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
01:14Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:30Ethical Dilemmas II
01:19Standards of Care II
01:20Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...