An international modified Delphi process supported updating the web-based "right review" tool

Area of Science:

• Health Research Methods
• Evidence Synthesis
• Systematic Reviews

Background:

• Selecting appropriate evidence synthesis methods is challenging due to the proliferation of available techniques.
• The Right Review tool was developed as a web-based decision support system to guide users in choosing suitable methods.
• Previous versions required updates to accommodate both quantitative and qualitative synthesis approaches.

Purpose of the Study:

• To update the Right Review tool, enhancing its functionality and clarity.
• To establish a common set of guiding questions for synthesizing both quantitative and qualitative evidence.
• To improve the selection process for evidence synthesis methods.

Main Methods:

• A 2-round modified international electronic Delphi survey was conducted in 2022.
• A diverse panel of experts (researchers, healthcare providers, patients, policymakers) rated the importance and clarity of tool items.
• High agreement was defined as at least 70% consensus; unresolved items were discussed by a Project Steering Group.

Main Results:

• Twenty-four experts participated in Round 1, and 12 in Round 2.
• Initial agreement was reached on 21 of 46 items in Round 1 and 8 of 27 items in Round 2.
• The final updated tool includes 42 items: 9 guiding questions, 25 evidence synthesis definitions/approaches, and 8 tool outputs, with revisions based on expert feedback.

Conclusions:

• The updated Right Review tool effectively supports the selection of appropriate evidence synthesis methods.
• The Delphi technique was instrumental in enhancing the tool's design and clarity.
• The enhanced, freely accessible tool is anticipated for release in Q1 2025.