Related Experiment Video
Updated: Oct 25, 2025

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
Systematic reviews on interventions for COVID-19 have rarely graded the certainty of the evidence
Ana Luiza Cabrera Martimbianco1, Rafael Leite Pacheco2, Carolina de Oliveira Cruz Latorraca3
1PhD. Professor, Centro Universitário São Camilo, São Paulo (SP), Brazil; and Professor, Universidade Metropolitana de Santos (UNIMES), Santos (SP), Brazil.
Background:
Numerous systematic reviews on coronavirus disease-19 (COVID-19) treatment have been developed to provide syntheses of the large volume of primary studies. However, the methodological quality of most of these reviews is questionable and the results provided may therefore present bias.
Objective:
To investigate how many systematic reviews on the therapeutic or preventive options for COVID-19 assessed the certainty of the evidence through the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach.
Methods:
We conducted a sensitive search in MEDLINE (via PubMed) and included all systematic reviews that assessed any intervention for COVID-19. The systematic reviews included were examined to identify any planned and/or actual assessment using the GRADE approach (or absence thereof) regarding the certainty of the evidence.
Results:
We included 177 systematic reviews and found that only 37 (21%; 37/177) assessed and reported the certainty of the evidence using the GRADE approach. This number reduced to 27 (16.2%; 27/167) when Cochrane reviews (n = 10), in which an evaluation using GRADE is mandatory, were excluded.
Conclusion:
Most of the systematic reviews on interventions relating to COVID-19 omitted assessment of the certainty of the evidence. This is a critical methodological omission that must not be overlooked in further research, so as to improve the impact and usefulness of syntheses relating to COVID-19.
Insights
Most COVID-19 systematic reviews lack evidence certainty assessment. Only 21% used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach, impacting review reliability for coronavirus disease-19 treatments.
Area of Science:
- Medical research methodology
- Evidence-based medicine
- Infectious disease epidemiology
Background:
- Numerous systematic reviews on COVID-19 treatments exist.
- Methodological quality of many reviews is questionable, potentially introducing bias.
- Syntheses of primary studies on COVID-19 interventions need reliable assessment.
Purpose of the Study:
- To determine the proportion of COVID-19 systematic reviews using the GRADE approach.
- To assess the certainty of evidence in reviews of therapeutic or preventive options for COVID-19.
- To highlight methodological gaps in COVID-19 evidence synthesis.
Main Methods:
- Systematic search of MEDLINE (PubMed) for systematic reviews on COVID-19 interventions.
- Inclusion of all systematic reviews assessing any intervention for COVID-19.
- Examination of reviews for planned or actual use of the GRADE approach for evidence certainty.
Main Results:
- 177 systematic reviews were included.
- Only 37 reviews (21%) utilized the GRADE approach for evidence certainty.
- Excluding Cochrane reviews, only 16.2% used GRADE, despite its mandatory nature in Cochrane reviews.
Conclusions:
- A significant majority of COVID-19 systematic reviews omit crucial evidence certainty assessment.
- The lack of GRADE methodology is a critical omission affecting review impact and usefulness.
- Future COVID-19 research syntheses must incorporate GRADE for improved reliability and clinical utility.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Nursing Interventions II: Selecting and Classifying the Nursing Interventions
Healthcare Associated Infections II: Preventive Measures
The best practices for preventing healthcare-associated infections include hand hygiene, patient risk...
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Controls in Experiments
Hazard Ratio
For example, in a clinical trial...

