Systematic reviews on interventions for COVID-19 have rarely graded the certainty of the evidence

Ana Luiza Cabrera Martimbianco1, Rafael Leite Pacheco2, Carolina de Oliveira Cruz Latorraca3

  • 1PhD. Professor, Centro Universitário São Camilo, São Paulo (SP), Brazil; and Professor, Universidade Metropolitana de Santos (UNIMES), Santos (SP), Brazil.

Abstract

Insights

Most COVID-19 systematic reviews lack evidence certainty assessment. Only 21% used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach, impacting review reliability for coronavirus disease-19 treatments.

Area of Science:

  • Medical research methodology
  • Evidence-based medicine
  • Infectious disease epidemiology

Background:

  • Numerous systematic reviews on COVID-19 treatments exist.
  • Methodological quality of many reviews is questionable, potentially introducing bias.
  • Syntheses of primary studies on COVID-19 interventions need reliable assessment.

Purpose of the Study:

  • To determine the proportion of COVID-19 systematic reviews using the GRADE approach.
  • To assess the certainty of evidence in reviews of therapeutic or preventive options for COVID-19.
  • To highlight methodological gaps in COVID-19 evidence synthesis.

Main Methods:

  • Systematic search of MEDLINE (PubMed) for systematic reviews on COVID-19 interventions.
  • Inclusion of all systematic reviews assessing any intervention for COVID-19.
  • Examination of reviews for planned or actual use of the GRADE approach for evidence certainty.

Main Results:

  • 177 systematic reviews were included.
  • Only 37 reviews (21%) utilized the GRADE approach for evidence certainty.
  • Excluding Cochrane reviews, only 16.2% used GRADE, despite its mandatory nature in Cochrane reviews.

Conclusions:

  • A significant majority of COVID-19 systematic reviews omit crucial evidence certainty assessment.
  • The lack of GRADE methodology is a critical omission affecting review impact and usefulness.
  • Future COVID-19 research syntheses must incorporate GRADE for improved reliability and clinical utility.

Related Concept Videos

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
207
Nursing Interventions II: Selecting and Classifying the Nursing Interventions01:29

Nursing Interventions II: Selecting and Classifying the Nursing Interventions

Creating and executing a nursing diagnosis helps nurses plan care and guide patient, family, and community interventions. They are developed based on a patient's physical evaluation and support measuring the outcomes. It is not recommended to select random interventions throughout the planning process. Instead, consider the following six essential factors when choosing interventions:
2.7K
Healthcare Associated Infections II: Preventive Measures01:22

Healthcare Associated Infections II: Preventive Measures

Essential infection prevention measures are based on the knowledge of the infection chain, the modes of transmission in healthcare settings, and the use of the best practices in all healthcare settings. Compulsory public reporting of healthcare-associated infection rates is needed to allow individuals and the community to make informed choices regarding selecting a healthcare facility.
The best practices for preventing healthcare-associated infections include hand hygiene, patient risk...
3.2K
Study Designs in Epidemiology01:20

Study Designs in Epidemiology

Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
526
Controls in Experiments01:13

Controls in Experiments

When conducting an experiment, it is crucial to have control to reduce bias and accurately measure the dependent variables. It also marks the results more reliable. Controls are elements in an experiment that have the same characteristics as the treatment groups but are not affected by the independent variable. By sorting these data into control and experimental conditions, the relationship between the dependent and independent variables can be drawn. A randomized experiment always includes a...
14.0K
Hazard Ratio01:12

Hazard Ratio

The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial...
304