Related Experiment Video

Updated: Oct 7, 2025

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

784

Systematic reviews do not (yet) represent the 'gold standard' of evidence: A position paper

Robert Andrew Moore1, Emma Fisher2,3, Christopher Eccleston2,3,4

  • 1Newton Ferrers, Plymouth, UK.

European Journal of Pain (London, England)
|January 9, 2022
PubMed

Insights

Most systematic reviews are flawed and unreliable due to poor trial quality and methodology. Their conclusions are often misleading, with only 3% being clinically useful, necessitating critical evaluation.

Area of Science:

  • Medical research methodology
  • Evidence-based medicine
  • Scientific integrity

Background:

  • Systematic reviews are considered the 'gold standard' for medical evidence.
  • However, numerous systematic reviews suffer from critical flaws.
  • These flaws compromise the reliability and validity of their findings.

Purpose of the Study:

  • To evaluate the quality and methodological rigor of published systematic reviews.
  • To identify common deficiencies that undermine the credibility of systematic review conclusions.
  • To advocate for improved standards in systematic review conduct and reporting.

Main Methods:

  • Analysis of methodological quality across a broad range of systematic reviews.
  • Assessment of adherence to established guidelines for systematic reviews.
  • Identification of specific flaws including trial selection, data extraction, and outcome interpretation.

Main Results:

  • A significant majority of systematic reviews contain fatal methodological flaws.
  • Less than 3% of reviewed systematic reviews meet adequate methodological standards for clinical utility.
  • Inclusion of low-quality trials and biased interpretation of results are prevalent issues.

Conclusions:

  • The conclusions drawn from most published systematic reviews should be viewed with skepticism.
  • Systematic reviews often represent research waste due to poor underlying trial quality.
  • Forensically critical appraisal of systematic reviews is essential to improve trial quality and protect scientific integrity.

More Related Videos

Protocol and Guidelines for Point-of-Care Lung Ultrasound in Diagnosing Neonatal Pulmonary Diseases Based on International Expert Consensus06:15

Protocol and Guidelines for Point-of-Care Lung Ultrasound in Diagnosing Neonatal Pulmonary Diseases Based on International Expert Consensus

Published on: March 6, 2019

50.7K
Meta-Analysis of the Effectiveness and Safety of Shugan Jieyu Capsules for the Treatment of Insomnia04:34

Meta-Analysis of the Effectiveness and Safety of Shugan Jieyu Capsules for the Treatment of Insomnia

Published on: February 17, 2023

1.3K

Related Concept Videos

Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
4.1K
The Evidence for Evolution02:55

The Evidence for Evolution

Genetic variations accumulating within populations over generations give rise to biological evolution. Evolutionary changes can result in the formation of novel varieties and entire new species. These changes are responsible for the diverse forms of life inhabiting the planet. The evidence for evolution suggests that all living organisms descended from common ancestors.
44.9K
Criticisms of the Evolutionary Perspective01:23

Criticisms of the Evolutionary Perspective

In a study where individuals posing as strangers offered compliments and proposed casual sex to students, the responses differed significantly based on gender. Not a single woman accepted the proposal, while 70% of the men agreed. This outcome provides a useful scenario to explore through the lens of evolutionary psychology and social learning theory, highlighting the diverse perspectives on human sexual behaviors.
Evolutionary psychology provides one explanation for these findings, suggesting...
178
Methods of Documentation VI: Case Management Model01:15

Methods of Documentation VI: Case Management Model

The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
650
Standards of Care II01:19

Standards of Care II

Nurses bear specific legal responsibilities under several federal statutes, including:
738
Cardiovascular Drugs: Classification based on Therapeutic Indications01:18

Cardiovascular Drugs: Classification based on Therapeutic Indications

Cardiovascular diseases, encompassing a range of conditions, can significantly affect the heart's operations and the overall circulatory system. These conditions impair the heart's ability to pump blood, leading to a deficit in oxygen supply to crucial organs. Anomalies in the heart's electrical system, known as arrhythmias, can cause heartbeats to accelerate or slow down. Usually, heart rates increase during physical activity and decrease while resting or sleeping. However,...
3.4K