The methodological quality and clinical applicability of meta-analyses on probiotics in 2020: A cross-sectional study
Jakub Ruszkowski1, Katarzyna Majkutewicz2, Ewelina Rybka3
1Department of Pathophysiology, Faculty of Medicine, Medical University of Gdańsk, Dębinki 7, 80-211 Gdańsk, Poland; Department of Nephrology, Transplantology and Internal Medicine, Faculty of Medicine, Medical University of Gdańsk, Poland.
Abstract:
Systematic reviews with meta-analyses (SR/MA) are frequently conducted to investigate clinical efficacy of probiotics. However, only rigorously prepared analyses can serve as the highest level of evidence for a specified research question. We have aimed to determine (1) what is the methodological quality of recent SR/MA conducted to assess the efficacy of probiotics; (2) whether the results of SR/MA have a clinical application; and (3) what are factors associated with better quality and applicability of the SR/MA. We systematically searched 4 databases for SR/MA on the probiotics efficacy published in 2020 (PROSPERO CRD42020222716). The AMSTAR 2 tool and pre-defined authors' criteria were used to evaluate methodological quality and clinical applicability, respectively. A total of 114 SR/MA were appraised. In the case of 88 papers (77%), the overall confidence in the results was rated as "critically low". The most prevalent flaws were lack of list of excluded studies with justification (79.8%), lack of study protocol (60.5%), and problems with appropriate results combination(54.4%). A declaration of conduction a probiotic efficacy SR/MA could have been misleading in case of 18 studies that included also synbiotics, paraprobiotics, and prebiotics trials in analyses. Only 14 SR/MA provided results that can be apply in clinical practice. Higher journal impact factor and European affiliation of the 1st and corresponding authors were most consistently associated with higher odds of AMSTAR 2 items fulfillments. Based on our findings, SR/MA of probiotics trials cannot be treated as the highest level of evidence without a careful evaluation of their methodological validity.
Insights
Most systematic reviews with meta-analyses (SR/MA) on probiotic efficacy lack methodological rigor, limiting their clinical applicability. Careful evaluation is needed before accepting SR/MA findings as high-level evidence.
Area of Science:
- Microbiology and Clinical Research
- Evidence-Based Medicine
Background:
- Systematic reviews with meta-analyses (SR/MA) are crucial for evaluating probiotic efficacy.
- High-quality SR/MA are essential for reliable clinical evidence.
Purpose of the Study:
- To assess the methodological quality and clinical applicability of recent SR/MA on probiotic efficacy.
- To identify factors associated with higher quality and applicability in these reviews.
Main Methods:
- Systematic search of four databases for SR/MA on probiotic efficacy published in 2020.
- Evaluation using the AMSTAR 2 tool for methodological quality and author-defined criteria for clinical applicability.
- Appraisal of 114 SR/MA.
Main Results:
- 77% of SR/MA had critically low confidence in their results.
- Common flaws included lack of excluded studies lists, study protocols, and appropriate results combination.
- Only 14 SR/MA offered clinically applicable results.
- Higher journal impact factor and European author affiliation correlated with better quality.
Conclusions:
- Many SR/MA on probiotic efficacy suffer from significant methodological flaws.
- The clinical applicability of findings from these reviews is often limited.
- SR/MA on probiotics require rigorous methodological assessment to be considered high-level evidence.
More Related Videos
Related Concept Videos
Microorganisms in Medicine and Therapeutics
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Bioavailability Study Design: Healthy Subjects Versus Patients
Clinical Trials
There are four phases in a clinical trial. A phase one...
Bioavailability Study Design: Absolute Versus Relative Bioavailability


