Related Experiment Video
Updated: Feb 28, 2026

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
Published on: February 19, 2021
Identifying approaches for assessing methodological and reporting quality of systematic reviews: a descriptive study
Kusala Pussegoda1, Lucy Turner1, Chantelle Garritty1,2
1Ottawa Methods Centre, Clinical Epidemiology Program, Centre for Practice-Changing Research, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Assessing the quality of systematic reviews (SRs) is crucial for evidence-based healthcare. This study found diverse methods are used, with PRISMA, OQAQ, and AMSTAR being the most common tools for methodological and reporting quality assessment.
Area of Science:
- Evidence-based healthcare
- Systematic review methodology
- Research quality assessment
Background:
- Methodological quality and reporting completeness of systematic reviews (SRs) are vital for effective evidence-based healthcare and reducing research waste.
- Existing methods for appraising SRs are known, but their application and potential gaps in best-practice guidance remain unclear.
- This study aimed to identify reports assessing the methodological quality (MQ) and/or reporting quality (RQ) of SRs, analyzing their characteristics and quality assessment approaches over time.
Purpose of the Study:
- To identify and characterize reports that assess the methodological and/or reporting quality of systematic reviews.
- To analyze the trends and approaches used in assessing the quality of systematic reviews over time.
- To understand the landscape of quality assessment tools and guidelines employed in systematic review research.
Main Methods:
- A comprehensive literature search was conducted in Cochrane Library, MEDLINE, and EMBASE from January 1990 to October 2014.
- Reports assessing the MQ and/or RQ of a cohort of ten or more SRs of interventions were included after independent screening by two reviewers.
- Data on the number, characteristics, and quality assessment approaches were extracted and reported as frequencies and percentages.
Main Results:
- Out of 20,765 unique records, 76 reports met the inclusion criteria.
- Eight established approaches (reporting guidelines like PRISMA, QUOROM; quality assessment tools like AMSTAR, OQAQ, Mulrow, Sacks, GRADE) were used in 80% of reports.
- PRISMA, OQAQ, and AMSTAR were the most frequently utilized published tools for assessing MQ or RQ.
Conclusions:
- The methods for assessing the quality of SRs are varied, with no single approach achieving universal acceptance.
- AMSTAR, OQAQ, and PRISMA are the most commonly employed tools for quality assessment in systematic reviews.
- Authors conducting methodological studies are encouraged to carefully select appropriate tools and guidelines for assessing both the methodological and reporting quality of SRs as new resources emerge.
More Related Videos
Related Concept Videos
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Data Validation
Key parameters for method validation include:
Quality Assurance
The Scientific Method in Nursing Process
When using research findings to change practice, one must understand the process used to guide a study. The scientific method is a systematic, step-by-step process that supports the data's validity, reliability, and generalizability. As a result, findings can be...
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...

