Related Experiment Video
Updated: Mar 2, 2026

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
Methodological quality is underrated in systematic reviews and meta-analyses in health psychology
Isabel Oliveras1, Josep-Maria Losilla1, Jaume Vives1
1Department of Psychobiology and Methodology of Health Sciences, Psychology Faculty, Universitat Autònoma de Barcelona, Carrer de la Fortuna, Edifici B, 08193 Bellaterra, Barcelona, Spain.
Objectives:
In this paper, we compile and describe the main approaches proposed in the literature to include methodological quality (MQ) or risk of bias (RoB) into research synthesis. We also meta-review how the RoB of observational primary studies is being assessed and to what extent the results are incorporated in the conclusions of research synthesis.
Study Design And Setting:
Electronic databases were searched for systematic reviews or meta-analyses related to health and clinical psychology. A random sample of 90 reviews published between January 2010 and May 2016 was examined.
Results:
A total of 46 reviews (51%) performed a formal assessment of the RoB of primary studies. Only 17 reviews (19%) linked the outcomes of quality assessment with the results of the review.
Conclusion:
According to the previous literature, our results corroborate the lack of guidance to incorporate the RoB assessment in the results of systematic reviews and meta-analyses. Our recommendation is to appraise MQ according to domains of RoB to rate the degree of credibility of the results of a research synthesis, as well as subgroup analysis or meta-regression as analytical methods to incorporate the quality assessment.
Related Concept Videos
Psychology as a Science
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
Humanistic Psychology
This approach...
Scientific Nature of Social Psychology
The Scientific Method in Nursing Process
When using research findings to change practice, one must understand the process used to guide a study. The scientific method is a systematic, step-by-step process that supports the data's validity, reliability, and generalizability. As a result, findings can be...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Ethics in Research