Five common pitfalls in mixed methods systematic reviews: lessons learned.

Area of Science:

• Systematic Reviews
• Mixed Methods Research
• Evidence Synthesis

Background:

• Mixed methods systematic reviews (MMSRs) integrate quantitative and qualitative data.
• The JBI methodology for MMSRs was revised in 2020.
• Recent MMSRs show frequent deviations from the updated JBI methodology.

Purpose of the Study:

• To identify common pitfalls in conducting MMSRs post-JBI methodology revision.
• To provide direction for reviewers to avoid methodological deviations.
• To aid MMSR users in recognizing potential issues in published reviews.

Main Methods:

• Forward citation tracking of reviews published after the JBI MMSR guidance revision.
• Examination of 17 identified reviews against the JBI MMSR methodology.
• Identification and analysis of deviations from the prescribed methods.

Main Results:

• Deviations were observed in the rationale for methodological approach selection.
• Issues included incorrect synthesis and integration strategies.
• Exclusion of primary mixed methods studies and lack of data transformation detail were noted.
• Insufficient 'mixing' of quantitative and qualitative components was a common problem.

Conclusions:

• Authors frequently deviate from the JBI MMSR methodology.
• Common pitfalls include rationale, synthesis, data transformation, and integration issues.
• Recommendations are provided to improve adherence and quality in future MMSRs.