Related Experiment Video
Updated: Jun 25, 2026
Enactive Phenomenological Approach to the Trier Social Stress Test: A Mixed Methods Point of View
Published on: January 7, 2019
A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and
Pierre Pluye1, Marie-Pierre Gagnon, Frances Griffiths
1Department of Family Medicine, McGill University, 517 Pine Avenue West, Montreal, QC, Canada H2W 1S4. pierre.pluye@mcgill.ca
Unlabelled:
A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies.
Objective:
To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components.
Design:
A three-step critical review was conducted.
Data Sources:
2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic.
Review Methods:
Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs).
Results:
Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality.
Conclusion:
A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.
Related Concept Videos
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
01:10Review and Preview
Percentiles are a type of fractile that partition data into...
01:13Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
01:15Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
01:17Cochran's Q Test
01:28Methods of Medium Optimization