Related Experiment Video
Updated: Feb 14, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies,
Quan Nha Hong1, Araceli Gonzalez-Reyes1, Pierre Pluye1
1Department of Family Medicine, McGill University, Montréal, QC, Canada.
Rationale, Aims, And Objectives:
Systematic reviews combining qualitative, quantitative, and/or mixed methods studies are increasingly popular because of their potential for addressing complex interventions and phenomena, specifically for assessing and improving clinical practice. A major challenge encountered with this type of review is the appraisal of the quality of individual studies given the heterogeneity of the study designs. The Mixed Methods Appraisal Tool (MMAT) was developed to help overcome this challenge. The aim of this study was to explore the usefulness of the MMAT by seeking the views and experiences of researchers who have used it.
Methods:
We conducted a qualitative descriptive study using semistructured interviews with MMAT users. A purposeful sample was drawn from the researchers who had previously contacted the developer of the MMAT, and those who have published a systematic review for which they had used the MMAT. All interviews were transcribed verbatim and analyzed by 2 coders using thematic analysis.
Results:
Twenty participants from 8 countries were interviewed. Thirteen themes were identified and grouped into the 2 dimensions of usefulness, ie, utility and usability. The themes related to utility concerned the coverage, completeness, flexibility, and other utilities of the tool. Those regarding usability were related to the learnability, efficiency, satisfaction, and errors that could be made due to difficulties understanding or selecting the items to appraise.
Conclusions:
On the basis of the results of this study, we make several recommendations for improving the MMAT. This will contribute to greater usefulness of the MMAT.
More Related Videos
Related Concept Videos
The Sense of Self: Reflected Self-Appraisal and Social Comparison
Lazarus's Cognitive Appraisal Theory
Primary Appraisal:...
Mixing Concrete
Mixing Time
Ready Mixed Concrete
Design Example: Vintage Mixing Console
The specifications for the pre-amplifier were clear. It needed to amplify the audio signal by a factor of 10, have an input impedance above 10...

