Related Experiment Video
Updated: Jun 10, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
A comparative analysis of three online appraisal instruments' ability to assess validity in qualitative research
Karin Hannes1, Craig Lockwood, Alan Pearson
1Catholic University Leuven, Centre for Methodologyof Educational Research, Leuven, Belgium. karin.hannes@ped.kuleuven.be
Abstract:
The concept of validity has been a central component in critical appraisal exercises evaluating the methodological quality of quantitative studies. Reactions by qualitative researchers have been mixed in relation to whether or not validity should be applied to qualitative research and if so, what criteria should be used to distinguish high-quality articles from others. We compared three online critical appraisal instruments' ability to facilitate an assessment of validity. Many reviewers have used the critical appraisal skills program (CASP) tool to complete their critical appraisal exercise; however, CASP appears to be less sensitive to aspects of validity than the evaluation tool for qualitative studies (ETQS) and the Joanna Briggs Institute (JBI) tool. The ETQS provides detailed instructions on how to interpret criteria; however, it is the JBI tool, with its focus on congruity, that appears to be the most coherent.
Related Concept Videos
Reliability and Validity
Self-Report Tests of Personality
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Friedman Two-way Analysis of Variance by Ranks
Surveys
Qualitative Analysis
For instance, group IV...