Related Experiment Video
Updated: May 15, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Development of an appraisal tool to evaluate strength of an instrument or outcome measure
Kat Leung1, Lyndal Trevena, Donna Waters
1Sydney Medical School, University of Sydney, New South Wales, Australia. kleu9486@uni.sydney.edu.au
Aim:
To devise a framework to enable the grading of the psychometric strength of instruments and questionnaires.
Background:
Clinicians and researchers use a range of instruments and questionnaires to evaluate the outcomes of their research or clinical practice. To date, there has been no quantitative framework designed to determine the validity of these measurement tools.
Review Methods:
The psychometric grading framework (PGF) consists of two scales: scale one is a matrix for assigning a level (A-D) to each of six psychometric properties, based on the strength of any measures reported; scale two grades the overall psychometric strength of the instrument by combining the number and level of psychometric measures arising from the first scale.
Conclusion:
The PGF uses a simple matrix that combines results from psychometric measures into an overall grading of an instrument's strength. The flexibility of the framework enables consistent determination of strength across a range of instruments.
Implications For Research/Practice:
The PGF provides a preliminary evaluation (or grading) of the psychometric properties of an instrument based on the number and strength of reported psychometric scores. Its use may reduce the subjective judgements about the quality of instruments and outcome measures.
More Related Videos
Related Concept Videos
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Reliability and Validity
Self-Report Tests of Personality
Development of Analytical Methods
Lazarus's Cognitive Appraisal Theory
Primary Appraisal:...
Self-Evaluation Maintenance Model
