Assessing psychometric properties of scales: a case study
Related Experiment Video
Updated: Jul 14, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Andrea P Marshall1, Murray J Fisher, Jillian Brammer
1Faculty of Nursing and Midwifery, The University of Sydney, Sydney, New South Wales, Australia. amarshall@nursing.usyd.edu.au
Aim:
This paper is a report of a study to examine the construct validity of The Nursing Students' Attitudes and Awareness of Research and Development within Nursing Scale.
Background:
The validity of instruments is critical in ensuring that data collected are sound and that the data measures what it purports to measure. When a new instrument is used in a different population or when it has been modified, it is useful to re-examine the construct validity of the instrument.
Method:
A survey design was used in September 2004 with a sample of 615 undergraduate nursing students to test the factor structure of The Nursing Students' Attitudes and Awareness of Research and Development within Nursing Scale and to estimate its similarity to the factor structure reported for the original scale developed and tested in a group of Registered Nurses.
Results:
Using Maximum Likelihood Factor Analysis and then Principal Axis Factoring, we were unable to obtain a similar factor structure to that originally identified for the scale. Our data resulted in a two-factor structure. One factor consisted of 16 items that reflected a positive attitude to nursing research and the other consisted of 14 items that reflected a negative attitude to nursing research.
Conclusion:
The substantially different factor structure identified suggests that this scale requires further refinement and testing. This case study highlights the importance of a systematic and comprehensive approach to determining construct validity of scales, thus enabling researchers to determine their suitability as data collection instruments.
Related Concept Videos
Self-Report Tests of Personality
Reliability and Validity
Surveys
Strategies of Self-Presentation III: Self-Monitoring
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Cattell's 16 Personality Factors
In contrast, source traits are the fundamental,...