Related Experiment Video
Updated: May 26, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Cross-validation of an instrument for measuring professionalism behaviors
Katherine A Kelley1, Luke D Stanke, Suzanne M Rabi
1College of Pharmacy, Ohio State University, USA. kelley.168@osu.edu
Objective:
To cross-validate an instrument to measure behavioral aspects of professionalism in pharmacy students using a rating scale that minimizes ceiling effects.
Methods:
Seven institutions collaborated to create a 33-item assessment tool that included 5 domains of professionalism: (1) Reliability, Responsibility and Accountability; (2) Lifelong Learning and Adaptability; (3) Relationships with Others; (4) Upholding Principles of Integrity and Respect; and (5) Citizenship and Professional Engagement. Each item was rated based on 5 levels of competency which were aligned with a modified Miller's Taxonomy (Knows, Knows How, Shows, Shows How and Does, and Teaches).
Results:
Factor analyses confirmed the presence of 5 domains for professionalism. The factor analyses from the 7-school pilot study demonstrated that professionalism items were good fits within each of the 5 domains.
Conclusions:
Based on a multi-institutional pilot study, data from the Professionalism Assessment Tool (PAT), provide evidence for internal validity and reliability. Use of the tool by external evaluators should be explored in future research.
Related Concept Videos
Self-Report Tests of Personality
Reliability and Validity
Self-Evaluation Maintenance Model
Self-Presentation: Self-Monitoring and Self-Handicapping
Sources of Self-Esteem II: Performance Feedback
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...