Certification examinations for massage therapists: a psychometric analysis

Area of Science:

• Professional assessment in health sciences.
• Psychometrics and educational measurement.
• Massage therapy practice standards.

Background:

• The Alberta Registered Massage Therapists Society (ARMTS) requires a standardized examination for professional licensure.
• Evaluating the psychometric properties of licensing examinations is crucial for ensuring public safety and professional competence.

Purpose of the Study:

• To detail the structure of the ARMTS examination.
• To assess the psychometric properties, including reliability and validity, of the ARMTS examination components.

Main Methods:

• The ARMTS examination, comprising knowledge, clinical judgment, and clinical skills, was administered to 112 candidates.
• Written components included multiple-choice questions on basic science and clinical judgment. Practical skills were assessed using standardized patients for history taking, physical assessment, and treatment.
• Criterion-referenced measurement with minimum performance levels (MPL) was employed.

Main Results:

• Internal consistency reliability (Cronbach alpha) ranged from 0.60 to 0.88.
• Concurrent, criterion-related validity was supported by correlations between components (r = 0.24 to 0.78, P <.05).
• Factor analysis identified three distinct factors: information processing, clinical treatment, and follow-up management.

Conclusions:

• The ARMTS examination exhibits adequate-to-good internal consistency reliability and content validity.
• Empirical validity is supported by correlational analyses, indicating that components assess unique domains.
• Factor analysis provides evidence for discriminant validity, confirming the examination measures distinct areas of competence.