Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among...

Area of Science:

• Medical Education
• Surgical Training
• Assessment Tools

Background:

• Workplace-based assessment (WPBA) was implemented in Malaysian orthopedic postgraduate training in December 2022.
• Understanding user knowledge and perception (KAP) is crucial for effective WPBA implementation.
• A systematic review is needed to assess if WPBA meets educational expectations.

Purpose of the Study:

• To validate a questionnaire assessing KAP of WPBA among orthopedic postgraduate trainees.
• To ensure the reliability and validity of a new assessment tool.

Main Methods:

• A pilot study utilized a 28-item questionnaire with prior face and content validation.
• The questionnaire was administered to postgraduate orthopedic trainees at the International Islamic University Malaysia.
• Rasch analysis was employed to evaluate the psychometric properties of the instrument.

Main Results:

• Rasch analysis indicated high reliability for both persons (0.93) and items (0.99).
• Person and item separation indices were 3.62 and 8.32, respectively.
• Misfitting items were identified and removed, refining the questionnaire.

Conclusions:

• The developed orthopedic WPBA KAP questionnaire is validated and reliable.
• The tool effectively assesses postgraduate trainees' understanding of WPBA.
• This validated instrument supports the successful integration of WPBA in orthopedic training.