Musculoskeletal ultrasound training and competency assessment program for rheumatology fellows

The purpose of this study was to establish standards for musculoskeletal ultrasound competency through knowledge and skills testing using criterion-referenced methods.

Two groups of rheumatology fellows trained in musculoskeletal ultrasound through a standardized curriculum, which required submission of ultrasound studies for review over 8 months. Both groups then completed written and practical examinations in musculoskeletal ultrasound. Instructors, advanced users, and intermediate users of musculoskeletal ultrasound served as comparison groups. A passing score (competency) was established for the written examination by the Angoff procedure and for the practical examination by the borderline method.

Thirty-eight fellows (19 in each group) took the final examination. Five fellows failed the written examination, and 1 failed the practical examination, whereas none of the advanced users failed. Written examination scores did not differ between the two fellow groups (74% versus 70%; P > .05), were reliable, and were able to discriminate between the intermediate and advanced groups. Practical and written examination results correlated in both groups (first group, r = 0.70; P = .0008; second group, r = 0.59; P = .009).

Criterion-referenced methods were used for the first time to determine fellow musculoskeletal ultrasound competency. The examination used to determine competency was reproducible, was reliable, and could differentiate musculoskeletal ultrasound users with different levels of experience. Most rheumatology fellows completing our program passed the written and practical examinations, suggesting achievement of basic musculoskeletal ultrasound competency.