Related Experiment Video
Updated: Aug 25, 2026
A Novel Application of Musculoskeletal Ultrasound Imaging
Published on: September 17, 2013
Confidence-Competence Calibration in Early Procedural Skill Acquisition: Evidence From Musculoskeletal Ultrasound
Kamini Shah1, Jonathan Samuels2, Jennifer Medlin3
1Donald and Barbara Zucker School of Medicine at Hofstra/Northwell Health, Hempstead, New York.
Objective:
We examined relationships among learner-reported outcomes and assessed alignment between confidence and objective examination performance during early musculoskeletal ultrasound (MSKUS) skill acquisition.
Methods:
Learners in the Ultrasound School of North American Rheumatologists Fundamentals program were evaluated in the 2024 and 2025 cohorts. The eight-month program included virtual instruction, standardized scanning protocols, a three-day hands-on workshop, longitudinal image submission with feedback, and written and practical examinations. Subjective measures included confidence in scanning and interpretation, perceived knowledge, and perceived ability to apply ultrasound in the work setting. Spearman correlations assessed associations among subjective measures and between confidence and continuous examination scores; threshold-sensitivity categorical analyses were secondary. Subjective-objective analyses were limited to 2025 because individual linkage was unavailable for 2024.
Results:
Among 118 learners, perceived knowledge and ability-to-apply data were available for 93. Linked subjective and written examination data were available for 70 learners and practical scores for 69. Subjective domains were positively associated (knowledge with confidence ρ = 0.46, P < 0.001; confidence with ability to apply ρ = 0.32, P = 0.007). Confidence was not associated with written performance (ρ = -0.04, P = 0.74) or practical performance (ρ = -0.16, P = 0.20) in continuous analyses, and no categorical threshold reached significance (all P ≥ 0.054). Miscalibration was bidirectional: 39% overconfident, 35% underconfident, and 26% calibrated.
Conclusion:
Among early MSKUS learners, confidence aligned with other learner-reported outcomes but did not discriminate objective competence. This calibration gap suggests that learner-reported readiness should not determine preparedness for independent scanning and supports objective competency assessment.
