Development of and Gathering Validity Evidence for a Theoretical Test in Contrast-Enhanced Ultrasound

Area of Science:

• Medical Imaging
• Ultrasound Technology
• Diagnostic Procedures

Background:

• Contrast-enhanced ultrasound (CEUS) is a versatile imaging technique used across medical specialties.
• Validated assessment tools for CEUS theoretical and practical competencies are currently lacking.
• Standardized evaluation is crucial before independent CEUS practice.

Purpose of the Study:

• To develop a multiple-choice question-based test for core CEUS competencies.
• To gather validity evidence for the developed theoretical CEUS assessment tool.
• To evaluate the test's reliability and ability to differentiate proficiency levels.

Main Methods:

• A Delphi process involving an expert team to develop the test items.
• Administration of the 47-item test to medical doctors with diverse CEUS experience.
• Evaluation of test items, internal consistency, and discriminant validity using Messick's framework.

Main Results:

• The final test demonstrated acceptable reliability in distinguishing between operators with and without CEUS experience.
• The test successfully identified core CEUS knowledge gaps.
• The established pass/fail score presented a significant risk of false positives and negatives.

Conclusions:

• The developed test can serve as an entry-level assessment for CEUS training.
• The current pass/fail threshold is not recommended for certification due to reliability concerns.
• Further refinement is needed to enhance the test's suitability for high-stakes CEUS evaluation.