Development and Validation of a New Assessment Tool for Simulation-Based Training in Ultrasound-Guided Peripheral...

Area of Science:

• Medical Education
• Ultrasound Technology
• Clinical Skills Assessment

Background:

• Peripheral venous catheterization is a common but challenging procedure.
• Ultrasound guidance improves success rates but requires specialized training.
• Simulation-based training offers a safe environment to develop these skills.

Purpose of the Study:

• To present and validate a novel assessment tool for ultrasound-guided peripheral venous catheterization.
• To ensure the tool's reliability and validity for simulation-based training.
• To facilitate the transition from simulation to clinical practice.

Main Methods:

• An exploratory, rater-blinded study involving 46 participants from two Danish university hospitals.
• Participants performed catheterizations on a phantom, with attempts video-recorded and rated using the new tool.
• Validity evidence was assessed using Messick's framework.

Main Results:

• High internal consistency (ICC = 0.85) and significant discrimination between novice and experienced participants (p < 0.001).
• A pass/fail score of 18 was established, with low false-negative (4.5%) and false-positive (12.5%) rates.
• The tool demonstrated validity and reliability in assessing skill acquisition.

Conclusions:

• The developed assessment tool is valid and reliable for evaluating competence in ultrasound-guided peripheral venous catheterization.
• It effectively differentiates skill levels, providing a standardized measure for simulation-based training.
• The tool serves as a crucial step for competence evaluation before clinical practice.