Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic...

Area of Science:

• Neurosurgery Education
• Medical Simulation
• Surgical Skill Assessment

Background:

• The shift towards criterion-based training in neurosurgery necessitates robust competency and assessment tools.
• Virtual reality simulators offer objective measures but lack comprehensive overall performance assessment for trainees.
• This study addresses the need for a validated tool to evaluate overall performance in simulation-based endoneurosurgery training.

Purpose of the Study:

• To develop and validate a tool for assessing overall participant performance in a simulation-based endoneurosurgery training environment.
• To identify key factors contributing to overall skill assessment in surgical residents.
• To test the tool's ability to estimate participant experience levels and assess scenario realism.

Main Methods:

• Developed a two-level training program (endoscopy, surgical practice) with four scenarios.
• Conducted three experiments with distinct participant groups (beginners, experienced, novices, intermediate).
• Analyzed performance data to extract a factor for overall skill assessment and tested its predictive accuracy.

Main Results:

• A performance indicator derived from time, distance, and accuracy effectively assessed overall skills.
• The tool demonstrated high prediction correctness for beginners compared to experienced surgeons.
• Specific scenarios were identified as suitable assessment tools for different skill levels (beginners, intermediate, novice).

Conclusions:

• The developed performance indicator effectively assesses overall skill levels in neurosurgery simulation.
• Simulation scenarios can be tailored for assessing specific trainee experience levels.
• Balancing perceived action capacities and skills is crucial for designing effective surgical simulation assessment tools.