Related Experiment Video
Updated: Mar 20, 2026
08:08
Simulator Training for Endovascular Neurosurgery
Published on: May 6, 2020
4.2K
Simulator and 2 tools: Validation of performance measures from a novel neurosurgery simulation model using the
Deborah M Rooney1, Bruce L Tai2, Oren Sagher3
1Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI.
Surgery
|June 1, 2016
Summary
A novel simulator and assessment tools effectively train and evaluate neurosurgical skills for ventriculostomy procedures. This validated approach distinguishes novice from expert performance, enhancing surgical education.
Area of Science:
- Neurosurgery
- Medical Simulation
- Surgical Education
Background:
- Ventriculostomy is a complex neurosurgical procedure with a significant learning curve.
- A high-fidelity simulator and specific assessment tools are needed for safe and effective skills training.
- Current training lacks objective measures aligned with accreditation standards.
Purpose of the Study:
- To evaluate the validity of a novel low-cost, high-fidelity ventriculostomy simulator.
- To assess the psychometric properties of the Ventriculostomy Procedural Assessment Tool (VPAT) and Objective Structured Assessment for Technical Skills (OSATS).
- To determine if the simulator and tools can differentiate between novice and expert neurosurgeons.
Main Methods:
- Collected performance data from 11 novice and 3 expert neurosurgeons using the simulator.
- Participants self-rated performance using the 11-item VPAT.
- Videotaped performances were independently rated by 3 neurosurgeons using VPAT and OSATS.
- Evaluated validity evidence using multifacet Rasch models and traditional psychometric analyses.
Main Results:
- Adequate validity evidence for test content and response processes was found.
- High inter-rater agreement was observed for both VPAT (ICC [0.00, 0.91]) and OSATS (ICC [0.80, 0.93]).
- Novices performed significantly lower than experts on OSATS (P < .01) and showed lower, though not always significant, performance on VPAT items.
Conclusions:
- The novel simulator and assessment tools (VPAT and OSATS) demonstrate favorable validity evidence for skills training and performance assessment in ventriculostomy.
- The combined approach can effectively distinguish between novice and expert performance.
- While promising, potential validity challenges require consideration before widespread implementation.
