Validity of robotic simulation for high-stakes examination: a pilot study.

Area of Science:

• Surgical Education
• Robotic Surgery
• Medical Simulation

Background:

• Simulation is vital for training surgeons in robotic skills and assessing technical competency.
• The construct validity of simulation for high-stakes credentialing remains under-researched.
• Existing data differentiate novices from experts, but not intermediate from competent surgeons.

Purpose of the Study:

• To evaluate the construct validity of robotic surgery simulation for distinguishing between intermediate and competent surgeons.
• To assess if Da Vinci (Xi) simulations can differentiate performance levels in a thoracic cadaveric setting.

Main Methods:

• Twenty-one competent surgeons and 17 intermediate surgeons performed three Da Vinci (Xi) simulations during a robotic thoracic cadaver course.
• Performance scores were recorded and analyzed for statistically significant differences between the two groups using t-tests.

Main Results:

• No statistically significant differences in overall scores were found between intermediate and competent surgeons across any simulation exercise.
• Simulation performance failed to distinguish between the skill levels of intermediate and competent robotic surgeons.

Conclusions:

• Current robotic surgery simulation exercises lack the validity to differentiate between intermediate and competent surgeon performance.
• The use of simulation for surgical credentialing requires careful consideration due to insufficient validity data.