Development and Validation of Objective Performance Metrics for Robot-Assisted Radical Prostatectomy: A Pilot Study

Area of Science:

• Robotics in Surgery
• Surgical Skill Assessment
• Medical Device Technology

Background:

• Objective performance metrics are crucial for evaluating surgeon proficiency in robotic surgery.
• The da Vinci® Surgical System offers opportunities for data capture to assess surgical skills.
• Standardized metrics are needed to objectively measure surgeon performance and guide training.

Purpose of the Study:

• To validate objective surgeon performance metrics using the novel dVLogger recorder.
• To assess the construct and concurrent validity of these metrics during robot-assisted radical prostatectomy.
• To establish a foundation for developing standardized metrics for surgeon training and assessment.

Main Methods:

• Recorded kinematic and event data from expert and novice surgeons during specific steps of robot-assisted radical prostatectomy.
• Compared metrics between expert and novice surgeons using statistical modeling for construct validation.
• Correlated objective metrics with expert ratings (GEARS) for seminal vesicle dissection and anterior vesicourethral anastomosis for concurrent validation.

Main Results:

• Experts demonstrated greater efficiency, with less instrument travel distance and idle time, and shorter camera path length compared to novices (p <0.001).
• Experts exhibited a higher ratio of dominant-to-nondominant instrument path distance (p <0.04), except in anterior vesicourethral anastomosis.
• Objective kinematic metrics showed low associations with Global Evaluative Assessment of Robotic Skills (GEARS) ratings for specific surgical steps.

Conclusions:

• Objective metrics effectively differentiate expert from novice surgeons in robot-assisted radical prostatectomy, highlighting improved efficiency and directed movements.
• The developed objective metrics show potential for surgeon training and assessment in robotic surgery.
• Further research is needed to refine and integrate these objective metrics into standardized surgical training programs.