Related Experiment Video
Updated: Jun 23, 2025
Video-oculography in Mice
Published on: July 19, 2012
Head motion-corrected eye gaze tracking with the da Vinci surgical system
Alexandre Banks1, Alaa Eldin Abdelaal2,3, Septimiu Salcudean2
1Electrical and Computer Engineering Department, University of British Columbia, Main Mall, Vancouver, BC, V6T 1Z4, Canada. albanks@student.ubc.ca.
Purpose:
To facilitate the integration of point of gaze (POG) as an input modality for robot-assisted surgery, we introduce a robust head movement compensation gaze tracking system for the da Vinci Surgical System. Previous surgical eye gaze trackers require multiple recalibrations and suffer from accuracy loss when users move from the calibrated position. We investigate whether eye corner detection can reduce gaze estimation error in a robotic surgery context.
Methods:
A polynomial regressor is first used to estimate POG after an 8-point calibration, and then, using another regressor, the POG error from head movement is estimated from the shift in 2D eye corner location. Eye corners are computed by first detecting regions of interest using the You Only Look Once (YOLO) object detector trained on 1600 annotated eye images (open dataset included). Contours are then extracted from the bounding boxes and a derivative-based curvature detector refines the eye corner.
Results:
Through a user study (n = 24), our corner-contingent head compensation algorithm showed an error reduction in degrees of visual angle of 1.20 (p = 0.037) for the left eye and 1.26 (p = 0.079) for the right compared to the previous gold-standard POG error correction method. In addition, the eye corner pipeline showed a root-mean-squared error of 3.57 (SD = 1.92) pixels in detecting eye corners over 201 annotated frames.
Conclusion:
We introduce an effective method of using eye corners to correct for eye gaze estimation, enabling the practical acquisition of POG in robotic surgery.
