Related Experiment Video
Updated: Jun 17, 2026
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
Towards image guided robotic surgery: multi-arm tracking through hybrid localization
David Morgan Kwartowitz1, Michael I Miga, S Duke Herrell
1Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA. kwartowitz.david@mayo.edu
Objective:
Use of the robotic assisted surgery has been increasing in recent years, due both the continuous increase in the number of applications and the clinical benefits that surgical robots can provide. Currently robotic assisted surgery relies on endoscopic video for navigation, providing only surface visualization, thus limiting subsurface vision. To be able to visualize and identify subsurface information, techniques in image-guidance can be used. As part of designing an image guidance system, all arms of the robot need to be co-localized in a common coordinate system.
Methods:
In order to track multiple arms in a common coordinate space, intrinsic and extrinsic tracking methods can be used. First, the intrinsic tracking of the daVinci, specifically of the setup joints is analyzed. Because of the inadequacy of the setup joints for co-localization a hybrid tracking method is designed and implemented to mitigate the inaccuracy of the setup joints. Different both optical and magnetic tracking methods are examined for setup joint localization.
Results:
The hybrid localization method improved the localization accuracy of the setup joints. The inter-arm accuracy in hybrid localization was improved to 3.02 mm. This inter-arm error value was shown to be further reduced when the arms are co-registered, thus reducing common error.