Related Experiment Video
Updated: May 24, 2026
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
Utility of augmented reality system in hepatobiliary surgery
Tomoyoshi Okamoto1, Shinji Onda, Michinori Matsumoto
1Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan. tomoka@jikei.ac.jp
Background/Purpose:
The aim of this study was to evaluate the utility of an image display system for augmented reality in hepatobiliary surgery under laparotomy.
Methods:
An overlay display of organs, vessels, or tumor was obtained using a video see-through system as a display system developed at our institute. Registration between visceral organs and the surface-rendering image reconstructed by preoperative computed tomography (CT) was carried out with an optical location sensor. Using this system, we performed laparotomy for a patient with benign biliary stricture, a patient with gallbladder carcinoma, and a patient with hepatocellular carcinoma.
Results:
The operative procedures performed consisted of choledochojejunostomy, right hepatectomy, and microwave coagulation therapy. All the operations were carried out safely using images of the site of tumor, preserved organs, and resection aspect overlaid onto the operation field images observed on the monitors. The position of each organ in the overlaid image closely corresponded with that of the actual organ. Intraoperative information generated from this system provided us with useful navigation. However, several problems such as registration error and lack of depth knowledge were noted.
Conclusion:
The image display system appeared to be useful in performing hepatobiliary surgery under laparotomy. Further improvement of the system with individualized function for each operation will be essential, with feedback from clinical trials in the future.
