Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Deep left hilar pedicle isolation technique with in situ umbilical portion dissection for recipient hepatectomy in adult living donor liver transplantation.

Surgery·2026
Same author

Reappraisal of Real-World Management of Acute Cholecystitis in Elderly Patients Based on the Adherence to Tokyo Guidelines 2018 (TG18): A Multicenter Study on Anzu HPB Surgical Meeting.

Annals of gastroenterological surgery·2026
Same authorSame journal

Histological Analysis of Cryopreserved Venous Allografts Used for Liver Transplantation and Hepato-Biliary-Pancreatic Surgery.

Journal of hepato-biliary-pancreatic sciences·2026
Same author

Clinical artificial intelligence (AI) in Japan: Regulatory pathways, domain-specific evidence, and its data infrastructure from an international perspective.

Global health & medicine·2026
Same author

ASO Visual Abstract: Longitudinal Symptom Recovery After Pancreatectomy-A Prospective Patient-Reported Outcomes Study using MDASI.

Annals of surgical oncology·2026
Same author

Mesenchymal hamartoma of the liver in a young adult female: a diagnostic challenge mimicking hepatic adenoma.

Journal of surgical case reports·2026

Related Experiment Video

Updated: Jan 7, 2026

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

1.1K

Automatic and Real-Time Surgeon's Gazing Point Detection From Surgical Videos Using Machine Learning and Mathematical

Shu Sasaki1, Kenji Karako1, Kyoji Ito1

  • 1Hepato-Biliary-Pancreatic Surgery Division, Department of Surgery, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.

Journal of Hepato-Biliary-Pancreatic Sciences
|December 19, 2025
PubMed
Summary

This study developed an AI system to automatically detect a surgeon's gaze point from surgical videos. The system shows promise for enhancing AI-assisted surgical procedures.

Keywords:
artificial intelligencedeep learningpancreaticoduodenectomyvideo recording

More Related Videos

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
04:48

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

3.3K
Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
05:12

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Published on: August 12, 2021

2.4K

Related Experiment Videos

Last Updated: Jan 7, 2026

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

1.1K
Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
04:48

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

3.3K
Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
05:12

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Published on: August 12, 2021

2.4K

Area of Science:

  • Medical Artificial Intelligence
  • Surgical Technology
  • Computer Vision in Surgery

Background:

  • Artificial intelligence (AI) is increasingly used in intraoperative imaging.
  • The surgeon's gaze point is crucial for identifying surgical sites and providing data for AI.
  • Current AI applications require precise identification of the surgeon's focus.

Purpose of the Study:

  • To develop a machine learning system for automatic detection of the surgeon's gaze point using surgical video data.
  • To validate the system's performance across different surgical procedures.
  • To assess the potential utility of gaze point detection in AI-assisted surgery.

Main Methods:

  • Surgical instruments were detected using a deep-learning model on video frames.
  • Gaze points were calculated via a mathematical algorithm based on instrument axes and intersections.
  • Time-averaging was employed for real-time analysis stability and validated on pancreaticoduodenectomy, extended cholecystectomy, and distal pancreatectomy cases.

Main Results:

  • Surgical instrument detection achieved an AP50 of 60.5%.
  • Gaze point detection accuracy reached 82.7% and 93.9% within specified pixel radii for pancreaticoduodenectomy.
  • The system demonstrated comparable performance (85.5% accuracy within a 324-pixel radius) in other procedures, with time-averaging improving results.

Conclusions:

  • The developed system successfully detected surgeon gaze points across multiple surgical procedures.
  • This technology holds potential for integration into future AI-assisted surgical systems.
  • Accurate gaze point detection is a key step towards more sophisticated AI surgical tools.