Related Experiment Video
Updated: Jun 16, 2025
Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
Artificial intelligence facilitates the potential of simulator training: An innovative laparoscopic surgical skill
Atsuhisa Fukuta1, Shogo Yamashita2, Junnosuke Maniwa3
1Department of Pediatric Surgery, Reproductive and Developmental Medicine, Faculty of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka, 812-8582, Japan. fukuta.atsuhisa.120@m.kyushu-u.ac.jp.
An artificial intelligence (AI) system was developed to objectively assess forceps manipulation skills in surgical training simulators. The AI system achieved good tracking stability, offering a valuable tool for evaluating laparoscopic surgical techniques.
Area of Science:
- Surgical Education
- Artificial Intelligence in Medicine
- Medical Simulation
Background:
- Innovative training methods like simulators and AI tutoring are transforming surgical skill acquisition.
- Objective assessment is crucial for effective intraoperative instruction and skill development.
Purpose of the Study:
- To develop a novel objective assessment system utilizing artificial intelligence (AI) for evaluating forceps manipulation within a surgical training simulator.
- To create an AI-driven tool for objective feedback on laparoscopic surgical skills.
Main Methods:
- Laparoscopic exercises were recorded using an iPad®, capturing top and side views.
- An AI-based posture estimation method, DeepLabCut (DLC), was employed for forceps recognition and positional measurement.
- Tracking accuracy was quantified by pixel differences, and stability was assessed at key points.
Main Results:
- The AI system demonstrated an average pixel discrepancy of 9.2 in tracking accuracy.
- Qualitative evaluation showed good tracking stability at the forceps hinge.
- Forceps tip tracking exhibited instability during rotational movements.
Conclusions:
- The AI-based forceps tracking system effectively visualizes and evaluates laparoscopic surgical skills.
- Further system improvements and AI self-learning can enhance the accurate differentiation between expert and novice surgeons.
- This system serves as a valuable tool for surgical training and performance assessment.
