Related Experiment Video
Updated: Aug 7, 2025

07:46
Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
800
3D Autonomous Surgeon's Hand Movement Assessment Using a Cascaded Fuzzy Supervisor in Multi-Thread Video Processing.
Fatemeh Rashidi Fathabadi1, Janos L Grantner1, Saad A Shebrain2
1Electrical & Computer Engineering Department, Western Michigan University, Kalamazoo, MI 49008, USA.
Sensors (Basel, Switzerland)
|March 11, 2023
Summary
This study introduces an autonomous system for assessing laparoscopic surgery skills using an intelligent box-trainer. The system accurately evaluates surgeon hand movements, reducing the need for human supervision in surgical training.
Area of Science:
- Surgical Education
- Medical Simulation
- Robotics and Automation
Background:
- Laparoscopic surgery training requires objective skill assessment.
- Current methods rely on expert supervision, which is costly and time-consuming.
- Simulation-based training offers a safe environment for skill development.
Purpose of the Study:
- To develop an autonomous system for evaluating laparoscopic surgical skills.
- To monitor surgeon hand movements during simulated surgical tasks.
- To eliminate the need for human intervention in skill assessment.
Main Methods:
- Utilized an intelligent box-trainer system (IBTS) with two cameras.
- Implemented multi-thread video processing for 3D hand movement analysis.
- Employed a cascaded fuzzy logic assessment system to evaluate instrument handling.
Main Results:
- The autonomous system accurately assessed surgeon hand movements.
- Results were delivered autonomously within approximately 10 seconds post-exercise.
- The system demonstrated potential for objective and efficient skill evaluation.
Conclusions:
- The intelligent box-trainer system provides an autonomous solution for laparoscopic skill assessment.
- This technology can enhance surgical training by offering objective, real-time feedback.
- Future work will focus on enhancing computational power for real-time performance assessment.
Keywords:
fuzzy logic-based decision support systemintelligent box-trainer systemlaparoscopic surgical skill assessmentmulti-class object detection
