Related Experiment Video
Updated: Jun 20, 2026
11:53
The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
Published on: October 14, 2017
Autonomous Robot-Assisted Video Capture in Open Cardiac Surgery: Surgical Field Detection and Obstacle-Aware
Juntao Gao1, Yueri Cai1, Hongjia Zhang2
1Robotics Institute, Beihang University, Beijing, China.
Summary
This study introduces an intelligent robot system for automatic surgical video capture, improving efficiency and reducing interference. The system precisely records surgical procedures, enabling intelligent and automated video documentation.
Area of Science:
- Robotics and Computer Vision in Medicine
- Surgical Technology Innovation
Background:
- Traditional surgical video recording is inefficient and disruptive due to manual camera adjustments.
- Lack of automation in surgical video capture hinders workflow and requires specialized personnel.
Purpose of the Study:
- To develop an automated surgical video capture scheme using an intelligent robot system.
- To enhance the efficiency and precision of surgical video recording.
Main Methods:
- Utilized YOLO v5 algorithm and a 3D camera for surgical field identification and localization.
- Developed the Convex Hull Edge Line Search (CHELS) algorithm for optimal, obstacle-free camera positioning.
- Applied Position-Based Visual Servoing (PBVS) for precise camera control during capture.
Main Results:
- Achieved a mean Average Precision (mAP@0.5) of 0.962 for surgical field detection.
- The CHELS algorithm demonstrated an average solution time of 0.1469 seconds.
- Successfully enabled precise and automatic capture of the surgical field.
Conclusions:
- The proposed automatic surgical video capture scheme significantly improves recording efficiency.
- Intelligent and automated recording of surgical videos is feasible with this robotic system.
- This technology offers a promising solution for modern surgical documentation.
