Related Experiment Video
Updated: May 21, 2025
The Role of Indocyanine Green Fluorescence in Complex Laparoscopic Cholecystectomy Navigation
Published on: January 31, 2025
Automated surgical action recognition and competency assessment in laparoscopic cholecystectomy: a proof-of-concept
Hung-Hsuan Yen1,2, Yi-Hsiang Hsiao1,2, Meng-Han Yang3
1Department of Surgery, National Taiwan University Hospital Hsin-Chu Branch, No. 2, Sec. 1, Shengyi Rd., Zhubei City, Hsinchu County, 302058, Taiwan.
Background:
Laparoscopic cholecystectomy (LC) is a common procedure with standardized steps and validated assessment tools. However, the role of surgical actions in competency assessment remains underexplored, and automated models for surgical action recognition are lacking.
Methods:
The Cholec80 dataset of 80 LC videos was analyzed for the Calot's Triangle Dissection (CTD) phase. Strasberg's critical view of safety (CVS) score and second-by-second annotations of surgical actions were evaluated. Videos were categorized into high_simple, low_simple, and high_complex groups based on competency levels and cholecystitis grade. The dataset was randomly divided into training (66 videos) and testing (14 videos) sets based on subgrouping. Surgical metrics were compared between subgroups, and a Random Forest model was constructed to predict competency levels using these metrics. In addition, a Video-Masked Autoencoders (VideoMAE) model was developed for surgical action recognition.
Results:
The high_simple group had significantly shorter CTD duration, fewer action transitions, and lower percentages of suctioning/irrigating, coagulating, and idle actions, but higher CVS scores and dissecting percentages. The Random Forest model achieved 93% accuracy (AUC: 0.96) in competency prediction, with CVS score, CTD duration, and percentages of dissecting, coagulating, and exposing as the top five important features. The VideoMAE model attained 89.11% overall accuracy in recognizing surgical actions, with the highest recall (0.97) for dissecting and the lowest (0.51) for suctioning/irrigating.
Conclusions:
This study highlights the importance of surgical actions in competency assessment and presents automated models for evaluation and action recognition. These tools have potential to transform surgical education by providing objective and data-driven feedback for skill improvement.
