Deep Learning Detection of Hand Motion During Microvascular Anastomosis Simulations Performed by Expert...

Deep learning enables precise hand tracking without the need for physical sensors, allowing for unsupervised quantitative evaluation of surgical motion and tasks. We quantitatively assessed the hand motions of experienced cerebrovascular neurosurgeons during simulated microvascular anastomosis using deep learning. We explored the extent to which surgical motion data differed among experts.

A deep learning detection system tracked 21 landmarks corresponding to digit joints and the wrist on each hand of 5 expert cerebrovascular neurosurgeons. Tracking data for each surgeon were analyzed over long and short time intervals to examine gross movements and micromovements, respectively. Quantitative algorithms assessed the economy and flow of motion by calculating mean movement distances from the baseline median landmark coordinates and median times between sutures, respectively.

Tracking data correlated with specific surgical actions observed in microanastomosis video analysis. Economy of motion during suturing was calculated as 19, 26, 29, 27, and 28 pixels for surgeons 1, 2, 3, 4, and 5, respectively. Flow of motion during microanastomosis was 31.96, 29.40, 28.90, 7.37, and 47.21 seconds for surgeons 1, 2, 3, 4, and 5, respectively.

Hand tracking data showed similarities among experts, with low movements from baseline, minimal excess motion, and rhythmic suturing patterns. The data revealed unique patterns related to each expert's habits and techniques. The results showed that surgical motion can be correlated with hand motion and assessed using mathematical algorithms. We also demonstrated the feasibility and potential of deep learning-based motion detection to enhance surgical training.