Related Experiment Video
Updated: May 28, 2026
Automatic Surgery in Transcatheter Aortic Valve Replacement Using Augmented Reality
Published on: August 9, 2024
Online recognition of surgical instruments by information fusion
Thomas Neumuth1, Christian Meissner
1Universität Leipzig, Innovation Center Computer Assisted Surgery (ICCAS), Semmelweisstr. 14, 04103, Leipzig, Germany. thomas.neumuth@medizin.uni-leipzig.de
Purpose:
Automatic online recognition of surgical instruments is required to monitor instrument use for surgical process modeling. A system was developed and tested using available technologies.
Methods:
A recognition system was developed using RFID technology to identify surgical activities. Information fusion for online recognition of surgical process models was conceived as a layer model to abstract information from specific sensor technologies. Redundant, complementary, and cooperative sensor signal fusion was used in the layer model to increase the surgical instrument recognition rate. Several different information fusion strategies were evaluated for situation recognition abilities in a mock-up environment based on simulations of surgical processes.
Results:
This information fusion system was able to reliably detect, identify, and localize surgical instruments in an interventional suite. A combination of information fusion strategies was able to achieve a correct classification rate of 97% and was as effective as observer-based acquisition methods.
Conclusion:
Different information fusion strategies for the recognition of surgical instruments were evaluated, showing that redundant, complementary, and cooperative information fusion is feasible for recognition of surgical work steps. A combination of sensor- and observer-based modeling strategies provides the most robust solution for surgical process models.
