Development of Augmented Reality Vision for Osteosynthesis Using a 3D Camera.

Area of Science:

• Medical Imaging
• Surgical Technology
• Computer-Aided Surgery

Background:

• Developed a 3D camera system for non-invasive surgical motion tracking.
• Potential to integrate augmented reality (AR) without conventional invasive markers.
• Aimed to verify real-time tracking accuracy and surgical workflow integration.

Purpose of the Study:

• Evaluate the real-time tracking accuracy of a novel 3D camera system.
• Assess the system's feasibility for integration into surgical workflows.
• Determine the potential to improve accuracy and efficiency in orthopedic procedures.

Main Methods:

• Created a 3D forearm bone model for accuracy verification against CT data.
• Employed a stereo vision-based 3D camera, modified for improved performance (RGB filter, marker size, frame stabilization).
• Assessed tracking accuracy via rotation matrix differences, inter-reference point errors, and average reference point errors.

Main Results:

• Modified system showed improved tracking accuracy: average rotation matrix difference of 4.22±1.73 mm.
• Reduced average minimum and maximum errors to 0.79±0.49 mm and 1.94±0.87 mm, respectively.
• Significant improvements in maximum and average errors (P<0.05) compared to the original system.

Conclusions:

• Developed an AR-compatible 3D camera system for surgical applications.
• Enables direct comparison of preoperative CT scans with intraoperative 3D data.
• Offers non-invasive AR integration, eliminating the need for traditional invasive markers.