Visualization of surgical 3D information with projector-based augmented reality

Area of Science:

• Medical Engineering
• Surgical Technology
• Computer-Aided Surgery

Background:

• Augmented reality (AR) systems are increasingly utilized in surgery to enhance visualization.
• Projector-based AR has shown promise for overlaying surgical information onto patients.
• Current systems require further development for improved spatial awareness and precision.

Purpose of the Study:

• To enhance a projector-based augmented reality system for cranio-maxillofacial surgery.
• To incorporate 3D localization and orientation capabilities for improved surgical guidance.
• To evaluate the system's effectiveness in clinical settings.

Main Methods:

• Development of a prototype projector-based augmented reality system.
• Integration of a second video projector to provide 3D spatial information (6 Degrees of Freedom - 6DoF).
• Evaluation of the enhanced system in initial clinical cases for cranio-maxillofacial procedures.

Main Results:

• The enhanced system successfully provides 3D information for localization and orientation.
• The system facilitates intuitive and exact repositioning of bone segments during surgery.
• Initial clinical evaluations demonstrate the system's applicability and potential.

Conclusions:

• The advanced projector-based AR system significantly improves surgical navigation in cranio-maxillofacial surgery.
• The addition of 3D guidance enhances the precision and intuitiveness of bone segment repositioning.
• This technology holds promise for advancing surgical planning and execution.