Integrating Artificial Intelligence into Mixed Reality for Back Detection and Virtual 3D Spine Visualization on...

Area of Science:

• Orthopedics
• Medical Imaging
• Computer Science

Background:

• Adolescent Idiopathic Scoliosis (AIS) is a complex 3D spinal deformity impacting quality of life.
• AIS requires continuous monitoring due to its progressive nature.
• Current monitoring methods may lack advanced visualization capabilities.

Purpose of the Study:

• To develop an AI-enhanced Mixed Reality application for spine visualization in AIS.
• To accurately overlay a 3D virtual spine model onto a patient's anatomy using HoloLens 2.
• To detect the patient's back and Central Sacral Vertical Line (CSVL) for precise anatomical alignment.

Main Methods:

• Development of a standalone Mixed Reality application utilizing the HoloLens 2.
• Implementation of Artificial Intelligence algorithms for back and CSVL detection.
• Integration of 3D spine models for overlay onto patient anatomy.

Main Results:

• A proof-of-concept Mixed Reality application was successfully developed.
• The system demonstrated the capability to detect the patient's back and CSVL.
• Virtual 3D spine models could be overlaid onto the patient's anatomy.

Conclusions:

• The developed Mixed Reality system shows promise for Adolescent Idiopathic Scoliosis monitoring.
• Further hardware enhancements are needed for robust clinical application.
• This innovative approach could improve the visualization and management of spinal deformities.