Integrating Artificial Intelligence into Mixed Reality for Back Detection and Virtual 3D Spine Visualization on...

Adolescent Idiopathic Scoliosis is a complex three-dimensional spinal deformity that typically develops between the ages of 10 and 18 years. If untreated, this condition can significantly impair a patient's quality of life and functional capabilities. Continuous monitoring is crucial due to the potential progressive nature of spinal curvature. This study introduces an innovative Mixed Reality approach to spine visualization using the HoloLens 2 head-mounted display. The primary objective was to develop an Artificial Intelligence-enhanced application capable of detecting a patient's back and identifying the Central Sacral Vertical Line to accurately overlay a virtual three-dimensional spine model onto the patient's actual anatomy. A standalone Mixed Reality application was developed to detect patients' backs and Central Sacral Vertical Line. While the prototype demonstrates proof-of-concept capabilities, the current implementation reveals limitations necessitating further hardware improvements for practical clinical application.