Development of a novel machine learning model to automate vertebral column segmentation utilizing biplanar full-body
Yash Lahoti1, Skanda Sai2, Wasil Ahmed1
1Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Pl, New York, NY 10019, USA.
Background Context:
Degenerative scoliosis (DS) is a common spinal disorder among adults, characterized by lateral curvature of the spine. Recent advancements in biplanar full-body imaging, a low-dose and weight-bearing X-ray modality, facilitate safer and longitudinal imaging of DS patients. Quantifying spinal curvature serves as a valuable metric for assessing DS severity and informing surgical planning. However, manual annotation of vertebral structures in radiographic images is labor-intensive, necessitating specialized expertise and resulting in significant inter- and intraobserver variability. Advances in deep learning computer models, particularly with convolutional neural networks (CNNs) employing UNET architecture, offer robust solutions for image segmentation tasks. These deep learning approaches have the potential to standardize and expedite the analysis of spinal alignment alterations throughout disease progression.
Purpose:
The purpose of this study is to develop an artificial intelligence algorithm capable of automating the segmentation of the vertebral column from biplanar full-body radiographic images regardless of spinal pathologies and previous hardware.
Study Design/Setting:
This was a retrospective study designed to create and evaluate a proposed AI algorithm for spinal imaging. It was conducted in 2023 at a tertiary medical center and utilized weight-bearing, full-length biplanar full-body X-ray images in AP and Lateral orientations. The images were retrieved from the institutional picture archiving and communication system (PACS), anonymized, and exported as high resolution files.
Patient Sample:
This study consisted of 250 images of patients who were either positive or negative for AIS.
Outcome Measures:
The primary outcome of this study was to identify the accuracy of the segmentation model using the Dice-Sørensen coefficient for anterior-posterior and lateral views.
Methods:
Biplanar full-body X-ray images were retrieved from the institutional picture archiving and communication system (PACS), anonymized, and exported as high-resolution files. Image dataset was crafted to include DS positive and negative samples. For each orientation, 200 images were used to train the model, and 50 radiographs were withheld for model performance evaluation. A 2-stage deep learning model was developed to first identify the spine region from a full-body X-ray image, and then isolate the spine curvature from the output of the first stage of the model.
Results:
The model was successful in segmenting the vertebral column, with Dice-Sørensen coefficient of 0.92 and 0.96 for anterior-posterior and lateral views respectively. The model was capable of accurately segmenting images involving complex spinal pathologies, such as lordosis and scoliosis, and noise from spinal instrumentation, such as rods and screws.
Conclusions:
Our findings indicate that a 2-stage deep learning model with UNET architecture can accurately identify and segment spinal curvature in 2D biplanar full-body radiographs, offering a robust tool for DS assessment.
Related Concept Videos
Body Planes
The sagittal plane is the plane that divides the body or an organ vertically into right and left sides. If this vertical plane runs directly down the middle of the body resulting in equal division, it is called the midsagittal or median...
Vertebral Column: Regions and Curvature
Regions of the Vertebral Column
In an adult, the spine is subdivided into five regions: the cervical, the thoracic, the lumbar, the sacral, and the coccygeal region. The spine initially develops as a series of 33 vertebrae; after 20 years of age, the nine bones in the sacral region, five sacral, and four coccygeal bones fuse to form...
Muscles of the Vertebral Column
Superficial Layer:
The superficial layer consists primarily of the splenius muscles, which include the splenius capitis and splenius cervicis. These muscles are mainly responsible for the head and cervical spine movements, including extension, rotation, and lateral bending. The splenius capitis...


