Related Experiment Video
Updated: Jan 19, 2026
Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
Published on: August 16, 2020
External validation of the SORG 90-day and 1-year machine learning algorithms for survival in spinal metastatic
Aditya V Karhade1, Ali K Ahmed2, Zach Pennington2
1Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Background Context:
Preoperative survival estimation in spinal metastatic disease helps determine the appropriateness of invasive management. The SORG ML 90-day and 1-year machine learning algorithms for survival in spinal metastatic disease were previously developed in a single institutional sample but remain to be externally validated.
Purpose:
The purpose of this study was to externally validate these algorithms in an independent population from another institution.
Study Design/Setting:
Retrospective study at a large, tertiary care center.
Patient Sample:
Patients 18 years or older who underwent surgery between 2003 and 2016.
Outcome Measures:
Ninety-day and 1-year mortality.
Methods:
Baseline characteristics of the validation cohort were compared to the developmental cohort for the SORG ML algorithms. Discrimination (c-statistic and receiver operating curve), calibration (calibration slope, intercept, calibration plot, and observed proportions by predicted risk groups), overall performance (Brier score), and decision curve analysis were used to assess the performance of the SORG ML algorithms in the validation cohort.
Results:
Overall, 176 patients underwent surgery for spinal metastatic disease, of which 44 (22.7%) experienced 90-day mortality and 99 (56.2%) experienced 1-year mortality. The validation cohort differed significantly from the developmental cohort on primary tumor histology, metastatic tumor burden, previous systemic therapy, overall comorbidity burden, and preoperative laboratory characteristics. Despite these differences, the SORG ML algorithms generalized well to the validation cohort on discrimination (c-statistic 0.75-0.81 for 90-day mortality and 0.77-0.78 for 1-year mortality), calibration, Brier score, and decision curve analysis.
Conclusion And Relevance:
Initial results from external validation of the SORG ML 90-day and 1-year algorithms for survival prediction in spinal metastatic disease suggest potential utility of these digital decision aids in clinical practice. Further studies are needed to validate or refute these algorithms in large patient samples from prospective, international, multi-institutional trials.
More Related Videos
Related Concept Videos
07:15Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
06:19Constructing and Visualizing Models using Mime-based Machine-learning Framework
09:53Quantifying the Brain Metastatic Tumor Micro-Environment using an Organ-On-A Chip 3D Model, Machine Learning, and Confocal Tomography
12:18A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
09:11Y-90 Radioembolization and PD-1 Inhibitor as Neoadjuvant Treatment in Hepatocellular Carcinoma
06:22Machine Learning-Based Cough Tone Classification: Diagnostic Exploration of Chronic Obstructive Pulmonary Disease and Respiratory Tract Infections