Related Experiment Video
Updated: Oct 4, 2025

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
Published on: August 16, 2020
Short-term prediction of secondary progression in a sliding window: A test of a predicting algorithm in a validation
B Skoog1, J Link2, H Tedeholm1
1University of Gothenburg, the Sahlgrenska Academy, Institute of Neuroscience and Physiology, Section of Clinical Neuroscience and Rehabilitation, Sweden.
Introduction:
The Multiple Sclerosis Prediction Score (MSPS, www.msprediction.com) estimates, for any month during the course of relapsing-remitting multiple sclerosis (MS), the individual risk of transition to secondary progression (SP) during the following year.
Objective:
Internal verification of the MSPS algorithm in a derivation cohort, the Gothenburg Incidence Cohort (GIC, n = 144) and external verification in the Uppsala MS cohort (UMS, n = 145).
Methods:
Starting from their second relapse, patients were included and followed for 25 years. A matrix of MSPS values was created. From this matrix, a goodness-of-fit test and suitable diagnostic plots were derived to compare MSPS-calculated and observed outcomes (i.e. transition to SP).
Results:
The median time to SP was slightly longer in the UMS than in the GIC, 15 vs. 11.5 years (p = 0.19). The MSPS was calibrated with multiplicative factors: 0.599 for the UMS and 0.829 for the GIC; the calibrated MSPS provided a good fit between expected and observed outcomes (chi-square p = 0.61 for the UMS), which indicated the model was not rejected.
Conclusion:
The results suggest that the MSPS has clinically relevant generalizability in new cohorts, provided that the MSPS was calibrated to the actual overall SP incidence in the cohort.
Insights
The Multiple Sclerosis Prediction Score (MSPS) accurately predicts secondary progression risk in relapsing-remitting multiple sclerosis patients. Calibration enhances its generalizability across different cohorts.
Area of Science:
- Neurology
- Clinical Epidemiology
Background:
- The Multiple Sclerosis Prediction Score (MSPS) is a tool to estimate individual risk of secondary progression (SP) in relapsing-remitting multiple sclerosis (MS).
- Accurate prediction of SP is crucial for managing MS progression and treatment strategies.
Purpose of the Study:
- To internally verify the MSPS algorithm using the Gothenburg Incidence Cohort (GIC).
- To externally validate the MSPS algorithm in the independent Uppsala MS cohort (UMS).
Main Methods:
- Patients with relapsing-remitting MS were followed for up to 25 years from their second relapse.
- A goodness-of-fit test and diagnostic plots were used to compare predicted versus observed transitions to SP.
- The MSPS algorithm was calibrated using multiplicative factors specific to each cohort.
Main Results:
- The median time to SP was 11.5 years in the GIC and 15 years in the UMS.
- Calibrated MSPS showed a good fit between expected and observed outcomes in the UMS (chi-square p=0.61).
- Calibration factors were 0.829 for GIC and 0.599 for UMS.
Conclusions:
- The MSPS demonstrates clinically relevant generalizability to new multiple sclerosis cohorts.
- Calibration of the MSPS to the specific SP incidence of a cohort is essential for its reliable application.
Related Concept Videos
Cancer Survival Analysis
Actuarial Approach
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
Survival Tree
Building a Survival Tree
Constructing a...
Tumor Progression
Colon cancer is one of the best-documented examples of tumor progression. Early mutation in the APC gene in colon cells causes a small growth on the colon wall called a polyp. With time, this polyp grows into a benign, pre-cancerous tumor. Further...
Kaplan-Meier Approach
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

