Related Experiment Video
Updated: Jan 24, 2026

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data
Published on: December 9, 2015
Does Interrater Variation Influence the Classification According to the Diagnostic Criteria for Multiple Sclerosis?
Nima Mahmoudi1,2, Julius Renne2, Franz Felix Konen3
1Department of Neuroradiology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin, Germany.
Background:
Studies on interrater agreement in MRI analysis for patients experiencing a first clinical episode suggestive of multiple sclerosis (MS) are limited and outdated. This study aimed to evaluate interrater agreement for lesion identification in the brain, optic nerve, and spinal cord, and to assess variability in applying the 2017 and 2024 McDonald criteria.
Methods:
Seventy-eight patients underwent a standardized multisequence 3 Tesla MRI of the brain, optic nerves, and spinal cord, analyzed by three readers with varying expertise. Lesions were categorized based on location according to McDonald criteria. Interrater variability was measured using Cohen's κ for pairwise reader comparisons and Fleiss κ for overall agreement.
Results:
Interrater agreement ranged from slight to fair for total lesion count and moderate to substantial for lesion presence. The highest agreement occurred for spinal cord lesions (κ = 0.84), periventricular T2 lesions (κ = 0.70), and gadolinium-enhancing brain lesions (κ = 0.75). Classification agreement based on diagnostic criteria was substantial between the 2017 and 2024 McDonald criteria revisions (κ = 0.65).
Conclusions:
Despite advanced standardized imaging protocols at 3 T, interrater agreement regarding lesion counts does not improve substantially. However, agreement in classifying lesions according to diagnostic criteria is consistent between the 2017 and 2024 criteria.
Insights
Interrater agreement for multiple sclerosis (MS) lesion identification varies, with higher consistency in applying diagnostic criteria than in lesion counts. Standardized MRI protocols show moderate to substantial agreement for lesion presence.
Area of Science:
- Neurology
- Radiology
- Medical Imaging
Background:
- Limited and outdated studies exist on interrater agreement in MRI analysis for early multiple sclerosis (MS) diagnosis.
- This study addresses the need for current data on MRI lesion identification agreement.
Purpose of the Study:
- To evaluate interrater agreement for brain, optic nerve, and spinal cord lesion identification in early MS.
- To assess variability in applying the 2017 and 2024 McDonald criteria for MS diagnosis.
Main Methods:
- Seventy-eight patients with a first clinical episode suggestive of MS underwent standardized 3 Tesla MRI.
- Three readers with varied expertise analyzed lesions in the brain, optic nerves, and spinal cord.
- Interrater variability was quantified using Cohen's κ and Fleiss κ.
Main Results:
- Interrater agreement was slight to fair for total lesion counts but moderate to substantial for lesion presence.
- Highest agreement observed for spinal cord lesions (κ=0.84), periventricular T2 lesions (κ=0.70), and enhancing brain lesions (κ=0.75).
- Substantial agreement (κ=0.65) was found between the 2017 and 2024 McDonald criteria revisions.
Conclusions:
- Standardized 3T MRI protocols did not substantially improve interrater agreement for lesion counts in early MS.
- Agreement in classifying lesions based on diagnostic criteria remained consistent between the 2017 and 2024 McDonald criteria.
Related Concept Videos
Heart Failure IV: Classification and Diagnostic Evaluation
Criteria for Causality: Bradford Hill Criteria - II
Criteria for Causality: Bradford Hill Criteria - I
What is Variation?
The range, standard deviation, standard error, and variance are the different measures of variation.
Range: The range is the difference between its maximum and...
Variation
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
Multiple Allele Traits

