Related Experiment Video
Updated: Jan 19, 2026

Brain Infarct Segmentation and Registration on MRI or CT for Lesion-symptom Mapping
Published on: September 25, 2019
Evaluation of the intra- and inter-method agreement of brain MRI segmentation software packages: A comparison between
L Palumbo1, P Bosco1, M E Fantacci2
1National Institute for Nuclear Physics (INFN), Pisa Division, Pisa, Italy.
Purpose:
The lack of inter-method agreement can produce inconsistent results in neuroimaging studies. We evaluated the intra-method repeatability and the inter-method reproducibility of two widely-used automatic segmentation methods for brain MRI: the FreeSurfer (FS) and the Statistical Parametric Mapping (SPM) software packages.
Methods:
We segmented the gray matter (GM), the white matter (WM) and subcortical structures in test-retest MRI data of healthy volunteers from Kirby-21 and OASIS datasets. We used Pearson's correlation (r), Bland-Altman plot and Dice index to study intra-method repeatability and inter-method reproducibility. In order to test whether different processing methods affect the results of a neuroimaging-based group study, we carried out a statistical comparison between male and female volume measures.
Results:
A high correlation was found between test-retest volume measures for both SPM (r in the 0.98-0.99 range) and FS (r in the 0.95-0.99 range). A non-null bias between test-retest FS volumes was detected for GM and WM in the OASIS dataset. The inter-method reproducibility analysis measured volume correlation values in the 0.72-0.98 range and the overlap between the segmented structures assessed by the Dice index was in the 0.76-0.83 range. SPM systematically provided significantly greater GM volumes and lower WM and subcortical volumes with respect to FS. In the male vs. female brain volume comparisons, inconsistencies arose for the OASIS dataset, where the gender-related differences appear subtler with respect to the Kirby dataset.
Conclusions:
The inter-method reproducibility should be evaluated before interpreting the results of neuroimaging studies.
Insights
Comparing brain MRI segmentation methods, FreeSurfer and SPM, revealed high repeatability but variable reproducibility. Inconsistent results emerged when comparing male and female brain volumes, highlighting the need for inter-method evaluation.
Area of Science:
- Neuroimaging
- Brain MRI Segmentation
- Computational Neuroscience
Background:
- Inconsistent results in neuroimaging studies can arise from a lack of agreement between different analysis methods.
- Automatic segmentation of brain structures is crucial for quantitative MRI analysis.
Purpose of the Study:
- To evaluate the intra-method repeatability and inter-method reproducibility of FreeSurfer (FS) and Statistical Parametric Mapping (SPM) for brain MRI segmentation.
- To assess the impact of these segmentation methods on group-level statistical comparisons, specifically sex differences in brain volume.
Main Methods:
- Segmentation of gray matter, white matter, and subcortical structures was performed using FS and SPM on test-retest MRI data from the Kirby-21 and OASIS datasets.
- Intra-method repeatability and inter-method reproducibility were assessed using Pearson's correlation (r), Bland-Altman plots, and the Dice index.
- Statistical comparisons of male versus female brain volumes were conducted to evaluate method-dependent effects.
Main Results:
- Both FS and SPM demonstrated high intra-method repeatability (r = 0.95-0.99).
- Inter-method reproducibility showed moderate to high correlation (r = 0.72-0.98) and overlap (Dice index = 0.76-0.83) between FS and SPM.
- SPM systematically yielded larger gray matter volumes and smaller white matter/subcortical volumes compared to FS, leading to inconsistencies in sex difference findings between datasets.
Conclusions:
- Inter-method reproducibility is a critical factor that must be assessed before interpreting neuroimaging study results.
- Differences in segmentation algorithms can influence quantitative volumetric measures and subsequent statistical outcomes.
- Careful consideration of software choice and validation is necessary for robust and reliable neuroimaging research.
More Related Videos
Related Concept Videos
10:25Brain Infarct Segmentation and Registration on MRI or CT for Lesion-symptom Mapping
09:06Whole-brain Segmentation and Change-point Analysis of Anatomical Brain MRI—Application in Premanifest Huntington's Disease
04:25Manual Segmentation of the Human Choroid Plexus Using Brain MRI
10:26A Multicenter MRI Protocol for the Evaluation and Quantification of Deep Vein Thrombosis
06:48Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images
08:57Quantification of Optic Nerve Cross Sectional Area on MRI: A Novel Protocol using Fiji Software

