Evaluation of the intra- and inter-method agreement of brain MRI segmentation software packages: A comparison between

L Palumbo1, P Bosco1, M E Fantacci2

  • 1National Institute for Nuclear Physics (INFN), Pisa Division, Pisa, Italy.

Abstract

Insights

Comparing brain MRI segmentation methods, FreeSurfer and SPM, revealed high repeatability but variable reproducibility. Inconsistent results emerged when comparing male and female brain volumes, highlighting the need for inter-method evaluation.

Area of Science:

  • Neuroimaging
  • Brain MRI Segmentation
  • Computational Neuroscience

Background:

  • Inconsistent results in neuroimaging studies can arise from a lack of agreement between different analysis methods.
  • Automatic segmentation of brain structures is crucial for quantitative MRI analysis.

Purpose of the Study:

  • To evaluate the intra-method repeatability and inter-method reproducibility of FreeSurfer (FS) and Statistical Parametric Mapping (SPM) for brain MRI segmentation.
  • To assess the impact of these segmentation methods on group-level statistical comparisons, specifically sex differences in brain volume.

Main Methods:

  • Segmentation of gray matter, white matter, and subcortical structures was performed using FS and SPM on test-retest MRI data from the Kirby-21 and OASIS datasets.
  • Intra-method repeatability and inter-method reproducibility were assessed using Pearson's correlation (r), Bland-Altman plots, and the Dice index.
  • Statistical comparisons of male versus female brain volumes were conducted to evaluate method-dependent effects.

Main Results:

  • Both FS and SPM demonstrated high intra-method repeatability (r = 0.95-0.99).
  • Inter-method reproducibility showed moderate to high correlation (r = 0.72-0.98) and overlap (Dice index = 0.76-0.83) between FS and SPM.
  • SPM systematically yielded larger gray matter volumes and smaller white matter/subcortical volumes compared to FS, leading to inconsistencies in sex difference findings between datasets.

Conclusions:

  • Inter-method reproducibility is a critical factor that must be assessed before interpreting neuroimaging study results.
  • Differences in segmentation algorithms can influence quantitative volumetric measures and subsequent statistical outcomes.
  • Careful consideration of software choice and validation is necessary for robust and reliable neuroimaging research.

Related Concept Videos

Brain Infarct Segmentation and Registration on MRI or CT for Lesion-symptom Mapping10:25

Brain Infarct Segmentation and Registration on MRI or CT for Lesion-symptom Mapping

Provided here is a practical tutorial for an open-access, standardized image processing pipeline for the purpose of lesion-symptom mapping. A step-by-step walkthrough is provided for each processing step, from manual infarct segmentation on CT/MRI to subsequent registration to standard space, along with practical recommendations and illustrations with exemplary...
49.3K
Whole-brain Segmentation and Change-point Analysis of Anatomical Brain MRI—Application in Premanifest Huntington's Disease09:06

Whole-brain Segmentation and Change-point Analysis of Anatomical Brain MRI—Application in Premanifest Huntington's Disease

This paper describes a statistical model for volumetric MRI data analysis, which identifies the "change-point" when brain atrophy begins in premanifest Huntington's disease. Whole-brain mapping of the change-points is achieved based on brain volumes obtained using an atlas-based segmentation pipeline of T1-weighted...
12.6K
Manual Segmentation of the Human Choroid Plexus Using Brain MRI04:25

Manual Segmentation of the Human Choroid Plexus Using Brain MRI

Despite the crucial role of the choroid plexus in the brain, neuroimaging studies of this structure are scarce due to the lack of reliable automated segmentation tools. The present protocol aims to ensure gold-standard manual segmentation of the choroid plexus that can inform future neuroimaging studies.
3.8K
A Multicenter MRI Protocol for the Evaluation and Quantification of Deep Vein Thrombosis10:26

A Multicenter MRI Protocol for the Evaluation and Quantification of Deep Vein Thrombosis

The goal of this study is to use magnetic resonance venography with long-circulating gadolinium-based contrast agent and direct thrombus imaging for quantitative evaluation of DVT volume in a multicenter, clinical trial setting. Inter- and intra-observer variability assessments were conducted, and reproducibility of the protocol was...
17.9K
Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images06:48

Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images

This protocol describes the process of applying seven different automated segmentation tools to structural T1-weighted MRI scans to delineate grey matter regions that can be used for the quantification of grey matter volume.
9.4K
Quantification of Optic Nerve Cross Sectional Area on MRI: A Novel Protocol using Fiji Software08:57

Quantification of Optic Nerve Cross Sectional Area on MRI: A Novel Protocol using Fiji Software

We provided a detailed protocol for a standardized method of optic nerve assessment and quantification using MRI, utilizing a widely available imaging sequence, and open access software for image analysis. Following this standardized protocol would provide meaningful data for comparison between different patients and different...
4.5K