Evaluation of atlas-based segmentation of hippocampi in healthy humans

Region of interest (ROI)-based functional magnetic resonance imaging (fMRI) data analysis relies on extracting signals from a specific area which is presumed to be involved in the brain activity being studied. The hippocampus is of interest in many functional connectivity studies for example in epilepsy as it plays an important role in epileptogenesis. In this context, ROI may be defined using different techniques. Our study aims at evaluating the spatial correspondence of hippocampal ROIs obtained using three brain atlases with hippocampal ROI obtained using an automatic segmentation algorithm dedicated to the hippocampus.

High-resolution volumetric T1-weighted MR images of 18 healthy volunteers (five females) were acquired on a 3T scanner. Individual ROIs for both hippocampi of each subject were segmented from the MR images using an automatic hippocampus and amygdala segmentation software called SACHA providing the gold standard ROI for comparison with the atlas-derived results. For each subject, hippocampal ROIs were also obtained using three brain atlases: PickAtlas available as a commonly used software toolbox; automated anatomical labeling (AAL) atlas included as a subset of ROI into PickAtlas toolbox and a frequency-based brain atlas by Hammers et al. The levels of agreement between the SACHA results and those obtained using the atlases were assessed based on quantitative indices measuring volume differences and spatial overlap. The comparison was performed in standard Montreal Neurological Institute space, the registration being obtained with SPM5 (http://www.fil.ion.ucl.ac.uk/spm/).

The mean volumetric error across all subjects was 73% for hippocampal ROIs derived from AAL atlas; 20% in case of ROIs derived from the Hammers atlas and 107% for ROIs derived from PickAtlas. The mean false-positive and false-negative classification rates were 60% and 10% respectively for the AAL atlas; 16% and 32% for the Hammers atlas and 6% and 72% for the PickAtlas.

Though atlas-based ROI definition may be convenient, the resulting ROIs may be poor representations of the hippocampus in some studies critical to under- or oversampling. Performance of the AAL atlas was inferior to that of the Hammers atlas. Hippocampal ROIs derived from PickAtlas are highly significantly smaller, and this results in the worst performance out of three atlases. It is advisable that the defined ROIs should be verified with knowledge of neuroanatomy before using it for further data analysis.