Neuroanatomic correlates of the feature-salience hierarchy in face processing: an fMRI -adaptation study

Previous fMRI studies suggest that faces are represented holistically in human face processing regions. On the other hand, behavioral studies have also shown that some facial features are more salient than others for face recognition: the neural basis of this feature-salience hierarchy is not known. We used fMRI-adaptation together with a behavioral discrimination task and an ideal observer analysis to ask (1) whether different face parts contribute different amounts to the neural signal in face responsive regions, and (2) whether this response correlates more with the behavioral performance of human subjects or with the physical properties of the face stimuli. Twenty-three subjects performed a same/different discrimination experiment to characterize their ability to detect changes to different face parts. The same subjects underwent an fMRI-adaptation study, in which limited portions of the faces were repeated or changed between alternating stimuli. The behavioral study showed high efficiency in identity discrimination when the whole face, top half, or eyes changed, and low efficiency when the bottom half, nose, or mouth changed. During fMRI, there was a release of adaptation in the right and left fusiform face area (FFA) with changes to the whole face, top face-half, or the eyes. Changes to the bottom half, nose or mouth did not result in a significant release of adaptation in the right FFA, although bottom-half changes resulted in a release of adaptation in the left FFA. Adaptation in the right and left FFA and the right pSTS was correlated with human perceptual efficiency but not with ideal observer measures of the physical image differences between face parts. The feature-salience hierarchy of human face perception is therefore reflected in the activity in the right and left FFA and right pSTS, further supporting the key role of these structures in our perceptual experience of faces.