Related Experiment Video
Updated: Sep 24, 2026

fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals
Published on: May 23, 2017
Time-resolved hemodynamic responses to sentence-level speech perception, production, and self-monitoring
Teng Ieng Leong1,2, Aotong Li1,3, Jian Hwee Ang1,3
1Centre for Cognitive and Brain Sciences, University of Macau, Taipa, Macau SAR, China.
Abstract:
Functional magnetic resonance imaging (fMRI) has been widely used to explore the neural mechanisms underlying speech processing. However, the intertwining of perception and production that exists in real-world scenarios remains underexplored due to challenges such as gradient noise and head motion artifacts from speaking. Previous research has often employed sparse-sampling designs, pausing image acquisition intermittently to present auditory stimuli or record overt speech. While this approach mitigates some challenges, it cannot capture continuous brain activity during speech processing and does not separate the mixed hemodynamic responses to external and self-generated speech occurring in succession. We overcame these limitations and continuously scanned 31 participants as they listened to and recited English sentences. Through independent component analysis (ICA), we decomposed each functional scan into spatially independent components (ICs), identifying task-related ICs with activations predominantly located in the superior temporal cortex, inferior frontal gyrus, and orofacial sensorimotor cortex. These ICs demonstrated time-resolved hemodynamic responses corresponding to distinct stages of speech perception, planning, and production. A linear subtraction between the IC time courses from the listening-reciting (perception-to-production) and listening (perception-only) tasks further revealed a secondary hemodynamic response to self-generated speech in the superior temporal cortex. Furthermore, we established precise temporal relationships between overt speech output and the peak, rise, and fall of hemodynamic responses for each independent component. Together, we present a methodological framework that can inform future fMRI studies on naturalistic tasks involving the perception of external auditory stimuli and monitoring of self-generated sounds.

