A supramodal neural network for speech and gesture semantics: an fMRI study

Area of Science:

• Neuroscience
• Cognitive Science
• Psycholinguistics

Background:

• Natural communication integrates speech and gestures.
• Iconic gestures convey semantic information, similar to speech.
• The neural basis for processing semantic information across auditory and visual modalities is unclear.

Purpose of the Study:

• To identify cortical areas involved in supramodal semantic information processing.
• To investigate if auditory and visual semantic comprehension rely on shared or distinct brain networks.
• To explore the neural underpinnings of multimodal semantic integration.

Main Methods:

• Functional magnetic resonance imaging (fMRI) was used.
• 18 healthy right-handed males watched video clips of meaningful speech and gestures.
• Control conditions included meaningless gestures and foreign language speech.

Main Results:

• Semantic processing of both speech and gestures activated a common frontotemporal network.
• Activations spanned the left inferior frontal gyrus, precentral gyrus, and bilateral posterior temporal regions.
• This network demonstrated supramodal processing of semantic information.

Conclusions:

• The identified frontotemporal network supports supramodal semantic processing.
• This challenges the notion of a narrowly defined core language system.
• Semantic comprehension relies on integrated processing across sensory modalities.