Related Experiment Video
Updated: Jun 13, 2026
05:48
Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
Published on: August 9, 2024
Cross-modal interactions between human faces and voices involved in person recognition
Frédéric Joassin1, Mauro Pesenti, Pierre Maurage
1Unité de Neurosciences Cognitives (NESC), Université catholique de Louvain, Louvain-la-Neuve, Belgium. frederic.joassin@uclouvain.be
Summary
The brain integrates faces and voices using a network involving visual, auditory, and memory areas. This research reveals how the brain binds these sensory inputs for recognition.
Area of Science:
- Neuroscience
- Cognitive Science
- Psychology
Background:
- Human recognition relies heavily on faces and voices.
- The neural mechanisms underlying the integration of faces and voices are not fully understood.
Purpose of the Study:
- To investigate the brain activity associated with recognizing faces, voices, and their associations.
- To identify specific brain regions and networks involved in binding auditory and visual social cues.
Main Methods:
- Functional magnetic resonance imaging (fMRI) was used to measure brain activity.
- Participants recognized static faces, voices, and learned voice-face associations.
- Subtraction analysis and functional connectivity analysis were employed.
Main Results:
- Voice-face associations activated unimodal visual and auditory cortices.
- Specific multimodal regions, including the left angular gyrus and right hippocampus, were involved.
- The right hippocampus showed connectivity with unimodal areas during association tasks.
Conclusions:
- Binding faces and voices involves a distributed cerebral network.
- This network supports integration of sensory processing, attention, and memory.
- The findings provide insights into the neural basis of multimodal human recognition.
Related Concept Videos
01:24Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...
01:24Prosopagnosia
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
01:13Nonconscious Mimicry
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
01:29Dark Triad and Person Perception
Person perception is influenced by both external behaviors and the observer’s internal characteristics, including personality traits. Individuals with dark personality traits, comprising psychopathy, Machiavellianism, and narcissism — collectively known as the dark triad – exhibit manipulative and exploitative tendencies in social contexts. These traits affect how they perceive others and how they are perceived.The Role of Dark Personality Traits in Person PerceptionBlack et al. (2014) explored...
01:21Association Areas of the Cortex
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
01:29Non-Verbal Cues
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...