Cultural background and input familiarity influence multisensory emotion perception

Area of Science:

• Cognitive psychology
• Cross-cultural psychology
• Neuroscience of emotion

Background:

• Multisensory emotion perception is influenced by cultural background.
• Modality dominance (visual vs. auditory attention) varies across cultures.
• Cultural familiarity may impact how individuals process emotional cues.

Purpose of the Study:

• To investigate how cultural familiarity affects multisensory emotion perception in Eastern and Western cultures.
• To explore the underlying mechanisms of cultural differences in modality dominance.
• To examine the interaction between cultural background and input familiarity.

Main Methods:

• Presented audiovisual emotional stimuli from familiar and unfamiliar cultural contexts to native Mandarin (Chinese) and English (American) speakers.
• Participants evaluated emotions from visual or auditory modalities.
• Used congruent (matching emotions) and incongruent (mismatching emotions) stimuli across modalities.

Main Results:

• In familiar contexts, Americans showed visual dominance, while Chinese showed auditory dominance.
• Both groups integrated incongruent emotional input; only Americans integrated congruent input from the irrelevant modality.
• In unfamiliar contexts, both groups increased visual dominance, but only Chinese participants showed decreased auditory dominance.

Conclusions:

• Cultural background and input familiarity interact to determine modality dominance in multisensory emotion perception.
• These findings highlight the role of cultural learning in shaping sensory processing for emotions.
• Understanding these cultural variations is crucial for effective cross-cultural communication and interaction.