Tone-affect compatibility with affective stimuli and affective responses.

Area of Science:

• Cognitive Psychology
• Neuroscience
• Human-Computer Interaction

Background:

• Multimodal integration is crucial for human cognition.
• The relationship between auditory stimuli and facial expressions is not fully understood.
• Embodied cognition theories propose perception and action are intertwined.

Purpose of the Study:

• To investigate the multimodal integration of auditory pitch and facial expressions.
• To determine if tone pitch influences facial expression imitation.
• To explore the connection between pitch height and emotional responses.

Main Methods:

• Three experiments used a compatibility paradigm.
• Participants imitated facial expressions (happy/angry) in response to auditory tones (high/low).
• Stimulus-response compatibility and integration effects were analyzed.

Main Results:

• High tones facilitated the imitation of happy expressions (smiles).
• Low tones facilitated the imitation of angry expressions (frowns).
• Integration was observed between tone and facial stimulus, and tone and facial response.

Conclusions:

• Pitch height is associated with specific emotions.
• Findings support embodied cognition by showing perception-action interweavement.
• Auditory pitch and facial expressions are integrated in cognitive processing.