Emotional information affects fission illusion induced by audio-visual interactions

Area of Science:

• Cognitive Neuroscience
• Psychology
• Sensory Integration

Background:

• Multisensory integration combines information from different senses.
• Emotional signals are known to modulate multisensory integration, often by altering emotional states.
• The direct impact of emotional information on multisensory processes, independent of emotional state changes, remains underexplored.

Purpose of the Study:

• To investigate the direct effects of emotional signals on audio-visual integration.
• To examine how emotional valence in stimuli influences perceptual phenomena like audio-visual fission and fusion illusions.
• To differentiate the effects of emotional stimuli versus changes in emotional states on multisensory processing.

Main Methods:

• Comparison of audio-visual fission and fusion illusion magnitudes.
• Utilized facial expression stimuli and simple geometric shapes with varying emotional valence.
• Conducted experiments to assess changes in perceptual judgments and response criteria.

Main Results:

• Emotional facial expressions altered the response criterion for discerning simultaneous auditory stimuli but did not affect fission illusion magnitude.
• Simple geometric shapes with emotional valence perceptually induced a larger fission illusion.
• Emotional valence in simple shapes directly influenced the magnitude of the fission illusion.

Conclusions:

• Emotional valence in simple geometric shapes can enhance the fission illusion in audio-visual integration.
• Emotional faces appear to modulate the response criterion in discerning auditory events within a multisensory context.
• Further research is needed to fully understand the mechanisms underlying emotional valence effects on audio-visual integration.