Early cross-modal interactions underlie the audiovisual bounce-inducing effect

Area of Science:

• Neuroscience
• Perception Science
• Psychology

Background:

• The audiovisual bounce-inducing effect (ABE) describes how sound influences visual perception of colliding objects.
• The precise neural origins of the ABE remain debated, particularly the role of early cross-modal interactions.

Purpose of the Study:

• To investigate the role of early neural activities and cross-modal interactions in the audiovisual bounce-inducing effect (ABE).
• To determine if early electrophysiological responses predict the perceptual outcome of the ABE.

Main Methods:

• Utilized event-related potential (ERP) recordings during a visual stimulus task with and without auditory cues.
• Analyzed neural activity, specifically P2, PD170, and PD190 components, in relation to perceived visual outcomes (streaming vs. bouncing).

Main Results:

• Early visual processing (P2 component) predicted perception in unimodal visual displays but not in audiovisual conditions.
• Enhanced fronto-central (PD170) and occipital (PD190) positivity were observed during bouncing perceptions in the audiovisual condition, indicating cross-modal interaction.
• These specific neural responses occurred within early processing windows (125-200 ms post-stimulus).

Conclusions:

• Early cross-modal interactions significantly contribute to the audiovisual bounce-inducing effect (ABE).
• Electrophysiological evidence supports the involvement of early perceptual processing in shaping the ABE phenomenon.