Audiovisual bounce-inducing effect: when sound congruence affects grouping in vision

Area of Science:

• Psychology
• Cognitive Science
• Auditory Perception

Background:

• Visual perception of motion can be ambiguous, with stimuli like overlapping disks perceived as either streaming or bouncing.
• Auditory stimuli can influence visual perception, a phenomenon known as cross-modal interaction.
• Attention plays a critical role in integrating sensory information and resolving perceptual ambiguity.

Purpose of the Study:

• To investigate how auditory congruence and timing affect the perception of visual motion stimuli.
• To determine the influence of attention, modulated by sound onset, on cross-modal perception.
• To examine the specific impact of bounce-congruent versus incongruent sounds on visual bounce perception.

Main Methods:

• Participants observed visual displays of two disks moving and overlapping.
• Audiovisual conditions included silent displays, bounce-congruent sounds, and bounce-inconcongruent sounds.
• Sound onset was manipulated to occur either 200 milliseconds before disk overlap or at the moment of overlap.

Main Results:

• Audiovisual displays significantly increased bounce perceptions compared to silent displays.
• Bounce-congruent sounds elicited more bounce perceptions than bounce-incongruent sounds when presented before overlap.
• When sounds were presented at overlap, only the general audiovisual effect was observed, not the congruence effect.

Conclusions:

• Sound congruence and timing critically modulate cross-modal perception of motion.
• Attention, influenced by sound onset relative to visual events, is crucial for integrating congruent audiovisual information.
• These findings underscore the interplay between attention, sound congruence, and perceptual outcomes in audiovisual scenarios.