Hearing flashes and seeing beeps: Timing audiovisual events

Area of Science:

• Neuroscience
• Psychology
• Sensory Perception

Background:

• Daily life events are often audiovisual, involving simultaneous visual and auditory signals.
• These signals travel at different speeds, reaching the brain at different times, necessitating temporal association for synchrony perception.

Purpose of the Study:

• To quantify the mutual temporal attraction between auditory and visual senses.
• To characterize different audiovisual interaction modes based on temporal offset.

Main Methods:

• Participants judged the timing of a fifth event (auditory or visual) after a sequence of four beep-flash pairs.
• A wide range of audiovisual offsets was tested, with participants attending to only one sensory modality.

Main Results:

• Visual stimuli (flashes) were perceptually attracted towards auditory stimuli (beeps), especially when beeps lagged.
• Auditory stimuli (beeps) showed minimal attraction towards visual stimuli, indicating auditory capture.
• Subjective visual timing shifted forward but not backward, consistent with processing delays.

Conclusions:

• Auditory stimuli exert a dominant influence on audiovisual temporal perception, a phenomenon termed auditory capture.
• This auditory dominance is not hardwired and can be overcome, allowing visual capture under specific conditions.
• Sensory processing constraints, like minimum visual delays, influence subjective timing perception.