Related Experiment Videos
Recalibration of audiovisual simultaneity
Waka Fujisaki1, Shinsuke Shimojo, Makio Kashino
1NTT Communication Science Laboratories, NTT Corporation, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan.
Nature Neuroscience
|June 15, 2004
Summary
The brain adapts to audiovisual time lags by recalibrating its sense of simultaneity. This sensory processing adjustment helps align auditory and visual inputs from the same event.
Area of Science:
- Neuroscience
- Sensory Perception
- Auditory-Visual Integration
Background:
- The brain integrates multisensory information, like sound and vision, to perceive a unified event.
- Physical transmission and neural processing delays between senses require the brain to adjust timing for accurate perception.
- Experience with audiovisual events may lead to adaptive recalibration of the perceived simultaneity point.
Purpose of the Study:
- To investigate whether the brain adaptively recalibrates its sense of simultaneity based on audiovisual experience.
- To determine if exposure to a consistent audiovisual time lag alters subjective simultaneity judgments.
- To explore the neural mechanisms underlying audiovisual time lag adaptation.
Main Methods:
- Human participants were exposed to a fixed time lag between auditory and visual stimuli for several minutes.
- Subjective simultaneity judgments were measured before and after the adaptation period.
- The effect of adaptation on an auditory-induced visual illusion was assessed to differentiate sensory vs. cognitive adaptation.
Main Results:
- Participants showed a significant shift in their subjective simultaneity responses toward the experienced audiovisual time lag ('lag adaptation').
- Lag adaptation altered the temporal tuning of the auditory-induced visual illusion, indicating changes in sensory processing.
- Findings suggest adaptation is not a cognitive response strategy but a recalibration of sensory timing.
Conclusions:
- The brain dynamically adjusts its perception of simultaneity across sensory modalities to match real-world audiovisual timing.
- This adaptive recalibration likely involves changes in sensory processing pathways to reduce perceived time lags.
- Understanding audiovisual integration and adaptation provides insights into neural mechanisms for unified sensory experience.