Related Experiment Videos
Hearing what the eyes see: auditory encoding of visual temporal sequences
Sharon E Guttman1, Lee A Gilroy, Randolph Blake
1Department of Psychology, Vanderbilt University, 111 21st Avenue South, 301 Wilson Hall, Nashville, TN 37203, USA. sharon.guttman@vanderbilt.edu
Psychological Science
|March 1, 2005
Summary
The brain automatically encodes visual rhythms using auditory processing. This cross-modal encoding demonstrates that temporal information from vision is perceived through audition, even when irrelevant.
Area of Science:
- Cognitive Psychology
- Neuroscience
- Sensory Perception
Background:
- Vision typically dominates spatial tasks, while audition excels in temporal processing.
- Sensory systems may specialize, leading to cross-modal encoding of information.
- Investigating how visual temporal structures are processed is key to understanding sensory integration.
Purpose of the Study:
- To determine if visual temporal structures are automatically encoded in the auditory domain.
- To examine the cross-modal influence of auditory information on visual rhythm perception.
- To test the obligatory nature of auditory encoding for visual temporal information.
Main Methods:
- Three experiments involved observers discriminating rhythms in visual sequences.
- Task-irrelevant auditory and visual stimuli were presented to assess interference.
- Performance was measured by the degree of disruption caused by incongruent stimuli.
Main Results:
- Auditory information significantly disrupted rhythm discrimination, especially during encoding.
- Visual changes in rhythm had minimal impact on performance.
- This suggests automatic, obligatory auditory encoding of visual temporal structure.
Conclusions:
- The perceptual system automatically abstracts temporal structure from visual input.
- This temporal information is obligatorily represented using an auditory code.
- This phenomenon leads to the experience of 'hearing visual rhythms'.