Related Experiment Video
Updated: Jun 6, 2026
06:07
Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm
Published on: May 15, 2019
Eye-gaze and arrow cues influence elementary sound perception.
Jeremy I Borjon1, Stephen V Shepherd, Alexander Todorov
1Department of Psychology, Princeton University, Green Hall, Princeton, NJ 08540, USA.
Proceedings. Biological Sciences
|December 15, 2010
Summary
Visual cues like eye-gaze and arrows alter sound perception. This study shows exogenous attention influences auditory spatial awareness, shifting perceived sound origins toward visual cues.
Area of Science:
- Cognitive Neuroscience
- Auditory Perception
- Visual Attention
Background:
- The spatial perception of sound is crucial for environmental interaction.
- Cross-modal interactions between vision and audition are increasingly recognized.
- Exogenous cues are known to capture attention automatically.
Purpose of the Study:
- To investigate whether visual cues, specifically eye-gaze and arrow direction, influence the perceived location of sounds.
- To determine if this influence is supramodal and independent of facial expression.
Main Methods:
- Participants were presented with visual cues (arrows or faces with specific gaze directions).
- Following the visual cue, a brief sound was presented from one of six spatial locations.
- Participants reported the perceived origin of the sound.
Main Results:
- Perceived sound origin was systematically shifted towards the direction indicated by the visual cue (arrow or gaze).
- The magnitude of the spatial shift was similar for both arrow cues and gazing faces.
- Facial expression did not significantly affect the observed perceptual shift.
Conclusions:
- Visual cues, including eye-gaze and arrows, can modulate auditory spatial perception.
- This effect suggests a supramodal attentional mechanism driven by exogenous cues.
- Auditory spatial awareness is influenced by non-auditory, visually-driven attentional capture.
Related Concept Videos
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:29Non-Verbal Cues
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
01:06Echo
The human ear cannot distinguish between two sources of sound if they happen to reach within a specific time interval, typically 0.1 seconds apart. More than this, and they are perceived as separate sources.
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case, then the...
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case, then the...