Related Experiment Video
Updated: Jun 3, 2026
07:52
An Automated System for Sound Localization Testing in Hearing-Impaired Listeners
Published on: March 13, 2026
Sound location can influence audiovisual speech perception when spatial attention is manipulated
Kaisa Tiippana1, Hanna Puharinen, Riikka Möttönen
1Institute of Behavioural Sciences, Psychology, PO Box 9, 00014 University of Helsinki, Finland. kaisa.tiippana@helsinki.fi
Seeing and Perceiving
|March 17, 2011
Summary
Sound location influences how we perceive speech, especially when visual and auditory cues conflict. Spatial attention, by focusing on specific sound locations, enhances this audiovisual speech perception effect.
Area of Science:
- Cognitive Neuroscience
- Auditory Perception
- Visual Perception
Background:
- Audiovisual speech perception was previously thought to be independent of sound location.
- The McGurk effect, a key phenomenon in this field, was unaffected by sound source location in prior studies.
Purpose of the Study:
- To investigate whether sound location modulates audiovisual speech perception.
- To determine the role of spatial attention in audiovisual speech perception and the McGurk effect.
Main Methods:
- Participants experienced the McGurk effect with auditory speech stimuli presented from five different spatial locations.
- Auditory spatial attention was manipulated by varying the probability of sound occurrence from different locations.
- Reaction times to congruent audiovisual stimuli were measured.
Main Results:
- The McGurk effect was significantly enhanced at the attended sound location.
- Sound location modulated the strength of the McGurk effect, with stronger effects observed at attended or central locations.
- Reaction times were fastest for congruent audiovisual stimuli, irrespective of sound location.
Conclusions:
- Sound location is a critical factor that modulates audiovisual speech perception.
- Spatial attention plays a significant role in mediating the influence of sound location on audiovisual speech perception.
More Related Videos
Related Concept Videos
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:25Factors Affecting Perception
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...