Related Experiment Video
Updated: Mar 21, 2026
09:27
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
10.9K
High visual resolution matters in audiovisual speech perception, but only for some
Agnès Alsius1, Rachel V Wayne2, Martin Paré3
1Department of Psychology, Queen's University, Humphrey Hall, 62 Arch St, Kingston, Ontario, Canada, K7L 3N6. aalsius@gmail.com.
Attention, Perception & Psychophysics
|May 7, 2016
Summary
Individual differences in audiovisual speech perception depend on using fine facial details. Some individuals benefit more from visual speech cues, especially when viewing the mouth region closely.
Area of Science:
- Audiovisual Speech Perception
- Human Sensory Processing
- Auditory-Visual Integration
Background:
- Individual differences in visual speech enhancement of degraded auditory signals are not well understood.
- Prior research suggests fine facial detail is not crucial, but didn't explore individual variations in its use.
Purpose of the Study:
- To investigate the role of fine facial detail and gaze behavior in individual differences in audiovisual speech perception.
- To understand why some individuals benefit more from visual speech cues than others.
Main Methods:
- Compared participants based on their ability to benefit from visual speech with noisy auditory signals.
- Modulated visual signal resolution using low-pass spatial frequency filtering.
- Monitored participants' gaze behavior during audiovisual speech tasks.
Main Results:
- High visual gain participants were more negatively impacted by removing high spatial frequency visual information.
- Gaze behavior differences emerged for word stimuli, with high visual gain participants fixating longer on the mouth.
- Individual variance in audiovisual speech perception is partly explained by better use of fine facial details and focused gaze on the mouth.
Conclusions:
- Effective use of fine facial details and focused visual attention on the mouth contribute to individual differences in audiovisual speech perception.
- Audiovisual speech perception can be impaired for some individuals when visual input is degraded.
Related Concept Videos
01:17Auditory Perception
1.4K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.4K
01:21Perceiving Loudness, Pitch, and Location
1.3K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.3K
01:01Perception of Sound Waves
6.0K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
6.0K
01:31Hearing
58.5K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
58.5K
01:15Depth Perception and Spatial Vision
2.6K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
2.6K
01:26Visual System
2.2K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
2.2K