Related Experiment Video
Updated: Jul 16, 2026
09:27
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
Auditory and auditory-visual perception of clear and conversational speech
1Department of Communication Disorders, University of Massachusetts, Amherst, USA.
Summary
Speaking clearly and using visual speech cues significantly improve speech understanding. These two methods provide complementary, not redundant, information for listeners, enhancing auditory speech recognition.
Area of Science:
- Speech perception research
- Auditory and visual communication
Background:
- Clear speech and visual speech cues enhance speech recognition.
- The redundancy of information from clear speech and visual cues is unknown.
Purpose of the Study:
- To investigate if clear speaking and visual speech cues offer redundant or complementary information.
- To examine the effects of speaking mode (clear vs. conversational) and presentation mode (auditory vs. auditory-visual) on word perception in nonsense sentences.
Main Methods:
- Experiment 1: 30 normal-hearing young adults viewed videotaped stimuli in noise (auditory-visual presentation).
- Experiment 2: 9 participants from Experiment 1 underwent auditory-only presentation.
- Stimuli were nonsense sentences presented at varying signal-to-noise ratios.
Main Results:
- Clear speech significantly improved word recognition compared to conversational speech.
- Auditory-visual presentation yielded better performance than auditory-only presentation.
- Clear speech benefits were greatest for medial words; visual cues benefited final words most.
Conclusions:
- Clear speaking and visual speech cues provide complementary, non-redundant information.
- The combined benefit of clear speech and visual cues equals the sum of their individual benefits.
- This suggests distinct informational contributions from each modality.
More Related Videos
11:39Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
06:04Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
Published on: March 24, 2023
Related Concept Videos
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...