Related Experiment Video
Updated: Jun 25, 2026
06:04
Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
Published on: March 24, 2023
Visual speech improves the intelligibility of time-expanded auditory speech.
Akihiro Tanaka1, Shuichi Sakamoto, Komi Tsumura
1Research Institute of Electrical Communication, Tohoku University, Sendai, Japan. a.tanaka@uvt.nl
Neuroreport
|February 26, 2009
Summary
Auditory-visual speech is more intelligible than auditory-only speech. However, time-expanding the audio signal decreased the auditory-visual benefit, while audio lag did not.
Area of Science:
- Speech Perception
- Audiology
- Human-Computer Interaction
Background:
- Auditory-visual speech perception enhances intelligibility compared to auditory-only.
- Understanding how timing variations affect this benefit is crucial for real-world applications.
Purpose of the Study:
- To investigate the impact of intermodal timing and speed differences on word intelligibility in auditory-visual speech.
- To compare the effects of asynchronous audio lag versus time-expanded audio on auditory-visual benefit.
Main Methods:
- Word intelligibility was assessed in visual-only, auditory-only, and auditory-visual conditions.
- Auditory-visual conditions included asynchronous audio lag (0-400 ms) and time-expanded audio (0-400 ms) with constant visual speed.
Main Results:
- Word intelligibility was significantly higher in auditory-visual conditions compared to auditory-only.
- Auditory-visual benefit decreased with increased time expansion of the auditory signal.
- No significant decline in auditory-visual benefit was observed with asynchronous audio lag.
Conclusions:
- Auditory-visual speech enhances intelligibility, but this benefit is sensitive to temporal distortions.
- Time expansion of the auditory signal negatively impacts auditory-visual benefit more than asynchronous audio lag.
Related Concept Videos
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
01:27Language and Cognition
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
01:07Elaborative Rehearsals
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...