Related Experiment Video
Updated: Jul 12, 2026
07:37
Assessment and Communication for People with Disorders of Consciousness
Published on: August 1, 2017
Bimodal displays improve speech comprehension in environments with multiple speakers
Darrell S Rudmann1, Jason S McCarley, Arthur F Kramer
1Beckman Institute, University of Illinois, Urbana-Champaign, Urbana, Illinois 61801, USA. rudmann@uiuc.edu
Human Factors
|October 8, 2003
Summary
Adding a video of the speaker improves speech comprehension in noisy environments. However, the ventriloquism effect did not enhance understanding, even with realistic sounds and visuals.
Area of Science:
- Auditory Perception
- Visual Perception
- Human-Computer Interaction
Background:
- Understanding speech in complex auditory environments is crucial.
- The ventriloquism effect, where sound appears to originate from a visual source, may aid auditory perception.
- Ecologically valid stimuli are needed to test these effects in realistic scenarios.
Purpose of the Study:
- To determine if video displays enhance speech comprehension with competing voices.
- To investigate if the ventriloquism effect can improve comprehension in naturalistic settings.
- To assess the impact of increasing numbers of distracting voices on target word detection.
Main Methods:
- Participants listened to target words from videos of a speaker while ignoring 2-4 other voices.
- Performance was measured by target-word detection accuracy.
- Signal-detection and gaze-contingent analyses were employed to examine the ventriloquism effect.
Main Results:
- Speech comprehension declined as the number of distracting voices increased.
- A video display of the target speaker significantly reduced this decline.
- Neither signal-detection nor gaze-contingent analyses revealed a ventriloquism effect.
Conclusions:
- Visual information from a target speaker aids auditory comprehension amidst competing sounds.
- The ventriloquism effect, as previously described, was not observed in this naturalistic study.
- Findings have implications for improving communication in high-noise environments like air traffic control.
Related Concept Videos
01:14SBAR II: Application of SBAR
SBAR is an effective communication tool used by healthcare professionals to communicate patient information accurately. SBAR stands for Situation, Background, Assessment, and Recommendation. For a better understanding, an example is given below.
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
01:21Barriers to Effective Communication II
The barriers to effective communication also include cultural barriers, semantic barriers, gender barriers, and time constraints.
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
01:28Lateralization
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...