A visual or tactile signal makes auditory speech detection more efficient by reducing uncertainty.
Bosco S Tjan1, Ewen Chao, Lynne E Bernstein
1Department of Psychology, Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, 90089, USA.
The European Journal of Neuroscience
|January 10, 2014
Summary
Seeing or feeling non-speech cues improves auditory speech detection in noise. Task-irrelevant sensory information refines auditory processing, enhancing speech perception without direct integration.
Area of Science:
- Auditory perception
- Multisensory processing
- Speech perception
Background:
- Auditory speech is more detectable in noise when visual cues are available.
- This enhancement is potentially due to multisensory integration or visual guidance refining auditory processing.
Purpose of the Study:
- To investigate how visual and tactile stimuli affect auditory speech detection in noise.
- To differentiate between multisensory integration and attentional modulation as explanations for enhanced auditory speech detection.
Main Methods:
- Two experiments using a two-interval forced-choice detection task for an auditory 'ba' in noise.
- Paired visual and/or tactile stimuli were presented identically in both intervals, unable to directly inform the response.
- Analysis based on an ideal observer model, assessing intrinsic noise and sampling efficiency.
Main Results:
- Multisensory conditions significantly reduced detection thresholds compared to auditory-only conditions.
- Intrinsic noise remained unaffected, arguing against sensory input merging.
- Sampling efficiency increased, indicating refined auditory stimulus knowledge and reduced uncertainty.
Conclusions:
- Enhanced auditory speech detection in noise is not due to neuronal integration or speech-specific processing.
- Task-irrelevant sensory stimuli improve auditory detection by reducing uncertainty and informing the auditory system about optimal listening times.
- This supports a rudimentary form of multisensory interaction rather than direct signal merging.
Related Concept Videos
01:31Hearing
48.0K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
48.0K
01:17Auditory Perception
1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
01:29Non-Verbal Cues
774
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
774
01:23Design Example
698
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
698
01:05Difference from Background: Limit of Detection
9.0K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
9.0K
01:31What is a Sensory System?
89.6K
Sensory systems detect stimuli—such as light and sound waves—and transduce them into neural signals that can be interpreted by the nervous system. In addition to external stimuli detected by the senses, some sensory systems detect internal stimuli—such as the proprioceptors in muscles and tendons that send feedback about limb position.
89.6K