Related Experiment Video
Updated: May 20, 2026
11:15
fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals
Published on: May 23, 2017
Absolute Pitch Shapes the Temporal Binding Window for Audiovisual Speech Perception in Noisy Environments
I-Hui Hsieh1,2, Pei-Chuen Tseng1
1Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan.
Summary
Individuals with absolute pitch (AP) show wider temporal binding windows, leading to poorer audiovisual speech perception in noise. This suggests AP influences multisensory processing, not musicality, and may benefit from targeted training.
Area of Science:
- Auditory Neuroscience
- Multisensory Integration
- Speech Perception
Background:
- Absolute pitch (AP) is the ability to identify musical notes without a reference.
- Emerging research links AP to nonmusical abilities like speech perception.
- The impact of AP on audiovisual speech perception in noise remains unclear.
Purpose of the Study:
- Investigate how AP affects audiovisual speech perception in noise.
- Examine the relationship between AP traits, musicality, and autistic traits (AQ domains) with multisensory speech processing.
Main Methods:
- 74 participants (AP musicians, non-AP musicians, nonmusicians) assessed temporal binding windows for audiovisual speech.
- Audiovisual, audio-only, and visual-only speech perception in noise was tested at various SNRs.
- AP-related functions, musical skills, and autistic traits were evaluated.
Main Results:
- AP musicians had wider temporal binding windows, indicating weaker audiovisual integration.
- This reduced integration correlated with poorer audiovisual speech perception in noise for AP musicians.
- Autistic traits correlated with wider temporal binding windows in AP musicians, independent of music training.
Conclusions:
- AP is linked to an enlarged audiovisual temporal binding window, impairing speech perception in noise.
- No musician advantage for audiovisual speech perception was found when AP ability was considered.
- Findings suggest AP influences multisensory speech processing, with potential for targeted training interventions.
Related Concept Videos
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:13The Cochlea
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:29Non-Verbal Cues
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...