Related Experiment Video
Updated: Aug 7, 2026
09:13
Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
Published on: April 22, 2015
Auditory-visual speech perception and synchrony detection for speech and nonspeech signals
Brianna Conrey1, David B Pisoni
1Department of Psychological and Brain Sciences, Indiana University, 1101 East Tenth Street, Bloomington, Indiana 47405, USA. bconrey@indiana.edu
The Journal of the Acoustical Society of America
|July 15, 2006
Summary
Individual differences in detecting auditory-visual synchrony, for both speech and non-speech sounds, influence how well people perceive speech, whether through hearing alone or combined senses.
Area of Science:
- Multisensory Perception
- Auditory-Visual Speech Perception
- Temporal Processing
Background:
- A "synchrony window" exists where auditory-visual (AV) asynchronies are imperceptible.
- Individual variability in this window is linked to AV speech perception, but its relation to speech vs. non-speech signals was unclear.
Purpose of the Study:
- To investigate the relationship between AV speech perception measures and AV synchrony detection.
- To determine if synchrony detection for speech and non-speech signals relates to speech perception.
Main Methods:
- An experiment was conducted to measure AV speech perception.
- AV synchrony detection thresholds for both speech and non-speech signals were assessed.
Main Results:
- Variability in AV synchrony detection for both speech and non-speech signals correlated with variability in auditory-only (A-only) speech perception.
- Variability in AV synchrony detection also correlated with variability in AV speech perception.
Conclusions:
- Temporal processing of both speech and non-speech signals is crucial for understanding individual differences in speech perception.
- Future research should consider temporal processing across signal types to explain speech perception variability.
More Related Videos
Related Concept Videos
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:29Non-Verbal Cues
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
01:30Classification of Signals
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...