Related Experiment Video
Updated: Aug 10, 2026
09:27
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
Integral processing of visual place and auditory voicing information during phonetic perception
Journal of Experimental Psychology. Human Perception and Performance
|February 1, 1991
Summary
Cross-modal speech perception shows interference between auditory voicing and visual place cues. Reaction times for classifying phonetic features are longer when both auditory and visual stimuli vary, indicating mutual interference.
Area of Science:
- Auditory and Visual Speech Perception
- Phonetics
- Cognitive Psychology
Background:
- Auditory speech perception involves classifying phonetic features like place and voicing.
- Previous research indicates interference between these features within the auditory modality.
Purpose of the Study:
- To investigate cross-modal interference between auditory voicing and visual place cues in speech perception.
- To determine if the McGurk effect paradigm reveals mutual interference between visual and auditory speech features.
Main Methods:
- Auditory speech stimuli varying in place and voicing were presented.
- Visual stimuli varying in place were presented, leveraging the McGurk effect.
- Reaction times (RTs) for phonetic feature classification were measured under single- and dual-modality conditions.
Main Results:
- RTs for place and voicing classification were significantly longer in the dual-modality (test) condition compared to single-modality (control) conditions.
- This interference pattern was observed for both place and voicing dimensions, regardless of modality.
Conclusions:
- Mutual and symmetric interference occurs in the classification of phonetic features across auditory and visual modalities.
- Speech perception integrates information from different sensory inputs, demonstrating cross-modal influences even with conflicting cues.
More Related Videos
05:38Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
05:48Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
Published on: August 9, 2024
Related Concept Videos
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:21Gestalt Principles of Perception
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...