Related Experiment Video
Updated: Aug 10, 2026
09:13
Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
Published on: April 22, 2015
Evaluation and integration of visual and auditory information in speech perception
Summary
Visual and auditory information significantly influence speech perception. A fuzzy logical model explains how continuous, independent features are integrated for accurate recognition, even with ambiguous speech events.
Area of Science:
- Psychology
- Linguistics
- Cognitive Science
Background:
- Speech perception relies on integrating auditory and visual cues.
- Understanding how the brain processes multisensory speech information is crucial.
Purpose of the Study:
- To investigate the integration of visual and auditory information in speech perception.
- To test quantitative models of perceptual recognition.
Main Methods:
- Three experiments were conducted using synthetic speech syllables (/ba/ to /da/).
- Visual articulation (videotaped) was paired with auditory stimuli.
- Response alternatives were varied, including unconstrained options.
Main Results:
- Visual articulation significantly impacted speech identification, even when auditory input was clear.
- Continuous and independent integration of information sources was supported.
- Reaction times correlated with perceived speech ambiguity.
- A fuzzy logical model accurately described responses, including combined phonetic features.
Conclusions:
- The fuzzy logical model of perceptual recognition provides a robust framework for understanding multisensory speech processing.
- Speech perception involves the dynamic integration of continuous, independent sensory information.
Related Concept Videos
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...