Related Experiment Video
Updated: Jun 10, 2025
05:38
Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
2.3K
When Hearing Lips and Seeing Voices Becomes Perceiving Speech: Auditory-Visual Integration in Lexical Access.
Rachel Ostrand1, Sheila E Blumstein2, James L Morgan2
1University of California, San Diego, Department of Cognitive Science 9500 Gilman Drive, #0515, La Jolla, CA 92093-0515 USA.
Summary
The McGurk Effect shows how vision impacts hearing. This study reveals that auditory-visual speech integration timing depends on whether the sound is a real word or not.
Area of Science:
- Psycholinguistics
- Auditory Perception
- Speech Processing
Background:
- The McGurk Effect demonstrates audiovisual speech perception, where visual stimuli alter auditory perception.
- The precise timing of auditory-visual integration within speech processing remains incompletely understood.
Purpose of the Study:
- To investigate the temporal relationship between lexical-semantic access and audiovisual integration in speech perception.
- To determine if integration occurs before, during, or after lexical access.
Main Methods:
- Utilized a semantic priming paradigm.
- Presented participants with auditory speech stimuli that were either real words or nonwords.
- Measured semantic activation related to the auditory signal and the McGurk percept.
Main Results:
- When the auditory stimulus was a word, semantic associates of the unintegrated auditory signal were activated.
- When the auditory stimulus was a nonword, semantic associates of the integrated McGurk percept (a real word) were activated.
Conclusions:
- The timing of lexical access and audiovisual integration is dependent on the lexical status of the auditory speech signal.
- Suggests a dynamic interplay between auditory processing, lexical access, and visual influences in speech perception.
More Related Videos
Related Concept Videos
01:10Higher Mental Functions of the Brain: Language
768
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
768
01:26Visual System
553
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
553
01:15Auditory Pathway
5.2K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.2K
01:27Language and Cognition
332
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
332
01:31Hearing
51.9K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.9K
01:21Perceiving Loudness, Pitch, and Location
197
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
197