Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Parallel Processing01:20

Parallel Processing

The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Visual System01:26

Visual System

Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Factors Affecting Perception01:25

Factors Affecting Perception

Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Erratum: Embodied emotions in ancient Neo-Assyrian texts revealed by bodily mapping of emotional semantics.

iScience·2026
Same author

The Effects of Cognitive Fatigue and Articulatory Suppression on Statistical Language Learning Depend on the Strength of Cognitive Resources.

Cognitive science·2026
Same author

Cerebral topographies of perceived and felt emotions.

Imaging neuroscience (Cambridge, Mass.)·2025
Same author

Prosody enhances learning of statistical dependencies from continuous speech streams in adults.

Cognition·2025
Same author

Embodied emotions in ancient Neo-Assyrian texts revealed by bodily mapping of emotional semantics.

iScience·2025
Same author

Six types of loves differentially recruit reward and social cognition brain areas.

Cerebral cortex (New York, N.Y. : 1991)·2024

Related Experiment Video

Updated: Jul 5, 2026

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

Visual processing affects the neural basis of auditory discrimination.

Daniel S Kislyuk1, Riikka Möttönen, Mikko Sams

  • 1Laboratory of Computational Engineering, Helsinki University of Technology, Finland. dkislyuk@gmail.com

Journal of Cognitive Neuroscience
|May 7, 2008
PubMed
Summary
This summary is machine-generated.

Visual speech alters auditory perception at the brain's auditory cortex level. The McGurk effect, when combined with mismatch negativity (MMN) testing, shows vision can prevent early sound discrimination.

More Related Videos

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Behavioral Determination of Stimulus Pair Discrimination of Auditory Acoustic and Electrical Stimuli Using a Classical Conditioning and Heart-rate Approach
10:50

Behavioral Determination of Stimulus Pair Discrimination of Auditory Acoustic and Electrical Stimuli Using a Classical Conditioning and Heart-rate Approach

Published on: June 6, 2012

Related Experiment Videos

Last Updated: Jul 5, 2026

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Behavioral Determination of Stimulus Pair Discrimination of Auditory Acoustic and Electrical Stimuli Using a Classical Conditioning and Heart-rate Approach
10:50

Behavioral Determination of Stimulus Pair Discrimination of Auditory Acoustic and Electrical Stimuli Using a Classical Conditioning and Heart-rate Approach

Published on: June 6, 2012

Area of Science:

  • Neuroscience
  • Auditory Perception
  • Multisensory Integration

Background:

  • The McGurk effect demonstrates audiovisual speech integration, where visual cues influence auditory perception.
  • Previous research localized audiovisual interactions to the auditory cortex but didn't clarify their role in perceptual changes.
  • Mismatch negativity (MMN) is an electrophysiological response in the auditory cortex to auditory changes.

Purpose of the Study:

  • To investigate if visual speech can alter auditory perception at the auditory cortex level.
  • To examine the impact of the McGurk effect on mismatch negativity (MMN) responses.
  • To determine if visual input affects early auditory discrimination mechanisms.

Main Methods:

  • An electroencephalogram (EEG) experiment combining the McGurk effect with an oddball paradigm.
  • Presentation of auditory syllables /va/ (standard) and /ba/ (deviant) to 11 participants.
  • Comparison of MMN responses to deviant auditory stimuli in unisensory (auditory only) versus audiovisual conditions.

Main Results:

  • Unisensory deviant /ba/ stimuli elicited a typical MMN, indicating auditory cortex discrimination.
  • In the audiovisual condition, the McGurk effect caused /ba/ to be perceived as /va/.
  • Audiovisual presentation of deviant /ba/ stimuli did not elicit MMN, suggesting failed auditory cortex discrimination.

Conclusions:

  • Visual speech input can qualitatively alter auditory perception at the auditory cortex.
  • The visual stream influences early auditory processing, specifically sound discrimination mechanisms.
  • Audiovisual integration, as shown by the McGurk effect, can suppress auditory cortex activity related to acoustic change detection.