Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Encoding01:19

Encoding

887
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
887
Hearing01:31

Hearing

57.6K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
57.6K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

1.1K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.1K
The Cochlea01:13

The Cochlea

51.4K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
51.4K
Auditory Pathway01:15

Auditory Pathway

7.6K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
7.6K
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

3.9K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Modulations of the P3b effect as a function of bilingual language experience.

Scientific reports·2026
Same author

Neural Underpinnings of the Continuity Illusion in Musicians.

The European journal of neuroscience·2026
Same author

Phonetic convergence enhances speech intelligibility.

Attention, perception & psychophysics·2025
Same author

Investigating the role of auditory cues in modulating motor timing: insights from EEG and deep learning.

Cerebral cortex (New York, N.Y. : 1991)·2024
Same author

Cross-Modal Tinnitus Remediation: A Tentative Theoretical Framework.

Brain sciences·2024
Same author

The Benefit of Bimodal Training in Voice Learning.

Brain sciences·2023
Same journal

Vestibular function drives gaze stability in locomoting macaques.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
Same journal

Region- and layer-specific glutamatergic synapse development in the nascent cortical hierarchy.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
Same journal

Endogenous peptide derived from c-Cbl-associated protein counteracts its inhibitory effect on enteric neural crest cell colonization in Hirschsprung disease.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
Same journal

Drowsiness alters the neural dynamics but not the core computations of multisensory integration.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
Same journal

A Matter of Parameters: Tailored Transcranial Focused Ultrasound Enhances Cortico-Thalamo-Cortical Circuit Resonance.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
Same journal

Proactive visual and motor prioritization differentially scale with cue reliability.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
See all related articles

Related Experiment Video

Updated: Feb 16, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.9K

Neural Mechanisms Underlying Cross-Modal Phonetic Encoding.

Antoine J Shahin1, Kristina C Backer2, Lawrence D Rosenblum3

  • 1Center for Mind and Brain, University of California, Davis, California 95618, and ajshahin@ucdavis.edu.

The Journal of Neuroscience : the Official Journal of the Society for Neuroscience
|December 22, 2017
PubMed
Summary
This summary is machine-generated.

Audiovisual integration in speech comprehension is enhanced when visual input influences auditory cortex phonetic representations. This study shows vision primes auditory processing, altering speech perception and demonstrating cross-modal influence.

Keywords:
McGurk illusionaudiovisual integrationauditory evoked potentialscross-modal perceptionspeech perception

More Related Videos

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.5K
Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns
09:42

Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns

Published on: May 12, 2019

6.5K

Related Experiment Videos

Last Updated: Feb 16, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.9K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.5K
Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns
09:42

Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns

Published on: May 12, 2019

6.5K

Area of Science:

  • Neuroscience
  • Auditory Perception
  • Speech Processing

Background:

  • Audiovisual (AV) integration is crucial for speech comprehension, particularly in noisy environments.
  • Theories on AV integration suggest either interaction between auditory and visual cortices or fusion in a multisensory integrator.
  • This study focuses on the theory that visual input modulates phonetic representations within the auditory cortex.

Purpose of the Study:

  • To investigate the neural mechanisms of audiovisual integration in spoken language.
  • To test the hypothesis that visual speech dynamically weights phonetic representations in the auditory cortex.
  • To examine how visual information alters auditory evoked potentials during speech perception.

Main Methods:

  • Electroencephalography (EEG) was used to record brain activity in human subjects.
  • Participants watched and listened to consonant-vowel (CV) syllables (/ba/, /fa/) in auditory-only, AV congruent, and AV incongruent conditions.
  • Behavioral responses and N1 auditory evoked potentials were analyzed to assess speech perception and neural processing.

Main Results:

  • An enlarged N1 auditory evoked potential was observed for the 'illusion-ba' perception (visual /ba/, acoustic /fa/), indicating strengthened /b/ representation.
  • A reduced N1 was found for the 'illusion-fa' perception (visual /fa/, acoustic /ba/), indicating weakened /f/ representation.
  • These neural changes mirrored behavioral perception and were more pronounced in individuals with stronger illusory perception.

Conclusions:

  • Visual speech significantly modifies phonetic encoding at the auditory cortex.
  • Audiovisual integration in speech involves one modality (vision) acting upon the representations of another (audition).
  • Findings support the model of visual networks influencing auditory cortex phonetic representations, offering new insights into cross-modal interactions.