Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Depth Perception and Spatial Vision01:15

Depth Perception and Spatial Vision

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
Non-Verbal Cues01:29

Non-Verbal Cues

Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
Visual System01:26

Visual System

Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Neural activation is enhanced with operational task ecological validity during complex cognitive tasks.

Frontiers in human neuroscience·2026
Same author

Testing the Role of Temporal Attention in Speech: Pretarget Alpha Predicts Memory Encoding Rather Than Effects of Linguistic Focus.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
Same author

From Sight to Touch: Haptic Sensory Integration Can Facilitate Multi-Limb Coordination.

IEEE transactions on haptics·2026
Same author

Different But Complementary Motor Functions Reveal an Asymmetric Recalibration of Upper Limb Bimanual Coordination.

eNeuro·2025
Same author

Geometry of orofacial neuromuscular signals: speech articulation decoding using surface electromyography.

Journal of neural engineering·2025
Same author

An instantaneous voice-synthesis neuroprosthesis.

Nature·2025

Related Experiment Video

Updated: May 29, 2026

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Speech cues contribute to audiovisual spatial integration.

Christopher W Bishop1, Lee M Miller

  • 1Center for Mind and Brain, University of California Davis, Davis, California, United States of America. cwbishop@ucdavis.edu

Plos One
|September 13, 2011
PubMed
Summary

Visual cues aid speech comprehension in noise. Conflicting spatial information does not hinder speech integration, but conflicting speech cues can disrupt spatial perception, revealing an asymmetrical brain pathway influence.

More Related Videos

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners
07:52

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners

Published on: March 13, 2026

Related Experiment Videos

Last Updated: May 29, 2026

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners
07:52

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners

Published on: March 13, 2026

Area of Science:

  • Neuroscience
  • Auditory Perception
  • Visual Perception

Background:

  • Human communication relies heavily on speech, but background noise and competing sounds degrade speech acoustics.
  • The brain utilizes visual information, particularly spatial cues, to enhance speech comprehension in noisy settings.
  • Audiovisual integration, crucial for speech perception, is known to depend on spatiotemporal factors, though some effects persist despite spatial mismatches.

Purpose of the Study:

  • To investigate the dependency of audiovisual speech integration on spatial factors.
  • To explore how conflicting spatial cues and speech cues interact during audiovisual integration.
  • To elucidate the asymmetrical influence between the brain's ventral ('what') and dorsal ('where') pathways in processing audiovisual speech information.

Main Methods:

  • Combining the McGurk effect (auditory-visual speech illusion) and the ventriloquist's illusion (spatial auditory-visual illusion) in psychophysical experiments.
  • Presenting participants with conflicting spatial and speech cues to assess audiovisual integration.
  • Analyzing the impact of spatial disparities and speech cue conflicts on perception.

Main Results:

  • Conflicting spatial cues did not impede the audiovisual integration of speech information.
  • Conversely, conflicting speech cues significantly hindered the integration of spatial information.
  • This asymmetry suggests a distinct interaction pattern between the 'what' and 'where' processing pathways.

Conclusions:

  • Audiovisual speech integration is robust to spatial conflicts but sensitive to speech cue conflicts.
  • The findings highlight an asymmetrical interaction between the ventral ('what') and dorsal ('where') brain pathways.
  • This research provides insights into how the brain resolves conflicting sensory information for speech perception in complex environments.