Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Identification of cognitive predictors of remission in depression following limited effect of repetitive transcranial magnetic stimulation on hot and cold cognitive systems.

Frontiers in human neuroscience·2026
Same author

The articulatory basis of phonological error patterns in childhood speech sound disorders.

Frontiers in human neuroscience·2025
Same author

Virtual Reality Portable Perimetry and Home Monitoring of Glaucoma: Retention and Compliance over a 2-year Period.

Ophthalmology science·2024
Same author

TORONTO: A trial-oriented multidimensional psychometric testing algorithm.

Journal of vision·2024
Same author

Improving the robustness of the Sequentially Optimized Reconstruction Strategy (SORS) for visual field testing.

PloS one·2024
Same author

Using Fused Data from Perimetry and Optical Coherence Tomography to Improve the Detection of Visual Field Progression in Glaucoma.

Bioengineering (Basel, Switzerland)·2024

Related Experiment Video

Updated: May 15, 2026

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

Gaze patterns and audiovisual speech enhancement.

Astrid Yi1, Willy Wong, Moshe Eizenman

  • 1University of Toronto, Ontario, Canada. willy.wong@utoronto.ca

Journal of Speech, Language, and Hearing Research : JSLHR
|January 1, 2013
PubMed
Summary

Understanding speech in noisy environments involves gaze. Focusing near the talker's mouth improves speech intelligibility, especially with multiple visual cues. This gaze strategy is crucial for clear auditory-visual perception.

Keywords:
speech intelligibilityspeech perceptionvisual scanning

More Related Videos

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

Related Experiment Videos

Last Updated: May 15, 2026

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

Area of Science:

  • Auditory-visual speech perception
  • Human eye-tracking studies
  • Speech intelligibility research

Background:

  • Auditory-visual speech perception relies on integrating audio and visual cues.
  • Gaze patterns play a role in how individuals process speech, particularly in challenging listening conditions.

Purpose of the Study:

  • To quantify the relationship between speech intelligibility and gaze patterns.
  • To investigate how different auditory-visual conditions affect gaze behavior and perception.

Main Methods:

  • Eleven subjects viewed talkers on a display while listening to sentences.
  • Gaze was either fixed at specific distances from the center of the talker's mouth (CTM) or moved freely.
  • Eye movements were tracked, and speech intelligibility was measured by word perception accuracy.

Main Results:

  • Speech intelligibility was maintained with fixations within 10° of the CTM for a single talker.
  • With multiple talkers, intelligibility required gaze within 2.5° of the CTM.
  • Gaze strategy adapted to speech-signal-to-noise ratio (SNR), with closer fixation on the CTM in low SNR conditions.

Conclusions:

  • High speech-SNR allows gaze flexibility on a talker's face without impacting intelligibility.
  • Low speech-SNR necessitates fixating near the CTM to optimize speech perception.
  • This gaze strategy is vital when multiple visual cues are present, aiding in distinguishing the relevant talker.