Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

494
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
494
Auditory Perception01:17

Auditory Perception

946
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
946
Prosopagnosia01:24

Prosopagnosia

632
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
632
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

857
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
857
Factors Affecting Perception01:25

Factors Affecting Perception

2.5K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
2.5K
Gestalt Principles of Perception01:21

Gestalt Principles of Perception

957
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
957

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Size Scaling of the Electrochemical Performance of Ti<sub>3</sub>C<sub>2</sub>T<sub>x</sub> MXene Microelectrode Arrays for Electrophysiological Recording and Stimulation.

Small (Weinheim an der Bergstrasse, Germany)·2026
Same author

Dissociating stimulus encoding and task demands in ECoG responses from human visual cortex.

bioRxiv : the preprint server for biology·2026
Same author

Size Scaling of the Electrochemical Performance of Ti<sub>3</sub>C<sub>2</sub>T <sub><i>x</i></sub> MXene Microelectrode Arrays for Electrophysiological Recording and Stimulation.

bioRxiv : the preprint server for biology·2026
Same author

Integrating data across oscillatory power bands predicts the seizure onset zone in focal epilepsies.

Brain communications·2026
Same author

A deep neural network model of audiovisual speech recognition reports the McGurk effect.

Psychonomic bulletin & review·2026
Same author

Task irrelevant sounds influence visual attention through graded crossmodal semantic modulation.

Psychonomic bulletin & review·2026
Same journal

Mind wandering during first- and foreign-language reading.

Psychonomic bulletin & review·2026
Same journal

Lexical word processing is unaffected by rapid invisible frequency tagging in reading: Evidence from eye movements.

Psychonomic bulletin & review·2026
Same journal

Anxiety modulates voluntary attentional orienting to emotional gaze cues: Eye movements for pro- and anti-saccades.

Psychonomic bulletin & review·2026
Same journal

Faster key-press responses to front vowels than back vowels when matching heard vowels with represented vowels.

Psychonomic bulletin & review·2026
Same journal

Testing the interleaving effect without response bias: A forced-choice reevaluation of Kornell and Bjork (2008).

Psychonomic bulletin & review·2026
Same journal

The impact of social interaction on abstract concepts.

Psychonomic bulletin & review·2026
See all related articles

Related Experiment Video

Updated: Jan 1, 2026

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.3K

Face viewing behavior predicts multisensory gain during speech perception.

Johannes Rennig1, Kira Wegner-Clemens1, Michael S Beauchamp2

  • 1Department of Neurosurgery and Core for Advanced MRI, Baylor College of Medicine, 1 Baylor Plaza Suite S104, Houston, TX, 77030, USA.

Psychonomic Bulletin & Review
|December 18, 2019
PubMed
Summary
This summary is machine-generated.

Individuals who focus more on a speaker's mouth when viewing faces show better understanding of noisy audiovisual speech. This suggests that lifelong visual attention to the mouth enhances speech comprehension through learned audio-visual associations.

Keywords:
AudiovisualEye trackingFaceMultisensorySpeech perception

More Related Videos

Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm
06:07

Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm

Published on: May 15, 2019

8.9K
Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.9K

Related Experiment Videos

Last Updated: Jan 1, 2026

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.3K
Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm
06:07

Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm

Published on: May 15, 2019

8.9K
Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.9K

Area of Science:

  • Neuroscience
  • Speech Perception
  • Human Vision

Background:

  • Audiovisual speech perception enhances intelligibility, but individual differences exist.
  • Variability in face viewing, specifically fixation on the mouth versus eyes, is also observed.

Purpose of the Study:

  • To investigate the relationship between visual attention to the mouth and audiovisual speech comprehension.
  • To determine if lifelong visual exposure influences the integration of auditory and visual speech information.

Main Methods:

  • Assessed interindividual variability in understanding noisy audiovisual sentences.
  • Measured the proportion of time participants spent fixating on a talker's mouth during clear audiovisual syllable presentation.
  • Correlated audiovisual speech comprehension accuracy with mouth fixation duration.

Main Results:

  • Significant positive correlation found between time spent fixating the mouth and audiovisual speech comprehension.
  • A 10% increase in mouth fixation corresponded to a 5.6% increase in multisensory gain.
  • Individual differences in speech comprehension accuracy ranged from 2% to 58%.

Conclusions:

  • Lifelong visual exposure, specifically fixation on the mouth, strengthens audio-visual speech associations.
  • Mouth fixation preference is linked to enhanced ability to comprehend noisy audiovisual speech.
  • This study reveals an unexpected connection between face processing and speech understanding mediated by visual experience.