Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

1.4K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.4K
Perception of Sound Waves01:01

Perception of Sound Waves

5.9K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.9K
Factors Affecting Perception01:25

Factors Affecting Perception

3.0K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
3.0K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

1.2K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.2K
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

4.0K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
4.0K
Gestalt Principles of Perception01:21

Gestalt Principles of Perception

1.7K
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
1.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Perceptual Tuning to Structure: Integrating the Phonetic Detail of Coarticulatory Vowel Nasalization With Prosodic and Information Structure.

Language and speech·2026
Same author

The impact of rhotic allophony on spoken-word recognition during sound change.

Journal of experimental psychology. Human perception and performance·2026
Same author

Name use by companion parrots.

PloS one·2026
Same author

Lexical Bias Effects do not Influence Responses to Real-Time Temporal Auditory Feedback Perturbation.

Language and speech·2026
Same author

A web-based mouse-tracking task for early perceptual language processing.

Behavior research methods·2025
Same author

Flexibility and Stability in Lexical Tone Recalibration: Evidence from Tone Perceptual Learning.

Language and speech·2024
Same journal

Low prevalence targets are primarily missed due to mind wandering.

Attention, perception & psychophysics·2026
Same journal

An introduction to the special issue celebrating Mary A. Peterson.

Attention, perception & psychophysics·2026
Same journal

Properties of the threshold stimulus exposure duration (TSED) measure of visual search efficiency.

Attention, perception & psychophysics·2026
Same journal

Auditory selective attention in depth: Investigating directional dependency across front, lateral, and rear spaces.

Attention, perception & psychophysics·2026
Same journal

Dissociations between stereoacuity and visual acuity with binocular night vision goggles.

Attention, perception & psychophysics·2026
Same journal

Reward-based prioritization and perceptual feature effects on attentional flexibility in working memory.

Attention, perception & psychophysics·2026
See all related articles

Related Experiment Video

Updated: Mar 11, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

3.0K

Visual speech influences speech perception immediately but not automatically.

Holger Mitterer1, Eva Reinisch2

  • 1Department of Cognitive Science, Faculty of Media and Knowledge Sciences, University of Malta, Msida, MSD 2080, Malta. holger.mitterer@um.edu.mt.

Attention, Perception & Psychophysics
|December 2, 2016
PubMed
Summary
This summary is machine-generated.

Visual speech cues from lipreading aid spoken word recognition but are reduced by divided attention. When attention is focused and visual load is low, lipreading cues are used immediately, even before auditory information.

Keywords:
Multisensory processingSpeech perception

More Related Videos

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

2.1K
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.5K

Related Experiment Videos

Last Updated: Mar 11, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

3.0K
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

2.1K
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.5K

Area of Science:

  • Cognitive Psychology
  • Auditory and Visual Perception
  • Speech Processing

Background:

  • Spoken word recognition relies on integrating auditory and visual speech cues.
  • Attentional resources significantly impact multisensory integration in speech perception.

Purpose of the Study:

  • To investigate the temporal dynamics of auditory and visual speech cue utilization in spoken word recognition.
  • To determine the role of attentional load and visual processing demands on lipreading cue integration.

Main Methods:

  • Utilized an eye-tracking paradigm to monitor participants' gaze during spoken word recognition tasks.
  • Manipulated attentional demands and visual processing load across two experiments.

Main Results:

  • Reduced use of visual speech cues when attention was divided by concurrent visual stimuli.
  • Visual speech cues were effectively utilized when attention was directed to the speaker and visual load was minimized.
  • Eye-tracking data revealed immediate use of visual information, often preceding auditory information processing.

Conclusions:

  • Visual speech cues are not automatically employed in spoken word recognition.
  • Effective utilization of lipreading cues is contingent on attentional focus and manageable visual processing load.
  • Visual information is integrated rapidly when conditions permit, highlighting its immediate contribution to speech perception.