Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

412
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
412
Perception of Sound Waves01:01

Perception of Sound Waves

4.6K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.6K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

342
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
342
Auditory Pathway01:15

Auditory Pathway

5.6K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.6K
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

229
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
229
Hearing01:31

Hearing

52.8K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026
Same author

Sequence effects during speech perception reveal multi-accent processing costs.

Attention, perception & psychophysics·2026
Same author

Working memory supports rapid talker and accent accommodation: An individual differences investigation.

Psychonomic bulletin & review·2026
Same author

Measuring brain sensitivity to semantic distance in spoken narrative comprehension.

Cortex; a journal devoted to the study of the nervous system and behavior·2026
Same author

Cortical connectivity in speech and sensory networks associated with childrens' listening and attention disorders.

medRxiv : the preprint server for health sciences·2025
Same author

A high-density diffuse optical tomography dataset of naturalistic viewing.

Scientific data·2025

Related Experiment Video

Updated: Aug 15, 2025

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.6K

Audiovisual speech perception: Moving beyond McGurk.

Kristin J Van Engen1, Avanti Dey2, Mitchell S Sommers1

  • 1Department of Psychological and Brain Sciences, Washington University, St. Louis, Missouri 63130, USA.

The Journal of the Acoustical Society of America
|December 31, 2022
PubMed
Summary

The McGurk illusion is a popular tool for studying how people combine auditory and visual speech cues. However, this study argues that McGurk tasks are not suitable for understanding real-world multisensory speech perception.

More Related Videos

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.6K
Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.4K

Related Experiment Videos

Last Updated: Aug 15, 2025

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.6K
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.6K
Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.4K

Area of Science:

  • Cognitive Science
  • Neuroscience
  • Speech Perception

Background:

  • Sighted listeners integrate auditory and visual cues for speech perception.
  • The McGurk illusion is commonly used to measure multisensory integration ability.
  • Individual differences in McGurk illusion susceptibility are often used as a proxy for audiovisual integration.

Purpose of the Study:

  • To critically evaluate the suitability of McGurk tasks for studying real-life multisensory speech perception.
  • To propose alternative methods for assessing audiovisual integration in naturalistic settings.

Main Methods:

  • Review of existing literature on the McGurk illusion and multisensory speech perception.
  • Analysis of the ecological validity of McGurk stimuli.
  • Comparison of McGurk task performance with natural audiovisual speech perception.

Main Results:

  • McGurk stimuli often use isolated syllables and unnatural audiovisual incongruence.
  • Susceptibility to the McGurk illusion does not reliably correlate with natural audiovisual speech perception performance.
  • McGurk tasks may not accurately reflect real-world multisensory integration abilities.

Conclusions:

  • McGurk tasks are ill-suited for studying naturalistic multisensory speech perception.
  • Understanding audiovisual integration requires ecologically valid stimuli, such as words, sentences, and narratives with congruent cues.
  • Future research should focus on methods that better approximate everyday communication for studying speech perception.