Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Spatial frequency requirements for audiovisual speech perception.

K G Munhall1, C Kroos, G Jozan

  • 1Department of Psychology, Queen's University, Kingston, Ontario, Canada. munhallk@psyc.queensu.ca

Perception & Psychophysics
|August 18, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The influence of bistable auditory feedback on speech motor control.

Experimental brain research·2019
Same author

Knowing when to respond: the role of visual information in conversational turn exchanges.

Attention, perception & psychophysics·2017
Same author

Movement coordination during conversation.

PloS one·2014
Same author

Speech perception: when to put your money where the mouth is.

Current biology : CB·2012
Same author

Audiovisual integration of speech in a bistable illusion.

Current biology : CB·2009
Same author

Talkers alter vowel production in response to real-time formant perturbation even when instructed not to compensate.

The Journal of the Acoustical Society of America·2009
Same journal

Response organization in selective adaptation to speech sounds.

Perception & psychophysics·2014
Same journal

Reaction times to comparisons within and across phonetic categories.

Perception & psychophysics·2012
Same journal

Auditory and phonetic memory codes in the discrimination of consonants and vowels.

Perception & psychophysics·2012
Same journal

Simple and contingent adaptation effects for place of articulation in stop consonants.

Perception & psychophysics·2012
Same journal

Auditory property detectors and processing place features in stop consonants.

Perception & psychophysics·2012
Same journal

Visual working memory for line orientations and face identities.

Perception & psychophysics·2008
See all related articles

Visual speech information, even when filtered, significantly boosts understanding in noisy conditions. Mid-range spatial frequencies offer the most benefit, suggesting high detail isn't crucial for audiovisual speech perception.

Area of Science:

  • Audiovisual Speech Perception
  • Image Processing
  • Auditory Intelligibility

Background:

  • Understanding how visual information aids speech perception in noise is crucial.
  • Spatial frequency content of visual speech signals may play a role in intelligibility.
  • Previous research has not fully explored the impact of specific spatial frequency bands.

Purpose of the Study:

  • To investigate the contribution of different spatial frequency bands to audiovisual speech perception.
  • To determine the optimal spatial frequency range for enhancing speech intelligibility.
  • To assess whether high spatial resolution is necessary for effective audiovisual speech processing.

Main Methods:

  • Subjects performed an audiovisual speech-in-noise task using talker images filtered across various spatial frequencies (2.7 to 44.1 cycles/face).

Related Experiment Videos

  • Three experiments systematically varied filter bands and viewing distance to analyze the use of spatial frequency information.
  • Performance was measured by speech intelligibility scores.

    • Main Results:

    • A broad range of spatial frequencies enhanced auditory intelligibility, with a peak benefit observed in mid-range bands (e.g., 11 cycles/face).
    • The observed pattern of enhancement was independent of viewing distance, supporting interpretation in object spatial frequencies.
    • Low-pass filtered images achieved performance comparable to unfiltered images, indicating high spatial detail is not essential.

    Conclusions:

    • Audiovisual speech perception benefits from a wide spectrum of spatial frequencies, not just high-resolution details.
    • A limited range of spatial frequencies within the visual speech signal is sufficient for significant intelligibility enhancement.
    • These findings refine our understanding of the visual information critical for robust speech perception in challenging acoustic environments.