Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Cross-modal source information and spoken word recognition.

Lorin Lachs1, David B Pisoni

  • 1Department of Psychology, California State University, Fresno, CA, USA. llachs@csufresno.edu

Journal of Experimental Psychology. Human Perception and Performance
|April 1, 2004
PubMed
Summary

This study reveals that preserving spectral and temporal patterns in speech is crucial for matching visual and auditory speaker information. Robust word recognition and cross-modal matching depend on these preserved acoustic properties.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Domains of Psychosocial Risk in School-Aged Cochlear Implant Users.

Journal of speech, language, and hearing research : JSLHR·2026
Same author

The visome: Using cognitive networks to examine lip-reading errors in English words.

The Journal of the Acoustical Society of America·2026
Same author

Signatures of adaptive memory search: How early linguistic input shapes strategic use of lexical information.

Journal of experimental psychology. General·2026
Same author

Elliptical speech reveals the use of broad phonetic categories aids noise-degraded speech perception.

bioRxiv : the preprint server for biology·2026
Same author

Understanding Variability in Long-Term Psychological Adjustment of Prelingually Deaf Young Adults Implanted During Childhood.

Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology·2025
Same author

Evolving perspectives on speech perception assessment in adults with cochlear implants: Are we using the right tests?

Frontiers in neuroscience·2025

Area of Science:

  • Auditory Perception
  • Speech Processing
  • Cross-modal Psychology

Background:

  • Cross-modal matching links auditory and visual speech information.
  • Understanding which acoustic properties convey speaker identity is key.

Purpose of the Study:

  • To investigate acoustic properties of sound conveying cross-modal information.
  • To examine the relationship between cross-modal matching and word recognition.

Main Methods:

  • Participants performed a cross-modal matching task with acoustically transformed speech.
  • Word recognition was assessed under identical acoustic transformations.

Main Results:

  • Cross-modal matching succeeded only when relative spectral and temporal patterns of formant frequencies were preserved.

Related Experiment Videos

  • Successful cross-modal matching correlated with robust word recognition performance.

    • Conclusions:

    • Acoustic and visual speech signals simultaneously convey linguistic content and talker-specific indexical information.
    • Preservation of formant frequency patterns is essential for both speaker recognition and intelligibility.