Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Visual influences on auditory pluck and bow judgments

H M Saldaña1, L D Rosenblum

  • 1University of California, Riverside.

Perception & Psychophysics
|September 1, 1993
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Audiovisual Speech Web-Lab: an Internet teaching and research laboratory.

Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc·2001
Same author

Effects of talker variability on speechreading.

Perception & psychophysics·2001
Same author

Face and mouth inversion effects on visual and audiovisual speech perception.

Journal of experimental psychology. Human perception and performance·2000
Same author

The McGurk effect in infants.

Perception & psychophysics·1997
Same author

Point-light facial displays enhance comprehension of speech in noise.

Journal of speech and hearing research·1996
Same author

An audiovisual test of kinematic primitives for visual speech perception.

Journal of experimental psychology. Human perception and performance·1996

Researchers explored if visual cello sounds influence auditory perception like the McGurk effect. Findings suggest non-speech visual cues can affect auditory judgments, but less so than speech stimuli.

Area of Science:

  • Auditory Perception
  • Audiovisual Integration
  • Speech Science

Background:

  • The McGurk effect demonstrates how visual speech articulatory movements influence auditory speech perception.
  • Investigating audiovisual integration with non-speech stimuli can elucidate the mechanisms underlying perceptual effects.

Purpose of the Study:

  • To determine if a McGurk-like effect exists for non-speech auditory stimuli (cello plucks and bows).
  • To compare the magnitude of visual influence from non-speech stimuli versus speech stimuli.
  • To explore the role of 'ostensive lawful relation' in audiovisual perception.

Main Methods:

  • Experiment 1: Assessed auditory judgments of cello sounds with discrepant visual pluck/bow stimuli.
  • Experiment 2: Compared visual influence on auditory judgments of speech syllables versus cello sounds.

Related Experiment Videos

  • Experiment 3: Tested the influence of visual word stimuli ('pluck', 'bow') on auditory judgments.

    • Main Results:

    • Visual pluck and bow stimuli significantly influenced auditory judgments of cello sounds.
    • Visual influence on speech consonants was significantly greater than on cello sounds.
    • Visual word stimuli ('pluck', 'bow') did not influence auditory judgments of cello sounds.

    Conclusions:

    • Non-speech visual stimuli can influence auditory perception, but the effect differs in magnitude from the McGurk effect in speech.
    • The influence of non-speech visual stimuli may depend on an 'ostensive lawful relation' between the audio and visual information.
    • Results inform theories of speech perception, including motor theory, ecological approaches, and the FLMP model.