Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Bidirectional grapheme-phoneme activation in a bimodal detection task

T Dijkstra1, U H Frauenfelder, R Schreuder

  • 1Nijmegen Institute for Cognition and Information, University of Nijmegen, The Netherlands.

Journal of Experimental Psychology. Human Perception and Performance
|October 1, 1993
PubMed
Summary

Graphemes and phonemes rapidly and automatically facilitate each other during bimodal processing. This cross-modal activation, but not inhibition, suggests rapid integration of visual and auditory speech information.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Corrigendum: Control and Eradication Programs for Six Cattle Diseases in the Netherlands.

Frontiers in veterinary science·2021
Same author

Control and Eradication Programs for Six Cattle Diseases in the Netherlands.

Frontiers in veterinary science·2021
Same author

Bacterial flora associated with udder cleft dermatitis in Dutch dairy cows.

Journal of dairy science·2020
Same author

Voluntarily reported prescribing, monitoring and medication transfer errors in intensive care units in The Netherlands.

International journal of clinical pharmacy·2020
Same author

Improving the time efficiency of identifying dairy herds with poorer welfare in a population.

Journal of dairy science·2016
Same author

Longitudinal study of udder cleft dermatitis in 5 Dutch dairy cattle herds.

Journal of dairy science·2016

Area of Science:

  • Cognitive Psychology
  • Psycholinguistics
  • Neuroscience of Language

Background:

  • Understanding how humans process information from different sensory modalities (bimodal processing) is crucial for explaining complex cognitive functions like reading.
  • The interaction between visual graphemes (letters) and auditory phonemes (speech sounds) is fundamental to word recognition, yet the precise mechanisms remain debated.

Purpose of the Study:

  • To investigate the mutual activation and inhibition between grapheme and phoneme representations during bimodal processing.
  • To examine the temporal dynamics of cross-modal interactions between visual and auditory speech stimuli.

Main Methods:

  • A divided attention paradigm was employed with Dutch participants.
  • Experiments involved presenting visual and auditory stimuli, either in a single channel or bimodal conditions, with varying degrees of identity and onset asynchrony.

Related Experiment Videos

  • Reaction times to visual and auditory targets were measured to infer processing interactions.

    • Main Results:

    • Rapid and automatic cross-modal facilitation was observed between phoneme and grapheme representations.
    • This facilitation occurred even when visual and auditory stimuli were not nominally identical (e.g., visual 'U' and auditory /a/).
    • Cross-modal inhibition between graphemes and phonemes was not detected under the experimental conditions.

    Conclusions:

    • Grapheme and phoneme representations interact quickly and automatically, supporting a tightly coupled system for bimodal speech processing.
    • The findings suggest that facilitation, rather than inhibition, is the primary mode of rapid interaction between visual and auditory speech units.
    • Current models of bimodal processing and word recognition may need refinement to account for the automatic and rapid nature of cross-modal facilitation.