Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study.

Sophie Molholm1, Walter Ritter, Daniel C Javitt

  • 1Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan S. Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA.

Cerebral Cortex (New York, N.Y. : 1991)
|March 19, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Serotonin type 3 receptor (5-HT<sub>3</sub>R) antagonists for negative symptoms and cognitive impairment associated with schizophrenia: a systematic review and meta-analysis.

Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology·2026
Same author

Opposite sides of different coins: near-diametrical opposition of physiological indices of reduced accuracy of face emotion recognition in schizophrenia and autism spectrum disorders.

Frontiers in neuroimaging·2026
Same author

Baseline Mismatch Negativity Amplitude Predicts Direction and Magnitude of Ketamine Effect in Healthy Volunteers: A Disordinal Effect.

Biological psychiatry·2026
Same author

Virtual Neuronavigation for Parcel-guided TMS.

medRxiv : the preprint server for health sciences·2025
Same author

Effect Size Deflation With Increasing Sample Size in Adjunctive Trials for Negative Symptoms in Schizophrenia: A Meta-Analysis and Meta-Regression Across Mechanisms of Action.

The American journal of psychiatry·2025
Same author

Disturbances in Auditory and Visual Perceptual Function in Schizophrenia: Patterns, Causes, and Consequences.

Current topics in behavioral neurosciences·2025
Same journal

Differentiation of cortical areas: effects of free energy minimization with broken symmetry.

Cerebral cortex (New York, N.Y. : 1991)·2026
Same journal

Prior exposure to speech rapidly modulates cortical processing of high-level linguistic structure.

Cerebral cortex (New York, N.Y. : 1991)·2026
Same journal

Beta bursts in SMA mediate anticipatory muscle inhibition.

Cerebral cortex (New York, N.Y. : 1991)·2026
Same journal

Cognitive load modulates the effects of social contexts on facial expression processing.

Cerebral cortex (New York, N.Y. : 1991)·2026
Same journal

The neural mechanisms of aligning spatial perspectives.

Cerebral cortex (New York, N.Y. : 1991)·2026
Same journal

Relationships between bilateral tapping skills and brain gray matter volumes: a voxel-based morphometry study.

Cerebral cortex (New York, N.Y. : 1991)·2026
See all related articles

Combining visual and auditory animal cues enhances object recognition speed and accuracy. This multisensory integration occurs early in visual processing, impacting the N1 component in the occipito-temporal cortex.

Area of Science:

  • Cognitive Neuroscience
  • Neuroscience
  • Sensory Processing

Background:

  • Object recognition typically relies on single sensory modalities.
  • The role of multisensory integration in early visual processing stages is not fully understood.
  • Investigating how auditory information influences visual object identification is crucial.

Purpose of the Study:

  • To investigate multisensory object-recognition processes by combining visual and auditory animal stimuli.
  • To determine if matched auditory and visual inputs improve object identification accuracy and speed.
  • To explore the neural underpinnings of multisensory integration in early visual cortex.

Main Methods:

  • Behavioral experiments measuring identification accuracy and reaction time for matched and unmatched visual and auditory stimuli.

Related Experiment Videos

  • High-density electroencephalography (EEG) recording to capture evoked potentials.
  • Topographic mapping and dipole modeling to localize neural generators of multisensory effects.

    • Main Results:

    • Subjects showed significantly faster and more accurate identification of animals when presented with matched pictures and vocalizations compared to unisensory stimuli.
    • A modulation of the visual evoked N1 component was observed, linked to early visual feature processing.
    • EEG analysis indicated that auditory input modulates activity in lateral occipito-temporal cortices, traditionally considered unisensory visual areas.
    • Attention-dependent visual selection negativity was also modulated by multisensory inputs.

    Conclusions:

    • Multisensory integration significantly enhances object recognition performance.
    • Auditory stimuli can modulate neural processing in early visual cortical areas, challenging traditional views of unisensory processing.
    • These findings suggest that multisensory interactions occur early in the visual object recognition pathway.