Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Multisensory recognition of actively explored objects.

Marc O Ernst1, Fiona N Newell

  • 1Max Planck Institute for Biological Cybernetics, Tübingen, Germany. marc.ernst@tuebingen.mpg.de

Canadian Journal of Experimental Psychology = Revue Canadienne De Psychologie Experimentale
|November 3, 2007
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Crossmodal correspondences influence adaptation during rule-based category learning of objects.

Journal of experimental psychology. Learning, memory, and cognition·2026
Same author

Delivering tactile stimuli via mobile browsers: A method for remote multisensory research.

Behavior research methods·2026
Same author

The role of audiovisual object features and scene context on children's ability to categorise familiar objects.

Journal of experimental child psychology·2026
Same author

Investigating developmental changes in susceptibility to temporal audiovisual illusions on balance and sensorimotor function in children.

Scientific reports·2026
Same author

Visual and tactile motion cues enhance the categorisation of novel object shapes.

Experimental brain research·2026
Same author

Dynamic sensor adaptation based on efferent feedback for adaptive bio-inspired sound source localization.

Frontiers in neuroscience·2026
Same journal

The costs and benefits of mind-wandering: 13 Years on.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Can computational sentiment analysis classify autobiographical memories? Comparing VADER and TextBlob.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Development of enumeration processes for kindergarten children: Evidence from eye-tracking data.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Differential sensitivity to outcome valence reveals two classes of shift behaviour related to exploitation and exploration.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Effects of valence and list composition on memory predictions, performance, and beliefs.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Differential response to cognitive stimulation in moderate versus moderately severe Alzheimer's disease.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
See all related articles

Cross-modal object recognition, comparing vision and touch, shows a performance cost for actively explored objects. This occurs because individuals often focus on a single object view, hindering multisensory matching.

Area of Science:

  • Cognitive Psychology
  • Neuroscience
  • Human-Computer Interaction

Background:

  • Object recognition can be achieved through vision or touch, raising questions about cross-modal information sharing.
  • Previous research indicated efficient cross-modal recognition when object views were matched across senses for fixed objects.
  • Active object exploration (spatially unconstrained) presents unique challenges for multisensory integration.

Purpose of the Study:

  • To investigate cross-modal object recognition for actively explored objects.
  • To compare within-modal versus cross-modal recognition performance in active exploration.
  • To analyze exploration strategies during visual and haptic learning and recognition.

Main Methods:

  • Empirical data collection on multisensory recognition of actively explored objects.

Related Experiment Videos

  • Detailed video analysis of visual and haptic exploration behaviors.
  • Comparison of recognition performance across within-modal and cross-modal conditions.

    • Main Results:

    • A cost in cross-modal recognition performance was observed for actively explored objects compared to within-modal recognition.
    • Analysis revealed imbalanced exploration, with one object view predominantly explored.
    • This skewed exploration strategy, not optimal for cross-modal matching, was identified as the cause of the performance cost.

    Conclusions:

    • Active exploration of objects, while efficient for within-modal recognition, can lead to suboptimal cross-modal recognition.
    • Individuals tend to adopt exploration strategies that constrain object orientation, favoring within-modal performance.
    • Optimal cross-modal object recognition may require balanced exploration across multiple object views.