Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Event based self-supervised temporal integration for multimodal sensor data.

Emilia I Barakova1, Tino Lourens

  • 1RIKEN Brain Science Institute, 2-1 Horosawa, Wako-shi, Saitama 351-0198, Japan. emilia@brain.riken.jp

Journal of Integrative Neuroscience
|July 1, 2005
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Personalizing HRI in Musical Instrument Practicing: The Influence of Robot Roles (Evaluative <i>Versus</i> Nonevaluative) on the Child's Motivation for Children in Different Learning Stages.

Frontiers in robotics and AI·2021
Same author

Pivotal Response Treatment with and without robot-assistance for children with autism: a randomized controlled trial.

European child & adolescent psychiatry·2021
Same author

Effects of Robot Facial Characteristics and Gender in Persuasive Human-Robot Interaction.

Frontiers in robotics and AI·2021
Same author

Robot-mediated therapy to reduce worrying in persons with visual and intellectual disabilities.

Journal of applied research in intellectual disabilities : JARID·2020
Same author

Self-initiations in young children with autism during Pivotal Response Treatment with and without robot assistance.

Autism : the international journal of research and practice·2020
Same author

Effects of the Level of Interactivity of a Social Robot and the Response of the Augmented Reality Display in Contextual Interactions of People with Dementia.

Sensors (Basel, Switzerland)·2020
Same journal

Metabolic Brain Network Reorganization in Temporal Lobe Epilepsy With Aware or Impaired Awareness Seizures.

Journal of integrative neuroscience·2026
Same journal

Longitudinal Reorganization of Local Brain Activity Following Acute Basal Ganglia Infarction: Combined Metrics of Amplitude and Dynamics Reveal Neural Substrates Underlying Motor Recovery.

Journal of integrative neuroscience·2026
Same journal

The Neuroprotective Role of a Caspase-1 Inhibitor Against Apoptosis via Inhibition of Glial Hyperactivation in a Mouse Model of Epilepsy.

Journal of integrative neuroscience·2026
Same journal

Understanding Sleep and Memory in the Avian Brain.

Journal of integrative neuroscience·2026
Same journal

Tea Polyphenols Protect the Blood-Brain Barrier Structure in the Hippocampus of Early Diabetic Mice by Inhibiting the AGEs-RAGE Pathway.

Journal of integrative neuroscience·2026
Same journal

Single-Cell and Integrative Analyses Uncover Therapeutic Potential of RFX1-Mediated Cuproptosis in PitNETs.

Journal of integrative neuroscience·2026
See all related articles

This study introduces a novel self-supervised learning method for synergistic integration of multimodal sensor data. The approach enhances robot navigation by effectively fusing sensory information over time.

Area of Science:

  • Robotics
  • Artificial Intelligence
  • Computer Vision

Background:

  • Multimodal sensor data integration is crucial for complex tasks like robot navigation.
  • Existing methods often struggle with fusing information from diverse sensors dynamically.
  • Understanding temporal relationships between sensory inputs is key for robust perception.

Purpose of the Study:

  • To propose a novel method for synergistic integration of multimodal sensor data.
  • To develop a self-supervised learning approach for combining sensory representations.
  • To address the temporal dynamics of information fusion in perception.

Main Methods:

  • A self-supervised learning framework inspired by psychophysical experiments.
  • An event-based temporal co-occurrence principle for information fusion.

Related Experiment Videos

  • Application and simulation on a mobile robot navigating unfamiliar environments.

    • Main Results:

    • Synergistic integration significantly improved route recognition, especially with similar perceptions.
    • A perceptual hierarchy of instant movement knowledge was vital for short-term navigation.
    • Visual perceptions demonstrated a greater impact on long-term navigation intervals.

    Conclusions:

    • The proposed method effectively achieves synergistic integration of multimodal sensor data.
    • Temporal co-occurrence and self-supervised learning are key for dynamic information fusion.
    • The findings highlight the importance of hierarchical and temporally-aware perception for robot navigation.