Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Local online learning of coherent information.

Ralf Der1, Darragh Smyth

  • 1Universität Leipzig, Institut für Informatik, Postfach 920, Leipzig, Germany

Neural Networks : the Official Journal of the International Neural Network Society
|March 29, 2003
PubMed
Summary

This study introduces a novel framework for unsupervised learning in multi-stream neural networks, enabling systems to detect coherent information across various inputs. The covariance rule proves most effective for learning this cross-stream structure.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Self-Organized Behavior Generation for Musculoskeletal Robots.

Frontiers in neurorobotics·2017
Same author

Novel plasticity rule can explain the development of sensorimotor intelligence.

Proceedings of the National Academy of Sciences of the United States of America·2015
Same author

Information driven self-organization of complex robotic behaviors.

PloS one·2013
Same author

Guided self-organization: perception-action loops of embodied systems.

Theory in biosciences = Theorie in den Biowissenschaften·2011
Same author

Information-driven self-organization: the dynamical system approach to autonomous robot behavior.

Theory in biosciences = Theorie in den Biowissenschaften·2011
Same author

The sparseness of neuronal responses in ferret primary visual cortex.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2009

Area of Science:

  • Computational Neuroscience
  • Machine Learning
  • Artificial Intelligence

Background:

  • Perception requires integrating information across space, time, and sensory modalities.
  • Current unsupervised learning methods often struggle with complex, multi-stream data integration.

Purpose of the Study:

  • To present an abstract framework for local, online, unsupervised learning of coherent information from multi-stream data.
  • To investigate learning rules that maximize predictability between processing units and their context.

Main Methods:

  • Utilized multi-stream neural networks with distinct feedforward and lateral contextual inputs.
  • Explored various local cost functions, including mutual information, relative entropy, squared error, and covariance.
  • Analyzed theoretical and simulation results to evaluate learning rule performance.

Related Experiment Videos

Main Results:

  • The covariance rule uniquely identifies and learns coherent cross-stream information.
  • The covariance rule is robustly approximated by a Hebbian rule and stable against input noise.
  • Demonstrated scalability of all learning rules with an increasing number of data streams.

Conclusions:

  • The proposed framework effectively learns coherent cross-stream structures using unsupervised learning.
  • The covariance rule offers a robust and efficient method for integrating multi-stream information in neural networks.
  • The approach is biologically plausible and scales well for complex systems.