Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Competitive spiking and indirect entropy minimization of rate code: efficient search for hidden components.

Botond Szatmáry1, Barnabás Póczos, András Lorincz

  • 1Department of Information Systems, Faculty of Informatics, Eötvös Loránd University, Pázmány Péter sétány 1/C., Budapest, Hungary.

Journal of Physiology, Paris
|November 18, 2005
PubMed
Summary

This study introduces a novel neural network architecture for efficient structure searching, inspired by brain component-based representations. It effectively reduces search spaces and aids in discovering and sorting components, overcoming combinatorial challenges.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

SenSet defines cell-type specific senescence signatures in the aged human lung.

The EMBO journal·2026
Same author

Bayesian machine learning for inverse design of ultra-high-performance concrete.

Philosophical transactions. Series A, Mathematical, physical, and engineering sciences·2025
Same author

SenSet, a novel human lung senescence cell gene signature, identifies cell-specific senescence mechanisms.

bioRxiv : the preprint server for biology·2025
Same author

Recovering time-varying networks from single-cell data.

Bioinformatics (Oxford, England)·2025
Same author

Diffusion Models in De Novo Drug Design.

Journal of chemical information and modeling·2024
Same author

BlinkLinMulT: Transformer-Based Eye Blink Detection.

Journal of imaging·2023

Area of Science:

  • Computational Neuroscience
  • Artificial Intelligence
  • Machine Learning

Background:

  • The brain utilizes component-based representations, motivating the search for similar neural methods.
  • Efficiently searching for complex structures in data remains a challenge in AI and neuroscience.

Purpose of the Study:

  • To develop a neural architecture capable of efficiently searching for and identifying component-based structures.
  • To leverage psychological and physiological evidence of brain representations for computational models.

Main Methods:

  • An architecture of coupled, parallel reconstruction subnetworks was designed.
  • Non-negativity constraints were applied to generative weights and internal representations.
  • A novel tuning method dynamically adjusted learning rates based on spike rate entropy, combined with stochastic gradient search.

Related Experiment Videos

Main Results:

  • Individual subnetworks demonstrated the ability to develop localized and oriented components.
  • Coupled networks successfully discovered and sorted components, addressing combinatorial explosion.
  • The dynamic learning rate adjustment facilitated escape from local minima and reduced search space.

Conclusions:

  • The proposed neural architecture offers an efficient method for structure searching and component discovery.
  • The synergy between spike and rate coding in neural networks is a promising area for future research.
  • This approach provides insights into biologically plausible mechanisms for representation learning.