Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

The relationship of local context codes to sequence length memory capacity.

W B Levy1, X Wu

  • 1Department of Neurological Surgery, University of Virginia Health Sciences Center, Box 420, Charlottesville, VA 22908, USA.

Network (Bristol, England)
|May 1, 1996
PubMed
Summary

This study explores neural networks for sequence prediction, finding a simple relationship between memory capacity and neuron activity. This confirms a key limitation in adaptive neural models for learning and memory.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The formation of neural codes in the hippocampus: trace conditioning as a prototypical paradigm for studying the random recoding hypothesis.

Biological cybernetics·2005
Same author

Estradiol increases delayed, N-methyl-D-aspartate receptor-mediated excitation in the hippocampal CA1 region.

Neuroscience·2004
Same author

Quantal synaptic failures enhance performance in a minimal hippocampal model.

Network (Bristol, England)·2004
Same author

Initial state randomness improves sequence learning in a model hippocampal network.

Physical review. E, Statistical, nonlinear, and soft matter physics·2002
Same author

A model of hippocampal activity in trace conditioning: where's the trace?

Behavioral neuroscience·2002
Same author

Relational learning with and without awareness: transitive inference using nonverbal stimuli in humans.

Memory & cognition·2001

Area of Science:

  • Computational neuroscience
  • Neural network theory

Background:

  • Hippocampal CA3 networks are crucial for memory.
  • Understanding sequence prediction in neural networks is ongoing.
  • Local context neuron encodings are a key mechanism.

Purpose of the Study:

  • To develop a theoretical understanding of sequence prediction networks using local context neuron encodings.
  • To analyze a neural network model of hippocampal CA3.
  • To establish relationships between network parameters and memory capacity.

Main Methods:

  • Developing general expressions for CA3 interpattern distances.
  • Relating these distances to sequence length memory capacity.
  • Verifying theoretical findings through computer simulations.

Related Experiment Videos

Main Results:

  • A simple relationship was confirmed between sequence length memory capacity and average activity level/local context lifetimes.
  • Sequence length memory capacity is bounded in networks with local context neuronal codes.
  • The theory quantifies a limitation in fully adaptive neural models.

Conclusions:

  • The study provides a theoretical framework for understanding memory capacity in sequence prediction networks.
  • Local context neuronal codes impose fundamental limitations on adaptive learning and memory.
  • This work contributes to the theory of self-supervising neural models.