Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Stable dynamic backpropagation learning in recurrent neural networks.

L Jin1, M M Gupta

  • 1Microelectronics Group, Lucent Technologies Inc., Allentown, PA 18103, USA.

IEEE Transactions on Neural Networks
|February 7, 2008
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Polymorphisms in the interleukin 3 gene show strong association with susceptibility to Graves' disease in Chinese population.

Genes and immunity·2009
Same author

A common variant in the FTO gene is associated with obesity in the Uyghur population.

Journal of endocrinological investigation·2009
Same author

Rat model of reperfused partial liver infarction: characterization with multiparametric magnetic resonance imaging, microangiography, and histomorphology.

Acta radiologica (Stockholm, Sweden : 1987)·2009
Same author

Biofilm lifestyle of Candida: a mini review.

Oral diseases·2008
Same author

Dosimetric advantages of IMPT over IMRT for laser-accelerated proton beams.

Physics in medicine and biology·2008
Same author

Human thyroid tumours, the puzzling lessons from E7 and RET/PTC3 transgenic mice.

British journal of cancer·2008
Same journal

Universal perceptron and DNA-like learning algorithm for binary neural networks: LSBF and PBF implementations.

IEEE transactions on neural networks·2013
Same journal

Guest editorial: special section on white box nonlinear prediction models.

IEEE transactions on neural networks·2011
Same journal

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.

IEEE transactions on neural networks·2011
Same journal

Guest editorial: special section on data-based control, modeling, and optimization.

IEEE transactions on neural networks·2011
Same journal

Neural network-based multiple robot simultaneous localization and mapping.

IEEE transactions on neural networks·2011
Same journal

Data-driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems.

IEEE transactions on neural networks·2011
See all related articles

This study introduces novel algorithms to ensure stable dynamic neural network learning. The multiplier and constrained learning rate methods enhance dynamic backpropagation (DBP) for reliable pattern storage.

Area of Science:

  • Computational Neuroscience
  • Machine Learning
  • Artificial Intelligence

Background:

  • Conventional dynamic backpropagation (DBP) algorithms may lead to unstable dynamic neural models during weight learning.
  • Assessing equilibrium point stability often requires post-learning simulation or verification, complicating the learning process.

Purpose of the Study:

  • To develop new learning schemes that guarantee stability during the dynamic weight learning process of neural networks.
  • To address the inherent instability issues associated with traditional DBP algorithms.

Main Methods:

  • Introduction of two novel learning schemes: the multiplier method and the constrained learning rate algorithm.
  • Incorporation of explicit stability conditions into the iterative error index (multiplier method) and dynamic updating of the learning rate (constrained learning rate algorithm).

Related Experiment Videos

  • Development of stable adaptive updating processes for synaptic and somatic parameters.

    • Main Results:

    • The proposed multiplier and constrained learning rate algorithms ensure stable adaptive updating processes for neural network parameters.
    • These stable DBP algorithms enable the implementation of analog target patterns via steady output vectors.
    • Demonstrated applicability through both analog and binary pattern storage examples.

    Conclusions:

    • The novel multiplier and constrained learning rate algorithms effectively overcome the stability limitations of conventional DBP.
    • These methods provide a robust framework for stable dynamic neural network learning and pattern implementation.
    • The research offers practical solutions for reliable dynamic neural network applications.