Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A general weight matrix formulation using optimal control.

O Farotimi1, A Dembo, T Kailath

  • 1Inf. Syst. Lab., Stanford Univ., CA.

IEEE Transactions on Neural Networks
|January 1, 1991
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Eigenstructure approach to directions-of-arrival estimation in IR detector arrays.

Applied optics·2010
Same author

Climate change and the integrity of science.

Science (New York, N.Y.)·2010
Same author

Depth of focus and the moment expansion.

Optics letters·2009
Same author

Estimation of multiple 2-D uniform motions by SLIDE: subspace-based line detection.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2008
Same author

A randomized trial of standard versus partially hyperfractionated radiation with or without concurrent 5-fluorouracil in locally advanced cervical cancer.

Gynecologic oncology·1998
Same author

X-ray small angle scattering study of chromatin as a function of fiber length.

Molecular biology reports·1998
Same journal

Universal perceptron and DNA-like learning algorithm for binary neural networks: LSBF and PBF implementations.

IEEE transactions on neural networks·2013
Same journal

Guest editorial: special section on white box nonlinear prediction models.

IEEE transactions on neural networks·2011
Same journal

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.

IEEE transactions on neural networks·2011
Same journal

Guest editorial: special section on data-based control, modeling, and optimization.

IEEE transactions on neural networks·2011
Same journal

Neural network-based multiple robot simultaneous localization and mapping.

IEEE transactions on neural networks·2011
Same journal

Data-driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems.

IEEE transactions on neural networks·2011
See all related articles

Optimal control theory provides general forms for neural network weights by encoding tasks in a performance index. This approach unifies various weight rules, offering a new perspective on neural network learning and applications.

Area of Science:

  • Computational Neuroscience
  • Machine Learning
  • Control Theory

Background:

  • Neural network weight determination is crucial for learning and application.
  • Existing methods like outer product rule and recurrent back-propagation have limitations.
  • Optimal control theory offers a powerful framework for dynamic system optimization.

Purpose of the Study:

  • To derive general forms for neural network weights using optimal control theory.
  • To demonstrate how different performance index structures lead to various weight update rules.
  • To compare the proposed method with existing techniques.

Main Methods:

  • Application of classical optimal control theory to neural network weight derivation.
  • Formulation of the learning or application task within a generalized performance index.

Related Experiment Videos

  • Comparative analysis against outer product rule, spectral methods, and recurrent back-propagation.
  • Main Results:

    • General forms for neural network weights derived from optimal control principles.
    • Demonstration that common weight rules emerge as special cases of the general framework.
    • Simulation results validating the derived weight rules and their performance.

    Conclusions:

    • Optimal control theory provides a unified and generalizable framework for deriving neural network weight update rules.
    • The proposed method offers a systematic way to develop and understand various learning algorithms.
    • This approach has the potential to advance the design and application of neural networks.