Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Many-body approach to the dynamics of batch learning

Wong1, Li, Tong

  • 1Department of Physics, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong.

Physical Review. E, Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics
|November 23, 2000
PubMed
Summary

This study models batch learning dynamics using cavity and diagrammatic methods, accounting for temporal correlations from data recycling. The findings are applicable to general learning cost functions and illustrated with the Adaline rule.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Vibrational Spectra of Tetrahedral Fullerenes.

Journal of molecular spectroscopy·1999
Same author

Double-Resonance Spectroscopic Studies of Core-Penetrating Rydberg States of CaCl.

Journal of molecular spectroscopy·1999
Same author

The Predissociation Mechanism for 2Sigma+ Rydberg States of CaCl.

Journal of molecular spectroscopy·1999
Same author

Comparative Studies of Carbon Blacks by Thermogravimetry and Nitrogen Adsorption.

Journal of colloid and interface science·1999
Same author

Conversion of supramolecular clusters to macromolecular objects

Science (New York, N.Y.)·1999
Same author

Nanocrystalline Silver Particles: Synthesis, Agglomeration, and Sputtering Induced by Electron Beam.

Journal of colloid and interface science·1999

Area of Science:

  • Machine Learning
  • Statistical Physics

Background:

  • Batch learning is crucial for many AI applications.
  • Temporal correlations in data can significantly impact learning efficiency.
  • Existing models often simplify or ignore these correlations.

Purpose of the Study:

  • To develop a theoretical framework for modeling batch learning dynamics.
  • To incorporate temporal correlations arising from data recycling.
  • To analyze the impact of these correlations on learning performance.

Main Methods:

  • Cavity method for analyzing disordered systems.
  • Diagrammatic techniques for representing and summing complex series.
  • Application to the Adaline learning rule.

Related Experiment Videos

Main Results:

  • The model captures the influence of temporal correlations on learning dynamics.
  • Analytical predictions align with expected learning behavior.
  • Demonstrates the utility of the cavity method in this context.

Conclusions:

  • The cavity and diagrammatic methods provide a powerful tool for analyzing batch learning with correlated data.
  • Understanding temporal correlations is key to optimizing learning algorithms.
  • The approach offers insights into the behavior of adaptive linear neuron (Adaline) models.