Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Categorization in fully connected multistate neural network models.

R Erichsen1, W K Theumann, D R Dominguez

  • 1Instituto de Física, Universidade Federal do Rio Grande do Sul, Caixa Postal 15051, CEP 91501-970, Porto Alegre, RS, Brazil.

Physical Review. E, Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics
|April 24, 2002
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Geometrical frustration and cluster spin glass with random graphs.

Physical review. E·2021
Same author

Ising spin glass in a random network with a Gaussian random field.

Physical review. E·2021
Same author

Stoma reversal after intended restorative rectal cancer resection in Denmark: nationwide population-based study.

BJS open·2020
Same author

Nationwide population-based cohort study to assess risk of surgery for adhesive small bowel obstruction following open or laparoscopic rectal cancer resection.

BJS open·2018
Same author

Multicritical points and topology-induced inverse transition in the random-field Blume-Capel model in a random network.

Physical review. E·2017
Same author

Pouch failures following ileal pouch-anal anastomosis for ulcerative colitis.

Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland·2017
Same journal

Efficient Monte Carlo simulations using a shuffled nested Weyl sequence random number generator.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics·2002
Same journal

Spatiotemporal dynamics of electromagnetic pulses in saturating nonlinear optical media with normal group velocity dispersion.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics·2002
Same journal

Soliton-breather reaction pathways.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics·2002
Same journal

Calculation of electromagnetic properties of regular and random arrays of metallic and dielectric cylinders.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics·2002
Same journal

Electromagnetic convective cells in a nonuniform dusty plasma.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics·2002
Same journal

Stability of neural networks and solitons of field theory.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics·2002
See all related articles

This study explores neural network categorization using replica symmetric mean-field theory. Networks trained with low-activity examples show improved categorization, robust to noise.

Area of Science:

  • Computational neuroscience
  • Statistical mechanics

Background:

  • Fully connected neural networks are key models in machine learning and neuroscience.
  • Understanding their categorization capabilities is crucial for developing advanced AI and cognitive models.

Purpose of the Study:

  • To investigate the categorization ability of fully connected neural networks with discrete or continuous Q-state units.
  • To analyze the impact of hierarchical pattern embedding and training data characteristics on network performance.

Main Methods:

  • Utilizing replica symmetric mean-field theory to analyze network behavior.
  • Embedding hierarchically correlated multistate patterns (ancestors and descendants) within the network.
  • Deriving explicit results for Q=3 and Q=infinity state models.

Related Experiment Videos

Main Results:

  • Categorization ability significantly improves when networks are trained with low-activity examples.
  • The categorization performance demonstrates robustness against finite threshold and synaptic noise.
  • Phase diagrams and categorization curves were obtained, alongside Almeida-Thouless lines.

Conclusions:

  • Low-activity training data enhances neural network categorization.
  • The studied neural network models exhibit robust categorization abilities.
  • Replica symmetric mean-field theory provides a valid framework for analyzing these systems within specific limits.