Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Informational properties of neural nets performing algorithmic and logical tasks

B M Ritz1, G L Hofacker

  • 1Department of Computer Science and Engineering, University of California, San Diego, La Jolla 92093-0114, USA.

Biological Cybernetics
|June 1, 1996
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Concurrent neutral evolution of mRNA secondary structures and encoded proteins.

Journal of molecular evolution·2001
Same author

Complementary coding conforms to the primeval comma-less code.

Journal of theoretical biology·1995
Same author

Neutral adaptation of the genetic code to double-strand coding.

Journal of molecular evolution·1993
Same author

Stochastic traits of molecular evolution--acceptance of point mutations in native actin genes.

Journal of theoretical biology·1990
Same author

An ESS-analysis for ensembles of prisoner's dilemma strategies.

Journal of theoretical biology·1990
Same author

Point mutations as an optimal search process in biological evolution.

Journal of theoretical biology·1987

This study links genetic information to neural network computation by relating it to Turing machine entropy. It demonstrates how neural networks can learn complex logic using error back-propagation, bridging biological and algorithmic systems.

Area of Science:

  • Computational neuroscience
  • Theoretical computer science
  • Information theory

Background:

  • Biological neural networks exhibit complex computational capabilities.
  • Algorithmic approaches, like Turing machines, provide a framework for understanding computation.
  • The relationship between genetic encoding and neural processing remains an area of active research.

Purpose of the Study:

  • To propose that genetic information for algorithmic neural processors is encoded by the entropy of minimal Turing machines.
  • To construct a near-minimal Turing machine capable of bivalent propositional logic.
  • To demonstrate that neural networks can compute propositional logic and be trained via error back-propagation.

Main Methods:

  • Construction of a near-minimal Turing machine for n-variable bivalent propositional logic.

Related Experiment Videos

  • Development of neural network models to perform the same logical tasks.
  • Utilizing informational entropy to compare neural nets and Turing machines.
  • Applying error back-propagation for training neural networks.

    • Main Results:

    • The informational entropy of analogous Turing machines represents the genetic information for algorithmic neural processors.
    • Neural networks were shown to compute propositional logic.
    • A direct correlation between the entropy of neural nets and their analogous Turing machines was established.
    • Single-hidden-layer neural networks successfully learned logic algorithms through error back-propagation.

    Conclusions:

    • Genetic information for tutoring biological neural nets can be understood through Turing machine entropy.
    • Neural networks are capable of implementing complex logical algorithms.
    • Error back-propagation is an effective training method for neural networks performing logical computations.