Analog neural nets with gaussian or other common noise distribution cannot recognize arbitrary regular languages
Related Experiment Videos
1Institute for Theoretical Computer Science, Technische Universität Graz, Klosterwiesgasse 32/2, A-8010, Graz, Austria, maass@igi. tu-graz.ac.at
Abstract:
We consider recurrent analog neural nets where the output of each gate is subject to gaussian noise or any other common noise distribution that is nonzero on a sufficiently large part of the state-space. We show that many regular languages cannot be recognized by networks of this type, and we give a precise characterization of languages that can be recognized. This result implies severe constraints on possibilities for constructing recurrent analog neural nets that are robust against realistic types of analog noise. On the other hand, we present a method for constructing feedforward analog neural nets that are robust with regard to analog noise of this type.
Related Concept Videos
Random Error
Neural Regulation
Propagation of Uncertainty from Random Error
Random Variables
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Neural Circuits
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Gaussian Elimination: Problem Solving