Related Experiment Videos
Beyond feedforward models trained by backpropagation: a practical training tool for a more efficient universal
Roman Ilin1, Robert Kozma, Paul J Werbos
1Department of Computer Science, University of Memphis, Memphis, TN 38117, USA. rilin@memphis.edu
Abstract:
Cellular simultaneous recurrent neural network (SRN) has been shown to be a function approximator more powerful than the multilayer perceptron (MLP). This means that the complexity of MLP would be prohibitively large for some problems while SRN could realize the desired mapping with acceptable computational constraints. The speed of training of complex recurrent networks is crucial to their successful application. This work improves the previous results by training the network with extended Kalman filter (EKF). We implemented a generic cellular SRN (CSRN) and applied it for solving two challenging problems: 2-D maze navigation and a subset of the connectedness problem. The speed of convergence has been improved by several orders of magnitude in comparison with the earlier results in the case of maze navigation, and superior generalization has been demonstrated in the case of connectedness. The implications of this improvements are discussed.
Related Concept Videos
Linearization and Approximation
Linear Approximations
Multi-input and Multi-variable systems
In the absence of...
Propagation of Uncertainty from Random Error
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Propagation of Uncertainty from Systematic Error