Related Experiment Videos
Incremental communication for adaptive resonance theory networks
Ming Chen1, Ali A Ghorbani, Virendrakumar C Bhavsar
1Faculty of Computer Science, University of New Brunswick, Fredericton, NB, E3B 5A3, Canada.
IEEE Transactions on Neural Networks
|March 1, 2005
Summary
Limited precision incremental communication in artificial neural networks (ANNs) significantly reduces costs. This method, applied to adaptive resonance theory 2 (ART2) networks, maintains performance with 7-13-bit precision, enabling efficient VLSI implementation.
Area of Science:
- Artificial Intelligence
- Computational Neuroscience
- Computer Engineering
Background:
- Artificial neural networks (ANNs) face challenges with high communication costs and learning times.
- Incremental internode communication methods have been proposed to optimize ANN performance.
- Adaptive Resonance Theory 2 (ART2) networks are a class of recurrent neural networks requiring efficient communication strategies.
Purpose of the Study:
- To investigate the application of a limited precision incremental communication method to ART2 networks.
- To evaluate the impact of this method on the convergence behavior and performance of ART2 networks.
- To determine the optimal precision level for incremental communication in ART2 networks.
Main Methods:
- Simulation studies were conducted to analyze the convergence of ART2 networks using the limited precision incremental communication method.
- Theoretical error analysis was performed to understand the effects of limited precision on network performance.
- Comparisons were made between results obtained with limited precision (7-13 bits) and full precision (32 bits).
Main Results:
- Limited precision incremental communication (7-13 bits) yields results comparable to full precision (32 bits) in ART2 networks.
- Simulation and analytical results demonstrate that limited precision errors are bounded and do not significantly impair network convergence.
- The proposed method effectively reduces communication costs and learning time without compromising accuracy.
Conclusions:
- The limited precision incremental communication method is suitable for ART2 networks.
- This approach enables efficient parallel and specialized Very Large Scale Integration (VLSI) implementations of ART2 networks.
- The findings support the integration of incremental communication for optimizing the performance and hardware realization of ART2 networks.