Oscillatory neural network learning for pattern recognition: an on-chip learning perspective and implementation

Area of Science:

• Neuromorphic Computing
• Artificial Intelligence
• Machine Learning

Background:

• Human brain learning is continuous, contrasting with current AI's pre-trained, non-evolutive models.
• AI models face evolving environments and data, necessitating continual learning algorithms.
• Implementing continual learning directly on-chip is a significant challenge.

Purpose of the Study:

• To investigate the implementation of continual learning algorithms on-chip.
• To adapt unsupervised learning rules from Hopfield Neural Networks (HNNs) for Oscillatory Neural Networks (ONNs).
• To propose and validate a digital ONN design for unsupervised on-chip learning.

Main Methods:

• Focus on Oscillatory Neural Networks (ONNs) as a neuromorphic computing paradigm.
• Studied the adaptability of HNN unsupervised learning rules (Hebbian and Storkey) to ONNs.
• Developed a digital ONN architecture for on-chip implementation.

Main Results:

• Demonstrated efficient on-chip learning capabilities of the proposed digital ONN architecture.
• Successfully implemented unsupervised learning using Hebbian and Storkey rules.
• Achieved learning times in the hundreds of microseconds for networks up to 35 digital oscillators.

Conclusions:

• The proposed digital ONN design enables efficient on-chip continual learning.
• This work presents a viable solution for implementing unsupervised learning in neuromorphic systems.
• The findings pave the way for more adaptive and evolutive AI models.