Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks

Area of Science:

• Neuromorphic Engineering
• Materials Science
• Computational Neuroscience

Background:

• Physical neuromorphic computing leverages complex physical system dynamics for advanced computation.
• Current physical reservoir computing is limited by single-system reliance, restricting output dimensionality and task performance.
• Nanomagnetic systems offer potential for novel neuromorphic architectures.

Purpose of the Study:

• To overcome limitations of single-system physical reservoir computing.
• To engineer a multilayer neural network architecture using nanomagnetic arrays.
• To enhance computational performance, dimensionality, and dynamic range for broader task applicability.

Main Methods:

• Engineered a suite of nanomagnetic array physical reservoirs.
• Interconnected reservoirs in parallel and series to form a multilayer network.
• Implemented a virtual feedback loop for inter-reservoir data transfer.

Main Results:

• Achieved increased output dimensionality and internal dynamics compared to single reservoirs.
• Demonstrated an overparameterised state in the physical neuromorphic system.
• Showcased strong performance across a wide range of tasks, including few-shot learning.

Conclusions:

• Networked physical reservoirs significantly enhance computational capabilities.
• The engineered system facilitates meta-learning and rapid adaptation for new tasks.
• This approach represents a significant advancement in physical neuromorphic computing.