Related Experiment Videos
Cerebellum-inspired neural network of supervised learning with tensor-based sparse coding for multi-class
Runguang Zhou1,2,3, Douglas Zhou1,2,3,4,5, Songting Li1,2,3
1School of Mathematical Sciences, Shanghai Jiao Tong University, Shanghai, China.
None:
Under the Marr-Ito-Albus framework, the cerebellum performs supervised learning in Purkinje cells upon the unsupervised sparse representations generated within granule cells, contributing fundamentally to associative learning in motor control. However, the specific mechanisms through which cerebellar circuitry and plasticity rules enable supervised learning, and properties of the sparse coding induced by cerebellar architectural constraints, remain poorly characterized. To address this, we first established a sparse coding mechanism inspired by anatomical and physiological properties of the granular layer, including input-sharing connectivity from mossy fibers, Golgi-cell-mediated localized feedback inhibition for winner-take-all sparsification, and activity-dependent bias adjustments. This sparse coding, implemented via efficient tensor-based computations, preserves local neighborhood structures as revealed in a geometric interpretation. Furthermore, we demonstrated that error signals transmitted via climbing fibers to Purkinje cells, integrated with intrinsic plasticity, drive efficient learning of the sparse representations for multi-class classification, leading to accurate population coding for judgments in the cerebellar nuclei. The resultant cerebellum-inspired neural network model achieved a test accuracy of 90.50±0.10% on Fashion-MNIST, performance comparable to a backpropagation-trained single-hidden-layer feedforward neural network, while providing more than 5× computational acceleration. The model further exhibited proof-of-principle closed-loop control capability in simplified motor tasks, including balancing a cart-attached pole and controlling a robotic arm to reach targets. Our study delineates cerebellum-inspired sparse coding and supervised learning mechanisms, and demonstrates robust performance of the cerebellum-inspired neural network across multiple task domains. These results suggest that cerebellum-inspired architectures would provide useful design principles for lightweight neural networks in resource-limited and latency-critical applications.
Related Concept Videos
Neural Circuits
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Cerebellum: Anatomical Regions
Cerebellar Structure
Externally, the cerebellum features a highly convoluted surface with numerous folia (narrow ridges) separated by shallow sulci (grooves). The cerebellum is divided into two hemispheres by a thin median structure known as the vermis. The...
Associative Learning
Classical conditioning, also known...
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Spinal Cord: Information Processing
Sensory Information Processing
Sensory information processing begins at the sensory receptors located in the skin and other tissues, which detect somatic sensory stimuli such as touch, temperature, or pain. These receptors function as catalysts, initiating...
Cognitive Learning
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...