Related Experiment Video
Updated: Jun 27, 2026
11:18
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
Spiking neurons can learn to solve information bottleneck problems and extract independent components
Stefan Klampfl1, Robert Legenstein, Wolfgang Maass
1Institute for Theoretical Computer Science, Graz University of Technology, A-8010 Graz, Austria. klampfl@igi.tugraz.at
Neural Computation
|November 21, 2008
Summary
This study shows how spiking neurons can learn unsupervisedly to optimize information processing and extract independent components. New learning rules, extending the BCM rule, enable biologically realistic firing rates for neural computation.
Area of Science:
- Computational Neuroscience
- Machine Learning
- Information Theory
Background:
- Independent Component Analysis (ICA) is crucial for sensory processing, reducing redundancy in brain representations.
- Information Bottleneck (IB) method optimizes internal representations by focusing on relevant information.
- Current models lack explanation for how spiking neurons learn ICA or IB.
Purpose of the Study:
- To demonstrate how spiking neurons can learn unsupervisedly to perform both ICA and IB.
- To develop novel learning rules for neural information processing.
Main Methods:
- Utilized stochastically spiking neurons with refractoriness.
- Derived learning rules extending the BCM rule from information optimization principles.
- Ensured biologically realistic firing rates for neurons.
Main Results:
- Showed that spiking neurons can learn to extract independent components.
- Demonstrated that these neurons can perform information bottleneck optimization.
- Developed learning rules that maintain realistic neuronal firing rates.
Conclusions:
- Spiking neurons with refractoriness can learn unsupervisedly to execute ICA and IB.
- The derived learning rules offer a biologically plausible mechanism for neural information processing.
- This work bridges the gap between theoretical information processing strategies and neural implementation.
Related Concept Videos
01:19The Role of Ion Channels in Neuronal Computation
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential.
01:25Neural Circuits
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
01:21Cognitive Learning
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
01:17Ampere-Maxwell's Law: Problem-Solving
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the problem,...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the problem,...
01:24Normal and Tangetial Components: Problem Solving
Consider a man with a mass of 70 kg seated in a chair connected to a pin support through a member BC. If the man maintains an upright position, the task is to determine the horizontal and vertical reactions of the chair on the man when the member makes a 45° angle with the horizontal. At this moment, the man has a speed of 5 m/s, increasing at a rate of 1 m/s².
01:29Problem-Solving
Effective problem-solving consists of two steps: 1. identifying the problem and 2. selecting the appropriate problem-solving strategy (i.e., a plan of action used to find a solution). Humans use four problem-solving strategies: