推进赫比安卷积神经网络的生物学可信性和有效性
Julian Jiménez Nimmo1, Esther Mondragón1
1Artificial Intelligence Research Centre (CitAI), Department of Computer Science, City St George's, University of London, Northampton Square, EC1V 0HBC, London, United Kingdom.
概括
这项研究将Hebbian学习集成到用于图像处理的卷积神经网络 (CNN),实现与反向传播相似的性能. 这种新的架构超越了现有的方法,推进了生物现实的人工智能.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 对于神经网络来说,Hebbian学习提供了一个生物学上可信的反向传播替代方案.
- 目前的CNN通常依赖于反向传播,这是计算密集且生物学上有疑问的.
- 将无监督学习与CNN集成,对于开发更现实的AI至关重要.
研究的目的:
- 开发一个最佳的卷积神经网络 (CNN) 架构,整合Hebbian学习.
- 通过使用生物启发的机制来增强CNN的代表性能力.
- 为了创建一个更具生物可持续性和高效的图像处理模型.
主要方法:
- 系统地探索CNN架构用于Hebbian学习集成.
- 整合了强硬的赢家夺取一切 (WTA) 竞争和高斯横向抑制.
- 在CNN框架内实施Bienenstock-Cooper-Munro (BCM) 学习规则.
主要成果:
- 最优的Hebbian学习CNN在CIFAR-10上实现了75.2%的准确性,与反向传播相匹配.
- 这一表现明显超过了最先进的硬式WTA CNN的10.6%.
- 在MNIST (98%) 和STL-10 (69.5%) 获得了竞争性结果,证据表明学习层次稀疏.
结论:
- 拟议的架构增强了学习表示的性能和通用性.
- 这项工作是朝着创造更具生物现实的人工神经网络迈出的重要一步.
- 赫比语学习与竞争和抑制相结合,为CNN中的图像处理提供了一个强大的替代方案.
相关概念视频
Neural Circuits
1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K
Long-term Potentiation
2.9K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.9K
Convolution Properties II
292
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
292
The Role of Ion Channels in Neuronal Computation
3.3K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.3K
Propagation of Action Potentials
7.1K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
7.1K


