增强量子化memristor神经网络的现场更新:一个语网络学习方法
Jinpei Tan1,2, Fengyun Zhang1, Jiening Wu1,2
1College of Artificial Intelligence, Southwest University, Chongqing, 400715 China.
Cognitive neurodynamics
|November 13, 2024
概括
这项研究介绍了一个罗网络用于训练memristor神经网络,显著减少重量更新,并提高对大脑启发的计算的能源效率. 该方法提高了设备的耐用性和识别精度.
科学领域:
- 神经形态工程的神经形态工程
- 材料科学 材料科学 材料科学
- 计算机科学 计算机科学
背景情况:
- 传统计算面临能源和速度限制,引发了对大脑启发的神经形态计算的兴趣.
- 记忆器为内存计算提供非挥发性特性,模仿大脑突触,但面临着非线性和设备变化的挑战.
- 记忆性设备中的重量重复更新会影响准确性,延迟和能耗,从而带来耐力挑战.
研究的目的:
- 优化训练多层次的memristor神经网络,使用语网络学习方法.
- 为了解决突触重量更新的记忆器件中的不准确性,非线性和耐久性问题.
- 为了减少能源消耗和延迟,同时提高memristive计算系统的耐用性.
主要方法:
- 用一个语网络方法来训练memristor神经网络.
- 在memristor网络中的神经推断检测到错误和噪音,而软件中则发生了梯度计算.
- 使用重量量化,稀疏更新策略,梯度积累和错误补偿来改进重量更新.
主要成果:
- 拟议的方法在使用MLP和CNN模型的MNIST数据集识别任务上显示了快速趋同.
- 在单个时代内,超过98%的memristor导电量权重的重量更新被消除.
- 与基本的闭环更新方法相比,能源消耗和时间延迟减少了98%以上.
结论:
- 语网络学习方法有效地优化了memristor神经网络的训练.
- 重量更新的显著减少提高了memristive设备的耐用性和性能.
- 这种方法为节能和高性能神经形态计算系统提供了可行的解决方案.
相关概念视频
Long-term Potentiation
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Long-term Potentiation
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when presynaptic neurons...
Hebbian LTP
LTP can occur when presynaptic neurons...
Neural Circuits
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal Communication
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
Neuroplasticity
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.


