单个神经形态记忆器密切模拟了节能神经网络的多个突触机制
Christoph Weilenmann1, Alexandros Nikolaos Ziogas2, Till Zellweger2
1Integrated Systems Laboratory, ETH Zurich, Zurich, Switzerland. weilenmc@iis.ee.ethz.ch.
Nature communications
|August 13, 2024
概括
新的记忆性纳米设备模拟复杂的突触功能,使生物灵感深度神经网络 (DNN) 能够更快地学习并使用更少的能量. 这一突破推动了神经形态计算和人工智能 (AI) 应用.
科学领域:
- 神经形态工程的神经形态工程
- 材料科学 材料科学 材料科学
- 人工智能的人工智能
背景情况:
- 生物突触具有超越记忆和重量增殖的复杂功能,包括短期可塑性和超可塑性.
- 人工神经网络 (ANN) 通常仅模拟长期记忆和重量乘法.
- 在硬件中模拟复杂的突触功能对于推进神经形态计算至关重要.
研究的目的:
- 为了展示能够模拟多个生物突触功能的memristive纳米设备.
- 将这些多功能记忆器集成到生物灵感深度神经网络 (DNN) 中.
- 在强化学习任务中评估这些DNN的性能和能源效率.
主要方法:
- 制造基于酸 (SrTiO3) 的记忆性纳米设备,在非丝状,低导电状态下运行.
- 开发生物启发的DNN,结合模拟长期记忆,短期记忆,短期可塑性和超可塑性的memristor.
- 训练DNN玩Atari Pong电子游戏,这是一个动态强化学习任务.
主要成果:
- 记忆装置成功模拟了所有目标复杂的突触功能.
- 生物启发的DNN证明了稳定和节能运行.
- 与同一个任务的GPU实现相比,能源消耗减少了大约两个数量级.
结论:
- 记忆器件可以有效模拟复杂的突触功能,为先进的神经形态硬件铺平道路.
- 这些多功能硬件突触显著提高了DNN的能源效率.
- 这项研究扩大了神经形态计算的适用性,并提高了AI性能和能源成本.
相关概念视频
01:25Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
01:35Long-term Potentiation
55.0K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
55.0K
01:01Neuroplasticity
315
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
315
01:23Role of Neurotransmitters in Memory
492
Neurotransmitters are integral to the brain's communication system, enabling neurons to transmit signals across synapses. This chemical exchange underpins various cognitive functions, including memory processes. The role of neurotransmitters in memory is multifaceted, influencing the encoding, consolidation, and retrieval of memories through their action on different neural circuits.
Glutamate and Synaptic Plasticity
Glutamate, the brain's main excitatory neurotransmitter, is...
Glutamate and Synaptic Plasticity
Glutamate, the brain's main excitatory neurotransmitter, is...
492
01:28Integration of Synaptic Events
1.5K
Synaptic integration mainly includes the summation of graded potentials. Graded potentials, regardless of their type, cause subtle alterations in membrane voltage, resulting in either depolarization or hyperpolarization. These incremental changes, when combined or summed, can propel the neuron toward its threshold. Consider, for example, a membrane experiencing a +15 mV shift, causing it to depolarize from -70 mV to -55 mV. In this scenario, graded potentials govern the membrane's ability to...
1.5K
01:28Neuronal Communication
816
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
816