基于突触晶体管的神经网络电路的机器学习潜力和局限性的计算调查
Sergei Manzhos1, Qun Gao Chen2, Wen-Ya Lee2
1School of Materials and Chemical Technology, Tokyo Institute of Technology, Ookayama 2-12-1, Meguro-ku, Tokyo 152-8552, Japan.
The journal of physical chemistry letters
|June 28, 2024
概括
突触晶体管提供高效的神经网络 (NN) 电路,但面临着挑战. 计算研究表明,准确性具有竞争力,但对激活功能的不稳定性有很高的敏感性,因此,对于要求高的NN应用程序,需要提高精度.
科学领域:
- 神经形态工程的神经形态工程
- 计算神经科学是一种神经科学.
- 固态电子 固态电子
背景情况:
- 突触晶体管正在探索在神经网络 (NN) 中实现神经元激活功能.
- 这些设备承诺紧,快速和节能的专用NN硬件.
- 然而,与数字NN相比,存在一些局限性,包括激活函数形状约束和模拟电路不稳定性.
研究的目的:
- 通过计算来研究突触晶体管限制对NN性能的影响.
- 评估模拟NN硬件和传统数字实现之间的权衡.
- 确定影响基于突触晶体管NNs的准确性和稳定性的关键因素.
主要方法:
- 利用计算建模来模拟神经网络架构中的突触晶体管行为.
- 分析了激活函数形状变化和模拟电路不稳定性对NN精度的影响.
- 将性能指标与已建立的数字神经网络基准进行比较.
主要成果:
- 在许多应用中实现了具有竞争力的准确性,与传统的NN相美.
- 证明了NN性能对激活函数形状不稳定性的高度敏感性.
- 确定了特定类型的晶体管实现,限制了激活功能的灵活性.
结论:
- 交感晶体管可以在某些任务中实现竞争性的NN性能.
- 高精度要求需要解决对激活功能不稳定性的敏感性.
- 进一步开发高精度突触晶体管电路对于先进的NN应用至关重要.
相关概念视频
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
Network Function of a Circuit
280
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
280
Electrical Synapses
8.3K
Electrical synapses found in all nervous systems play important and unique roles. In these synapses, the presynaptic and postsynaptic membranes are very close together (3.5 nm) and are actually physically connected by channel proteins forming gap junctions.
Gap junctions allow the current to pass directly from one cell to the next. In contrast, in the chemical synapse, the neurotransmitters carry the information through the synaptic cleft from one neuron to the next. They consist of two...
Gap junctions allow the current to pass directly from one cell to the next. In contrast, in the chemical synapse, the neurotransmitters carry the information through the synaptic cleft from one neuron to the next. They consist of two...
8.3K
Neuronal Communication
828
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
828
Postsynaptic Potential (PSP)
2.5K
Postsynaptic potential (PSP) refers to a change in the electrical potential of a neuron when neurotransmitters released by presynaptic neurons bind to postsynaptic receptors. This potential can either be excitatory, leading to depolarization and ultimately action potential generation, or inhibitory, leading to hyperpolarization and suppression of the postsynaptic neuron.
There are two types of receptors: ionotropic and metabotropic.
The ionotropic receptor is the membrane protein that has an...
There are two types of receptors: ionotropic and metabotropic.
The ionotropic receptor is the membrane protein that has an...
2.5K
Integration of Synaptic Events
1.5K
Synaptic integration mainly includes the summation of graded potentials. Graded potentials, regardless of their type, cause subtle alterations in membrane voltage, resulting in either depolarization or hyperpolarization. These incremental changes, when combined or summed, can propel the neuron toward its threshold. Consider, for example, a membrane experiencing a +15 mV shift, causing it to depolarize from -70 mV to -55 mV. In this scenario, graded potentials govern the membrane's ability to...
1.5K


