在一个随机连接的神经网络中,对激活和学习值的步骤控制同步,朝着硬件实现的硬件实现
Kumiko Nomura1, Yoshifumi Nishi1
1Frontier Research Laboratory, Corporate Research and Development Center, Toshiba Corporation, Kawasaki, Japan.
Frontiers in neuroscience
|November 28, 2024
概括
本研究介绍了自组织机制,内在可塑性 (IP) 和突触可塑性 (SP),用于尖端神经网络 (SNN) 来改善时间数据处理. 拟议的模型提高了SNN在异常检测等任务中的性能,实现了完美的准确性.
科学领域:
- 神经形态工程的神经形态工程
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
背景情况:
- 尖端神经网络 (SNN) 为基于边缘的时间数据处理提供了低功耗解决方案.
- 在SNN中随机的网络架构可能会导致性能降低.
- 像内在可塑性 (IP) 和突触可塑性 (SP) 这样的自我组织机制对于缓解SNN性能问题至关重要.
研究的目的:
- 在尖端神经网络 (SNN) 中提出内在可塑性 (IP) 和突触可塑性 (SP) 的硬件导向模型.
- 为了提高随机连接的SNNs的稳定性和性能,用于时间数据处理.
- 在现实应用中证明拟议的IP和SP模型的有效性.
主要方法:
- 在刺激神经元中实施了IP的可变触发值,逐步根据神经元活动进行调整.
- 定义了SP的活动依赖值,以控制在前突触尖峰时的逐步突触更新.
- 模拟时间数据学习和异常检测,使用电心电图 (ECG) 数据上的提议IP和SP模型的尖端RNN.
主要成果:
- 与拟议的IP和SP模型集成的尖端RNN实现了100%的异常检测真正率.
- 通过实施的IP和SP模型,假阳性率被成功抑制到0%.
- 观察到,值和突触权重可以通过适当的RNN架构设计进行二元化,从而最大限度地降低电路复杂性.
结论:
- 拟议的面向硬件的IP和SP模型显著提高了用于时间数据处理的尖端神经网络的性能和稳定性.
- 这些模型能够在心电图数据中高精度检测异常,性能优于标准SNN.
- 重量和值的二元化是可行的,导致更高效和紧的神经形态硬件实现.
相关概念视频
Open and closed-loop control systems
642
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
642
Transfer Function in Control Systems
352
The transfer function is a fundamental concept in the analysis and design of linear time-invariant (LTI) systems. It offers a concise way to understand how a system responds to different inputs in the frequency domain. It serves as a bridge between the time-domain differential equations that describe system dynamics and the frequency-domain representation that facilitates easier manipulation and analysis.
To derive the transfer function, consider a general nth-order linear time-invariant...
To derive the transfer function, consider a general nth-order linear time-invariant...
352
Propagation of Action Potentials
5.3K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
5.3K
Simplified Synchronous Machine Model
183
The Synchronous Machine Model is a fundamental tool in analyzing and ensuring the transient stability of power systems. This model simplifies the representation of a synchronous machine under balanced three-phase positive-sequence conditions, assuming constant excitation and ignoring losses and saturation. The model is pivotal for understanding the behavior of synchronous generators connected to a power grid, particularly during transient events.
In this model, each generator is connected to a...
In this model, each generator is connected to a...
183
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
State Space to Transfer Function
174
The conversion of state-space representation to a transfer function is a fundamental process in system analysis. It provides a method for transitioning from a time-domain description to a frequency-domain representation, which is crucial for simplifying the analysis and design of control systems.
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:
174


