浮点近似使得菲茨休-纳古莫神经网络的高成本效益和高精度数字实现成为可能
IEEE transactions on biomedical circuits and systems
|October 25, 2023
概括
本研究介绍了一种新的,具有成本效益的算法,用于在硬件中实现菲茨休-纳古莫 (FHN) 神经元模型. 新方法显著提高了精度,并减少了大规模神经网络模拟的资源开销.
科学领域:
- 神经科学是一个神经科学.
- 计算机工程 计算机工程
- 计算神经科学是一种神经科学.
背景情况:
- 开发大规模的生物神经网络需要神经元模型的高效硬件实现.
- 菲茨休-纳古莫 (FHN) 模型提供了生物可信性,但对于大规模应用而言,它在计算上是复杂的.
研究的目的:
- 提出一个节省成本和高精度的近似算法,用于数字化实现FHN模型.
- 为了减少FHN神经元的硬件实现中的资源开销.
主要方法:
- 将计算数据转换为浮点数,用指数加法取代乘法,并按部分线性曼蒂萨配合.
- 使用转换器和添加器来实现硬件,最大限度地减少资源开销.
- 在FPGA上实施合循环神经网络以证明有效性.
主要成果:
- 实现了FHN神经元实现的最先进状态 (SOTA) 的3.5%的正常化根平均平方误差 (RMSE).
- 与SOTA相比,性能开销比率提高了1.09倍.
- 与近似乘数实现相比,减少了20%的错误,通用成本增加了2.8%.
- 与单个SOTA神经元相比,结合网络的错误减少了60%.
结论:
- 拟议的硬件友好算法使生物可信的神经网络的低成本,高精度硬件模拟成为可能.
- 这种方法为研究大规模神经网络提供了新的视角.
- 使用该算法实现的FHN模型显示了增强的生物特性和减少的部署规模.
相关概念视频
Linear Approximation in Frequency Domain
94
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
94
Linear Approximation in Time Domain
85
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
85
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
57
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
57
Accuracy, limits, and approximation
458
Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
458
Fast Fourier Transform
349
The Fast Fourier Transform (FFT) is a computational algorithm designed to compute the Discrete Fourier Transform (DFT) efficiently. By breaking down the calculations into smaller, manageable sections, the FFT significantly reduces the computational complexity involved. Direct computation of an N-point DFT requires N2 complex multiplications, whereas the FFT algorithm needs only (N/2)log2N multiplications, offering a much faster performance.
The computational efficiency of the FFT becomes...
The computational efficiency of the FFT becomes...
349
Numerical Calculations
362
In engineering applications, the representation of the numerical value is critical. Presenting or reporting the answer is one of the essential parts of engineering practices. Numerical calculations are performed using handheld calculators or computers since numerically accurate answers are always preferred.
The solution to a problem is obtained using different methods. While manually solving algebraic symbols is one of the most common methods, the graphical method is often preferred. Computers...
The solution to a problem is obtained using different methods. While manually solving algebraic symbols is one of the most common methods, the graphical method is often preferred. Computers...
362


