一个高精度的基于概率的西格莫体近似仪,结合了节省记忆和节省时间的策略
IEEE transactions on neural networks and learning systems
|February 4, 2026
概括
这项研究介绍了一种用于神经网络的新型概率性Sigmoid近似器,优化了硬件实现. 新方法减少了内存,并提高了边缘设备的准确性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 硬件工程 硬件工程
背景情况:
- 对于神经网络来说,特别是边缘设备上,西格体功能至关重要.
- 之前使用高斯累积函数的概率近似方法在所有输入中面临着对内存使用,速度和准确性的挑战.
研究的目的:
- 开发一个硬件友好和高度准确的概率学西格莫体近似仪.
- 克服现有方法的局限性,例如高RAM要求和耗时的流程.
主要方法:
- 建立Sigmoid函数输出和逻辑随机变量的概率之间的等价性.
- 实施一个间接的随机变量量化策略,以尽量减少内存和精度损失.
- 优化延迟和开发一个资源高效的数字电路实现.
主要成果:
- 拟议的方案大大减少了内存使用量和精度损失.
- 开发的Sigmoid近似仪证明了优化的延迟和资源效率.
- 从绝对误差的上限得出,证实了近似的准确性.
结论:
- 与现有方法相比,新型概率性西格莫体近似仪在准确性和资源成本方面提供了卓越的性能.
- 这种方法为神经网络中的sigmoid近似提供了一个硬件友好和高效的解决方案,特别是在边缘计算应用中.
相关概念视频
Accuracy, limits, and approximation
1.3K
Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
1.3K
Linear Approximation in Time Domain
376
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
376
Approximate Integration
53
In many practical and theoretical contexts, the exact value of a definite integral may be inaccessible. This limitation typically arises when the antiderivative of a function is either unknown or cannot be expressed in a closed mathematical form. Alternatively, it can occur when a function is defined not by a formula but by a finite set of empirical data points, such as those collected during experiments. In these cases, approximate integration techniques provide a valuable solution.One of the...
53
Improving Translational Accuracy
15.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
15.0K
Linearization and Approximation
67
Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
67
Application of Linearization and Approximation
94
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
94


