一个节能处理器阵列和内存控制器,用于精确处理基于卷积神经网络的推理引擎
1Department of Micro and Nanoelectronics School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, 632014, India.
Scientific reports
|November 12, 2025
概括
一个新的控制器有效地管理卷积神经网络 (CNNs) 完全连接 (FC) 层中的非结构化的稀疏性,在推断过程中提高能源效率. 这种硬件加速器设计改善了数据的移动,并实现了显著的性能提升.
科学领域:
- 计算机工程 计算机工程
- 人工智能的人工智能
- 硬件加速器 硬件加速器
背景情况:
- 利用卷积神经网络 (CNN) 硬件加速器中的非结构化的稀疏性可以提高推断的能源效率.
- 管理非结构化的稀疏性,特别是在完全连接 (FC) 层中,通常需要复杂的控制器来进行索引和负载平衡.
研究的目的:
- 设计和评估一种新的控制器,用于管理CNN的FC层中的非结构化的稀疏性.
- 为了提高硬件加速器的能源效率和数据传输速度,CNN的推断需要最小的硬件开销.
主要方法:
- 在预训练的视觉几何组-16 (VGG-16) 模型中使用诱导的稀疏性机制引入了约20%的稀疏性.
- 开发了一个结合IFM和权重 - 零值压缩 (CIW-ZVC) 控制器,以管理离芯片和芯片内存之间的数据移动.
- 使用了一个处理器数组,具有256个卷积运算符 (CO) 和平行计算,重量为零,采用基于的计算策略,具有静态输入特征图 (IFM).
主要成果:
- 在ImageNet数据集上实现了95%的分类准确度和0.96波精度和回忆的平均值.
- CIW-ZVC控制器提高了数据移动速度,并且硬件开销最小.
- 14nm的实现显示了256 x 10^9操作/秒 (OPS) 的峰值性能和15 x 10^12 OPS/Watt的能量效率.
- 与现有处理器相比,报告的能效提高了6.08倍,面积效率提高了7.6倍.
结论:
- 设计的控制器有效地管理了FC层中的非结构化的稀疏性,显著提高了能源和区域效率.
- 拟议的硬件加速方法为基于CNN的推理提供了实质性的性能改进.
- 这种方法提供了一个可行的解决方案,通过解决稀疏性挑战来优化硬件加速器上的深度学习推断.
相关概念视频
Parallel Processing
612
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
612
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Ampere-Maxwell's Law: Problem-Solving
1.1K
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
1.1K
PI Controller: Design
1.1K
Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...
1.1K
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT)
975
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT) is an advanced Nuclear Magnetic Resonance (NMR) technique specifically designed to detect and enhance the signals of low-abundance nuclei, such as carbon-13 and nitrogen-15, in small molecules. The fundamental principle behind INEPT is the transfer of polarization from a more abundant and highly polarizable nucleus, typically hydrogen-1, to the low-abundance nucleus of interest. This process effectively boosts the NMR signal of the...
975
PD Controller: Design
599
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
599


