随机和对抗性比特错误的稳定性:节能和安全的DNN加速器
IEEE transactions on pattern analysis and machine intelligence
|October 10, 2023
概括
深度神经网络 (DNN) 加速器可以在低压操作中节省能源,但易受比特错误的影响. 强大的培训方法可以提高DNN的安全性和能源效率,而无需进行硬件更改.
科学领域:
- 计算机工程 计算机工程
- 人工智能的人工智能
- 硬件安全 硬件安全
背景情况:
- 深度神经网络 (DNN) 加速器可以节省能源,但在低电压运行方面面临挑战,导致位失效.
- 这些加速器容易受到针对电压控制器或单个位的敌对攻击,从而损害其完整性.
- 现有的解决方案往往需要硬件修改,或者在不同的操作条件下缺乏通用性.
研究的目的:
- 为DNN加速器开发一个强大的训练方法,以提高对比特错误和对抗性攻击的弹性.
- 通过低压操作和低精度量化来实现显著的能源节约,而不会影响精度.
- 提高DNN加速器在各种操作环境中的整体安全性和可靠性.
主要方法:
- 实施强大的固定点量化和重量剪切技术.
- 采用随机位错误训练 (RandBET) 或对抗位错误训练 (AdvBET) 对于量化DNN权重.
- 开发一种新的对抗性比特错误攻击来测试和验证强度.
主要成果:
- 在CIFAR10上的8/4位量子化实现了20%/30%的显著能源减少,精度损失最小 (0.8%/2%).
- 证明了对随机和对抗位错误的稳定性,显著提高了安全性.
- 测试错误从90%以上减少到26.22%,即使有多达320个对抗位错误.
结论:
- 提出的训练方法 (RandBET/AdvBET) 有效地提高了DNN加速器对比特错误和对抗性攻击的稳定性.
- 这种方法为低压和低精度操作提供了可观的能源节约,同时提高了安全性.
- 这种通用解决方案不需要硬件更改,并且在弹性和适用性方面优于相关工作.
相关概念视频
Random and Systematic Errors
11.0K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
11.0K
Randomized Experiments
7.0K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
7.0K
Random Error
899
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
899
Propagation of Uncertainty from Random Error
704
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
704
Random Variables
12.3K
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
12.3K
Improving Translational Accuracy
11.4K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.4K


