对于白盒对抗性攻击的梯度校正
IEEE transactions on neural networks and learning systems
|October 11, 2023
概括
本研究介绍了ADV-ReLU,这是一种通过纠正由ReLU激活函数引起的梯度错误计算来改善对深度神经网络的对抗性攻击的新方法. 这种方法增强了白盒和黑盒攻击,减少了对手的干扰.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 深度神经网络 (DNN) 对于人工智能任务,如图像分类至关重要.
- 敌对的例子构成重大威胁,因为它们会导致DNN错误地分类不知不觉地改变的输入.
- 现有的白盒攻击通常集中在梯度优化上,但可能会受到激活函数属性的阻碍.
研究的目的:
- 为了研究 Rectified Linear Unit (ReLU) 激活函数在敌对攻击期间对梯度计算的影响.
- 提出一种通用梯度校正方法,以增强对抗性示例生成.
- 提高基于梯度的白盒攻击的有效性,并将其转移到黑盒场景中.
主要方法:
- 分析ReLU在反向传播过程中的"错误阻断"和"过度传播"现象.
- 开发ADV-ReLU,一种梯度校正方法,根据计算得分调整误导的梯度.
- 将ADV-ReLU与已有的白盒攻击算法 (FGSM,I-FGSM,MI-FGSM,VMI-FGSM) 集成在一起.
主要成果:
- ADV-ReLU有效地纠正了ReLU引起的梯度误导,从而导致更准确的梯度攻击.
- 在ImageNet和CIFAR10数据集上的实验显示,在使用ADV-ReLU.LU时,对抗性扰动 (以-norm为单位) 减少.
- 该方法证明了与各种最先进的白盒攻击的成功集成,并提高了对黑盒攻击的可转移性.
结论:
- 拟议的ADV-ReLU方法提供了一个通用的解决方案,通过解决ReLU特定的梯度问题来增强基于梯度的对抗性攻击.
- ADV-ReLU提高了生成对抗示例的效率和有效性,减少了所需的扰动大小.
- 这项工作为了解和缓解深度神经网络的漏洞提供了有价值的技术.
相关概念视频
Difference from Background: Limit of Detection
6.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.4K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Reducing Line Loss
156
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
156
Distance Corrections
31
To achieve precise distance measurements, especially in surveying and construction, certain corrections must be applied to account for potential sources of error like the standardization errors, temperature variations, and slope adjustments.Standardization error emerges when measurement equipment undergoes changes, such as wear, repairs, or weather impacts. To address this, surveyors compare the equipment’s readings to a standard. This process identifies any deviation that might lead to...
31
Masking and Demasking Agents
2.5K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.5K
Mean Absolute Deviation
2.6K
The mean absolute deviation is also a measure of the variability of data in a sample. It is the absolute value of the average difference between the data values and the mean.
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
2.6K


