缓解低频偏差:特征重新校准和频率注意力规范化,以实现对抗性强度.
Kejia Zhang1, Juanjuan Weng2, Yuanzheng Cai3
1Department of Artificial Intelligence, Xiamen University, Xiamen, 361005, Fujian, China.
概括
对深层神经网络的对抗性训练会产生低频偏差. 我们的高频特征解和重新校准 (HFDR) 方法通过重新校准频率特征来提高稳定性.
科学领域:
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
- 机器学习安全 机器学习安全
背景情况:
- 深度神经网络 (DNN) 容易受到敌对攻击.
- 反对训练 (AT) 提高了强度,但引入了低频特征偏差.
- 这种偏差忽略了关键的高频细节,影响了模型性能.
研究的目的:
- 为了解决对抗训练中的低频偏差.
- 为了增强DNN的对抗性强度.
- 改进高频特征的捕获,以便更好地理解语义.
主要方法:
- 提出高频特征解和重新校准 (HFDR) 模块.
- 实施频率注意力规范化,以协调特征提取.
- 分离和重新校准特定频率的特征,以捕获潜在的语义线索.
主要成果:
- 在数据集 (CIFAR-10,CIFAR-100,ImageNet-1K) 中,HFDR始终提高对抗性稳定性.
- 在CIFAR-100 (WRN34-10) 上获得了2.89%的收益,在ImageNet-1K上获得了3.09%的收益.
- 在对抗AutoAttack的ViT-B上显示了4.89%的收益,显示了对CNN和变形金刚的适应性.
结论:
- 在对抗训练中,HFDR有效地减轻了低频偏差.
- 拟议的方法显著提高了DNN对抗对抗攻击的稳定性.
- 高高压电机可适应各种架构,包括卷积式和变压器模型.
相关概念视频
Frequency-dependent Selection
23.1K
When the fitness of a trait is influenced by how common it is (i.e., its frequency) relative to different traits within a population, this is referred to as frequency-dependent selection. Frequency-dependent selection may occur between species or within a single species. This type of selection can either be positive—with more common phenotypes having higher fitness—or negative, with rarer phenotypes conferring increased fitness.
23.1K
Scaling
563
In designing and analyzing filters, resonant circuits, or circuit analysis at large, working with standard element values like 1 ohm, 1 henry, or 1 farad can be convenient before scaling these values to more realistic figures. This approach is widely utilized by not employing realistic element values in numerous examples and problems; it simplifies mastering circuit analysis through convenient component values. The complexity of calculations is thereby reduced, with the understanding that...
563
Biasing of FET
681
Biasing a Junction Field Effect Transistor (JFET) is crucial for setting operational parameters and ensuring efficient functioning in electronic circuits. JFETs are characterized by using a single carrier type in N-channel or P-channel configurations, where the channel is surrounded by PN junctions. These junctions are central to the device's ability to control current flow.
In an N-channel JFET, the structure consists of N-type material forming the channel on a P-type substrate, with the...
In an N-channel JFET, the structure consists of N-type material forming the channel on a P-type substrate, with the...
681
Aliasing
572
Accurate signal sampling and reconstruction are crucial in various signal-processing applications. A time-domain signal's spectrum can be revealed using its Fourier transform. When this signal is sampled at a specific frequency, it results in multiple scaled replicas of the original spectrum in the frequency domain. The spacing of these replicas is determined by the sampling frequency.
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
572
Upsampling
591
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
591
Linear Approximation in Frequency Domain
359
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
359


