内容保存图像翻译与纹理共发生和空间自我相似性用于纹理脱皮和域调整
Myeongkyun Kang1, Dongkyu Won2, Miguel Luna2
1Department of Robotics and Mechatronics Engineering, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Daegu, South Korea; Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA.
概括
本研究引入了一种新的图像翻译框架,以减轻人工智能模型中的纹理偏差. 通过生成新的训练数据,它可以提高模型的稳定性,防止分类和细分任务中的不一致的纹理偏差.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 在有偏见的数据集上训练的模型在未见的数据上表现不佳,这是由于嵌入有偏见的表示.
- 现有的调解方法很难在不影响基本信息的情况下解开纹理偏差.
研究的目的:
- 提出一个新的框架来缓解人工智能模型中的纹理偏差.
- 在下游任务中增强模型稳定性,防止不一致的纹理偏差.
主要方法:
- 通过将源图像内容与目标图像纹理相结合,利用图像翻译生成合成训练数据.
- 采用纹理共发生损失用于纹理相似性和空间自我相似性损失用于内容保存.
- 结合生成和原始图像用于培训分类和细分模型.
主要成果:
- 在已知纹理偏差的五个分类和两个细分数据集上展示了实用性.
- 与最先进的方法相比,在减轻纹理偏差方面取得了显著的改进.
- 生成的模型对不一致的纹理偏差表现出增强的稳定性.
结论:
- 拟议的框架通过生成多样化的培训数据,有效地减轻了纹理偏差.
- 这种方法可以提高计算机视觉任务的AI模型的性能和稳定性.
- 为开发能够在不同数据分布中更好地泛化的人工智能系统提供了一个有前途的解决方案.
相关概念视频
Deconvolution
188
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
188
Improving Translational Accuracy
2.6K
2.6K
Downsampling
184
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
184
Upsampling
262
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
262
Shape and Texture of Coarse Aggregate
234
Aggregate shape is classified based on the relative sharpness or roundness of the edges and corners. This classification includes categories like rounded, angular, elongated, and flaky, each with specific characteristics. Rounded aggregates, fully shaped by attrition, are typical of river or seashore gravel, while angular aggregates, such as crushed rock, have well-defined edges. Aggregates that are elongated and flaky are less desirable, as they can reduce the workability and strength of...
234
Aliasing
161
Accurate signal sampling and reconstruction are crucial in various signal-processing applications. A time-domain signal's spectrum can be revealed using its Fourier transform. When this signal is sampled at a specific frequency, it results in multiple scaled replicas of the original spectrum in the frequency domain. The spacing of these replicas is determined by the sampling frequency.
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
161


