DN-DETR:通过引入查询消噪来加速DETR培训
IEEE transactions on pattern analysis and machine intelligence
|November 29, 2023
概括
本研究介绍了一种无声化训练方法,通过稳定双边图匹配来加快DETR (检测转换器) 训练. 这种方法显著提高了合速度和物体检测性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- DETR (检测转换器) 和类似的方法由于在早期培训阶段不稳定的双部分图匹配而遭受缓慢的融合.
- 这种不稳定性导致了不一致的优化目标,阻碍了有效的模型训练.
研究的目的:
- 开发一种新的Denoising培训方法,以加快DETR培训.
- 解决DETR类物体检测模型中的缓慢收问题.
- 为了更深入地了解基于变压器的探测器的融合挑战.
主要方法:
- 引入了一项否定的培训策略,以补充匈牙利的损失.
- 给变压器解码器输入杂的地面真相边界盒,以训练原始盒子的重建.
- 该方法旨在在DETR类架构中普遍适用,代码更改最小.
主要成果:
- 拟议的DN-DETR方法在相同的设置下实现了+1.9 AP的改进.
- 在12个和50个时代后,与ResNet-50骨干实现了46.0 AP和49.5 AP,分别.
- 使用50%更少的培训时代,证明了与基线方法可比的性能.
结论:
- 拒绝训练有效地减少了双边图匹配的困难,导致更快的融合.
- 该方法在物体检测准确度和训练效率方面取得了显著的改善.
- 在各种架构中验证了无声化培训的有效性,包括基于CNN的探测器和细分模型.
相关概念视频
¹³C NMR: Distortionless Enhancement by Polarization Transfer (DEPT)
1.1K
When proton-coupled carbon-13 spectra are simplified by a broadband proton decoupling technique, structural information about the coupled protons is lost. Distortionless enhancement by polarization transfer (DEPT) is a technique that provides information on the number of hydrogens attached to each carbon in a molecule. While the DEPT experiment utilizes complex pulse sequences, the pulse delay and flip angle are specifically manipulated. The resulting signals have different phases depending on...
1.1K
Double Resonance Techniques: Overview
214
Double resonance techniques in Nuclear Magnetic Resonance (NMR) spectroscopy involve the simultaneous application of two different frequencies or radiofrequency pulses to manipulate and observe two distinct nuclear spins. One important application of double resonance is spin decoupling, which selectively suppresses coupling with one type of nucleus while observing the NMR signal from another nucleus, simplifying the spectrum and enhancing resolution.
Spin decoupling is usually achieved by...
Spin decoupling is usually achieved by...
214
Nuclear Overhauser Enhancement (NOE)
701
Irradiation of a spin-active nucleus causes an increase or decrease in the signal intensity of neighboring nuclei that are not necessarily chemically bonded or involved in J-coupling. This phenomenon, called the Nuclear Overhauser Enhancement (NOE), results from through-space interactions between the nuclear spins. The NOE effect decreases with increasing internuclear distance and is generally not observed beyond 4 angstroms. In NOE, dipole-dipole interactions between neighboring...
701


