帽子:用于图像恢复的混合注意力变压器
IEEE transactions on pattern analysis and machine intelligence
|November 3, 2025
概括
混合注意力转换器 (HAT) 通过集成基于频道和窗口的自我注意力来增强图像恢复,激活更多的输入像素以获得超分辨率和无声化任务中的优异结果.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 变压器网络在图像恢复方面表现有前途,但空间信息利用有限.
- 现有的变压器模型可能无法充分利用它们的潜力来完成诸如超分辨率和无声化等任务.
研究的目的:
- 提出一种新的混合注意力变压器 (HAT),通过最大限度地利用输入信息来改善图像恢复.
- 增强跨窗口的功能交互,以更好地整合全球上下文.
主要方法:
- 混合注意力变压器 (HAT) 结合了通道注意力和基于窗口的自我注意力机制.
- 引入了一个重叠的交叉注意模块,以改善交叉窗口信息聚合.
- 在培训阶段采用相同任务的预培训策略.
主要成果:
- 广泛的实验验证了拟议的HAT模块的有效性.
- 缩放模型显著提高了超分辨率 (SR) 任务的性能.
- 在各种图像恢复应用中,HAT展示了最先进的定量和质量结果.
结论:
- 拟议的混合注意力变压器 (HAT) 有效地解决了基于变压器的现有图像恢复方法的局限性.
- 在超分辨率,无声化和工件减少方面,HAT 实现了卓越的性能.
- 该模型的架构和预训练策略为图像恢复中的变压器网络释放了更大的潜力.
相关概念视频
Transformers
1.7K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.7K
The Ideal Transformer
1.3K
In single-phase two-winding transformers, two windings are coiled around a magnetic core characterized by cross-sectional area A and magnetic permeability μ. A phasor current i1 enters the left winding while i2 exits the right winding, establishing the fundamental working of the transformer through electromagnetic principles.
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's tangential...
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's tangential...
1.3K
Types Of Transformers
1.4K
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
1.4K
Reconstruction of Signal using Interpolation
679
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
679
Equivalent Circuits for Practical Transformers
1.3K
The practical equivalent circuits of single-phase two-winding transformers exhibit significant deviations from their idealized versions due to the inherent properties of winding resistance and finite core permeability. These properties result in real and reactive power losses, affecting the transformer's performance. Understanding these deviations is crucial for designing more efficient transformers.
In a practical transformer, each winding exhibits resistance and leakage reactance. The...
In a practical transformer, each winding exhibits resistance and leakage reactance. The...
1.3K
Reducing Line Loss
351
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
351

