MB-TaylorFormer V2:改进的多分支线性变压器扩展了图像恢复的泰勒公式
概括
本研究介绍了MB-TaylorFormer V2,一种用于图像恢复的新型变压器. 它在处理和消毒等任务中实现了最先进的结果,并大大降低了计算成本.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 由于全球受感场,变压器网络在图像恢复方面出色.
- 软max注意力的高计算复杂性限制了变压器在高分辨率图像恢复中的应用.
研究的目的:
- 开发一个高效的变压器变体用于图像恢复任务.
- 为了解决Softmax-attention的二次计算复杂性.
主要方法:
- 提出了一个变压器变体,使用泰勒扩展来近似软max注意力.
- 采用保存规范的映射来近似泰勒扩展余数,实现线性复杂性.
- 引入了一个多分支架构,具有多尺度补丁嵌入,用于增强功能处理.
主要成果:
- MB-TaylorFormer V2 在各种图像恢复基准中展示了最先进的性能.
- 在图像 dehazing, deraining, desnowing, motion deblurring 和 denoising 中取得了卓越的结果.
- 该模型处理粗细的特征,并捕捉长距离的像素交互,最小的计算开销.
结论:
- MB-TaylorFormer V2有效地降低了计算成本,同时在图像恢复中保持了高性能.
- 新型架构增强了特征处理和近似精度.
- 该模型为高分辨率图像恢复挑战提供了计算高效的解决方案.
相关概念视频
01:25Transformers with Off-Nominal Turns Ratios
122
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
122
01:26Linear Approximation in Frequency Domain
79
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
79
01:18Reducing Line Loss
135
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
135
01:26Transformers
1.0K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.0K
01:19Three-Winding Transformers
178
Three identical single-phase transformers can be configured to form a three-phase transformer connection, which involves high-voltage and low-voltage windings. The high-voltage windings are denoted by capital letters A-B-C, while the low-voltage windings are labeled with lowercase letters a-b-c, representing their respective phases. This notation helps distinguish between the high and low voltage sides of the transformer.
In the per-unit equivalent circuit of a grounded Y-Y three-phase...
In the per-unit equivalent circuit of a grounded Y-Y three-phase...
178
01:28Equivalent Circuits for Practical Transformers
369
The practical equivalent circuits of single-phase two-winding transformers exhibit significant deviations from their idealized versions due to the inherent properties of winding resistance and finite core permeability. These properties result in real and reactive power losses, affecting the transformer's performance. Understanding these deviations is crucial for designing more efficient transformers.
In a practical transformer, each winding exhibits resistance and leakage reactance. The...
In a practical transformer, each winding exhibits resistance and leakage reactance. The...
369