交叉形式++:一个多功能视觉转换器,依赖于交叉规模的注意力
IEEE transactions on pattern analysis and machine intelligence
|December 19, 2023
概括
本研究介绍了CrossFormer,这是一款新的视觉变换器,明确结合了多层次特征. 通过解决变压器关键局限性,CrossFormer++在各种计算机视觉任务中展示了卓越的性能.
科学领域:
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
- 人工智能的人工智能
背景情况:
- 现有的视觉转换器没有明确利用视觉感知至关重要的多尺度特征.
- 在当前的变压器架构中,处理不同规模的特征仍然是一个挑战.
研究的目的:
- 提出一种新的视觉转换器架构,CrossFormer,可以有效地集成多个尺度的功能.
- 解决与自我注意机制和特征表示有关的视觉变压器的性能限制.
主要方法:
- 引入了一个跨尺度嵌入层 (CEL),以将令牌与多尺度补丁混合在一起.
- 开发了一个长短距离注意力 (LSDA) 机制来管理计算负载并保留规模特定的特征.
- 提出了一个渐进式组大小 (PGS) 范式和一个振幅冷却层 (ACL),以减轻扩大的自我注意力图和振幅爆炸.
主要成果:
- 克罗斯福默有效地结合了跨度特征,增强了自我注意能力.
- LSDA减少了计算复杂性,同时保留了小规模和大规模的特征.
- PGS和ACL成功地解决了分别扩大自我注意地图和振幅爆炸的问题.
结论:
- 在图像分类,对象检测,实例细分和语义细分方面,CrossFormer++显著优于现有的视觉转换器.
- 拟议的架构和技术为各种视觉任务的视觉变压器设计提供了更强大,更有效的方法.
相关概念视频
01:25Cross Product
250
The cross product is a fundamental concept in vector algebra that is a vector operation on two different vectors to obtain a third vector. Unlike the scalar product, the cross product results in a vector quantity perpendicular to both the original vectors.
The magnitude of the cross product is obtained by multiplying the magnitude of both the vectors and the sine of the angle between them. This means that a larger angle between the vectors will lead to a greater magnitude of the cross product.
The magnitude of the cross product is obtained by multiplying the magnitude of both the vectors and the sine of the angle between them. This means that a larger angle between the vectors will lead to a greater magnitude of the cross product.
250
01:16Types Of Transformers
979
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
979
01:25Transformers with Off-Nominal Turns Ratios
160
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
160
01:27Transformers in Distribution System
103
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
103
01:26The Ideal Transformer
398
In single-phase two-winding transformers, two windings are coiled around a magnetic core characterized by cross-sectional area A and magnetic permeability μ. A phasor current i1 enters the left winding while i2 exits the right winding, establishing the fundamental working of the transformer through electromagnetic principles.
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
398
01:28Forced Transdifferentiation
1.9K
Transdifferentiation, also known as lineage reprogramming, was first discovered by Selman and Kafatos in 1974 in silkmoths. They observed that the moths’ cuticle-producing cells transformed into salt-producing cells. Many such cases of natural transdifferentiation occur in organisms. In humans, pancreatic alpha cells can become beta cells. In newts, the loss of the eye’s lens causes the pigmented epithelial cells to transdifferentiate into the lens cells.
Artificial...
Artificial...
1.9K