适应性令牌选择可扩展点云转换器的可适应性令牌选择
Alessandro Baiocchi1, Indro Spinelli2, Alessandro Nicolosi3
1Sapienza University of Rome, Department of Computer, Control and Management Engineering, Via Ariosto 25, Rome, 00185, Italy.
概括
适应点云转换器 (AdaPT) 通过动态选择令牌有效地处理大型3D点云. 这种几何深度学习模型可以降低计算成本,同时保持对现实应用的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 几何深度学习 几何深度学习
- 自然语言处理自然语言处理.
背景情况:
- 3D数据采集正在迅速增加,推动对高效点云处理模型的需求.
- 变压器在自然语言处理方面取得了成功,并且正在适应点云任务.
- 标准点云转换器 (PTs) 面临着由于点云大小的二次复杂性而导致的可扩展性挑战.
研究的目的:
- 开发一个高效的几何深度学习模型来处理大规模的3D点云.
- 为了解决现有点云变压器的计算可扩展性限制.
- 引入一个灵活的机制来管理推理过程中的计算成本.
主要方法:
- 提出了自适应点云变压器 (AdaPT),该变压器将自适应令牌选择机制集成到标准PT中.
- 在推断过程中实施动态令牌减少策略,以处理大型点云.
- 引入一个预算机制,以灵活调整计算成本而无需再培训.
主要成果:
- AdaPT显著降低了大型点云处理的计算复杂性.
- 与标准点云变压器相比,该模型保持了竞争力的准确性.
- 对点云分类任务的实验评估验证了AdaPT的效率和性能.
结论:
- 通过使用几何深度学习,AdaPT为点云处理提供了一种高效且可扩展的解决方案.
- 适应性代币选择和预算机制使灵活和计算效率高的推断成为可能.
- 在将变压器架构应用于大规模3D数据方面,AdaPT代表了重大进步.
相关概念视频
01:26Transformers
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
01:16Types Of Transformers
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
01:27Transformers in Distribution System
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
01:25Transformers with Off-Nominal Turns Ratios
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the rated...