IFE-CMT:用于3D对象检测的实例感知细粒度特征增强交叉模态变压器
Xiaona Song1, Haozhe Zhang1, Haichao Liu1
1School of Mechanical Engineering, North China University of Water Resources and Electric Power, Zhengzhou 450045, China.
Sensors (Basel, Switzerland)
|September 27, 2025
概括
本研究介绍了实例感知细粒度特征增强交叉模态变压器 (IFE-CMT) 模型,以改进多模态3D对象检测. IFE-CMT模型显著提高了小物体的检测精度,在基准数据集上实现了更好的性能.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 多模态3D物体检测算法已经显著进步.
- 当前的方法往往忽视细粒度的特征,影响小物体检测的准确性.
- 现有的核聚变策略可能导致检测较小物体的性能下降.
研究的目的:
- 提出一种新型模型,即实例感知细粒度特征增强交叉模态变压器 (IFE-CMT),用于改进多模态3D对象检测.
- 为了提高复杂场景中小物体的检测精度.
- 为了解决当前融合策略在捕获细粒度对象表示方面的局限性.
主要方法:
- 开发了一个实例功能增强模块 (IE-模块),用于准确的多模式功能提取和增强.
- 引入了一个新的点云分支网络,以扩大受体场并改善语义表达.
- 设计了一种跨模式的变压器架构,专注于细粒度的功能增强.
主要成果:
- 与CMT模型相比,IFE-CMT模型在nuScenes数据集上表现得更好.
- 在验证和测试组分别实现了2.1%和1.9%的mAP增加.
- 对像自行车 (6.6%) 和摩托车 (3.7%) 等小型物体显著改善了mAP.
结论:
- 拟议的IFE-CMT模型有效地增强了用于多模式3D对象检测的细粒度特征表示.
- IFE-CMT表现出卓越的性能,特别是在检测小物体方面,优于现有的方法.
- 该模型提供了一种有前途的方法来应对自动驾驶系统中小型物体检测的挑战.
相关概念视频
Transformers
1.7K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.7K
Transformation
704
Microbial communities are dynamic environments where cell lysis releases free DNA into the surroundings. Other cells can take up this extracellular DNA through a process known as transformation.When a cell incorporates this foreign DNA into its genome, resulting in genetic modification, the process is known as transformation. Cells capable of this process are termed competent. Competence can be natural, as observed in certain bacteria and archaea, or artificially induced in the...
704
Types Of Transformers
1.4K
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
1.4K
Transformers with Off-Nominal Turns Ratios
523
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
523
Improving Translational Accuracy
14.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.1K
Improving Translational Accuracy
3.5K
3.5K

