SODFormer:通过变压器使用事件和进行流式对象检测
概括
我们介绍了SODFormer,这是一款新型的物体检测器,它集成了事件和数据,用于连续的异步检测. 这种方法在具有挑战性的条件下显著提高了性能,例如高速运动和低光.
科学领域:
- 计算机视觉 计算机视觉
- 神经形态工程的神经形态工程
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 对象检测面临着快速运动模糊和低光条件的挑战.
- 现有的方法很难有效地将异步事件数据和传统框架数据融合起来.
- 利用来自多式传感的时间线索对于强大的物体检测至关重要.
研究的目的:
- 提出SODFormer,一种新的流式物体检测器,集成事件和数据,用于异步物体检测.
- 开发一个能够利用来自异质视觉流的丰富时间线索的时空变压器架构.
- 为神经形态物体检测创建一个大规模的多模式数据集.
主要方法:
- 开发了基于变压器的物体检测器SODFormer,用于使用事件和数据进行连续,异步检测.
- 构建了大规模的PKU-DAVIS-SOD数据集,包含超过100万个手动标签.
- 设计了一个带有新型时间模块和非同步基于注意力的融合模块的时空变压器.
主要成果:
- SODFormer显著优于四种最先进的方法和八种基准方法.
- 该框架在高速运动和低光场景中表现出卓越的性能,而传统方法在这些场景中失败.
- 异步聚变模块有效地整合了异构的传感方式,以提高检测.
结论:
- SODFormer通过合并事件和数据,为异步对象检测提供了一个有效的解决方案.
- 提出的方法实现了最先进的性能,特别是在具有挑战性的环境条件下.
- 开发的数据集和框架推动了多模式神经形态物体检测的研究.
相关概念视频
Transformers in Distribution System
124
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
124
Transformers
1.1K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.1K
Frames: Problem Solving II
261
Consider a hydraulic hoist supporting a load of 1 kN. Assuming a simplified schematic representation of this frame structure, the force acting on BD and BF members can be determined.
261
Frames: Problem Solving I
533
Consider a jib crane with an external load suspended from the pulley. The dimensions of the crane members are shown in the figure. A systematic analysis of the frame structure is required to determine the reaction forces at the pin joints, assuming that the pulleys are frictionless.
533
Types Of Transformers
1.0K
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
1.0K
Frames
587
Frames are essential components of various mechanical and structural systems used daily. These structures are known for their stability and ability to bear heavy loads. A frame is constructed using two-force and multi-force members, interconnected using pin joints. In contrast, trusses are made entirely of two-force members.
Frames are versatile and widely used in various applications such as structural supports for beams and columns, automobile chassis construction, and in the construction...
Frames are versatile and widely used in various applications such as structural supports for beams and columns, automobile chassis construction, and in the construction...
587


