从事件摄像头通过联合学习与立体流的时间立体匹配
IEEE transactions on pattern analysis and machine intelligence
|December 18, 2025
概括
本研究介绍了一个使用事件摄像头进行3D环境感知的时间事件立体框架. 这种新的方法通过整合过去的数据来增强立体匹配,在多个数据集上实现最先进的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 传感器技术 传感器技术
背景情况:
- 受视网膜启发的事件摄像头提供高动态范围,时间分辨率和低功耗.
- 由于连续,详细的像素运动记录,它们在具有挑战性的条件下擅长感知3D环境.
- 利用事件数据的时间密度对于高级感知任务至关重要.
研究的目的:
- 开发一个时间事件立体框架,利用过去的信息来增强3D环境感知.
- 通过整合来自事件摄像头的时间数据来提高立体声匹配的准确性.
- 证明拟议方法的计算效率.
主要方法:
- 引入了一个时间事件立体框架,集成过去事件数据.
- 联合训练了一个事件立体声匹配网络与立体流.
- 训练的运动流使用差异地图,而不是光学流地面真相.
- 为了计算效率,使用了过去数据的级联堆叠.
主要成果:
- 在MVSEC,DSEC,M3ED和EVIMO2数据集上实现了最先进的立体声匹配性能.
- 通过通过立体流的信息的时间聚合,显著提高了性能.
- 展示了处理事件数据的计算效率.
结论:
- 时间事件立体框架有效地利用过去的信息来实现强大的3D感知.
- 该方法在基于事件的立体声匹配中提供了显著的进步.
- 这种方法为实时应用程序提供了一个计算效率高的解决方案.
相关概念视频
Uniform Depth Channel Flow: Problem Solving
417
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
417
Relative Motion Analysis using Rotating Axes
858
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
858
Uniform Depth Channel Flow
517
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
517
Relative Motion Analysis using Rotating Axes-Problem Solving
677
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
677
Depth Perception and Spatial Vision
1.7K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
1.7K
Relative Motion Analysis - Velocity
670
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
670


