在高动态场景中以视觉惯性融合为基础的图像退化恢复,使用滚动快门摄像头
Jianbin Ye1, Cengfeng Luo2, Qiuxuan Wu2
1HUD-ITMO Joint Institute, Hangzhou Dianzi University, Hangzhou 310018, China.
本研究引入了一种视觉惯性融合框架,用于修复移动相机中的运动模糊和滚动快门扭曲. 该方法提高了图像质量,并在动态场景中提高了SLAM准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 图像处理 图像处理
背景情况:
- 滚动快门 (RS) 摄像机在移动设备中很普遍,但会受到运动模糊和几何扭曲的影响.
- 快速运动和振动加剧了这些合的退化,影响图像质量和系统性能.
研究的目的:
- 开发一个统一的框架来估计和纠正滚动式快门摄像机中与运动相关的退化.
- 在高动态场景中提高光度 (模糊) 和几何 (扭曲) 图像质量.
主要方法:
- 一个视觉惯性融合框架,集成IMU和图像数据来估计统一的运动退化参数.
- 考虑CMOS传感器光电特征的曝光感知模糊管道.
- 一种视角一致的滚动快门补偿方法,解决深度运动合.
主要成果:
- 在真实世界移动数据上显示了显著的图像质量 (光度和几何) 改进.
- 在下游的同时定位和映射 (SLAM) 任务中实现了更高的准确性.
- 在纠正合性降解方面表现优于现有的代表性基线方法.
结论:
- 拟议的视觉惯性融合框架有效地解决了滚动快门摄像头中的合运动退化问题.
- 该方法提供了一个强大的解决方案,用于在动态环境中提高图像质量和SLAM性能.
- 这项工作有助于为移动和嵌入式系统提供更可靠的视觉感知.
更多相关视频
11:57Three-dimensional Super Resolution Microscopy of F-actin Filaments by Interferometric PhotoActivated Localization Microscopy iPALM
Published on: December 1, 2016
07:24Using Eye-tracking to Assess the Relative Importance of Visual and Vestibular Input to Subcortical Motion Processing in the Roll Plane
Published on: August 22, 2025
相关概念视频
Relative Motion Analysis using Rotating Axes
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
Relative Motion Analysis using Rotating Axes-Problem Solving
Here, in order to determine the magnitude of velocity and acceleration for point...
Relative Motion Analysis using Rotating Axes - Acceleration
Time differentiation is...
Deconvolution
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Inertial Frames of Reference
Relative Motion Analysis - Velocity
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
