INformer:用于摄像机震动解的惯性聚变变压器
概括
本研究介绍了INformer,这是一个使用惯性测量单元 (IMU) 数据和变压器架构的新型消除模糊性的网络. 该方法有效地利用运动信息来改善图像模糊,优于现有技术.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 机器人技术 机器人技术 机器人技术
背景情况:
- 惯性测量单元 (IMU) 通过陀螺仪和加速度计捕捉设备运动.
- 传统的消除模糊的方法往往忽略了IMU数据,而现有的基于IMU的方法难以充分利用这些信息,导致噪声.
- 在有效地将传感器衍生的运动数据集成到图像消除模糊的过程中存在挑战.
研究的目的:
- 提出一个新的多阶段消除模糊网络,INformer,有效地集成惯性测量单元 (IMU) 数据.
- 解决现有的消除模糊方法在利用IMU信息和减轻传感器噪声方面的局限性.
- 通过使用先进的注意力机制将运动数据与图像特征融合起来,以提高图像消除模糊性能.
主要方法:
- 开发了一个多阶段的消除模糊网络,INformer,结合了变压器架构.
- 设计了一个IMU图像注意力融合 (IAF) 块,以在注意力水平上将运动信息与模糊图像特征合并.
- 引入了惯性引导可变形注意力 (IGDA) 块,以使用运动特征进行自适应受感场调整和模糊内核改进.
主要成果:
- 拟议的INformer网络在图像消除模糊的任务中表现出卓越的性能.
- 对综合基准的广泛实验证实了该方法的有效性.
- 国际空军和IGDA成功地集成了惯性数据,改善了模糊内核估计.
结论:
- INformer有效地利用IMU数据进行先进的图像消除模糊.
- 提出的注意力融合和引导可变形的注意力块显著提高了消除模糊的质量.
- 该方法与最先进的消除模糊的方法相比,表现良好.
相关概念视频
Inertial Frames of Reference
7.0K
Newton’s first law is usually considered to be a statement about reference frames. It provides a method for identifying a special type of reference frame: the inertial reference frame. In principle, we can make the net force on a body zero. If its velocity relative to a given frame is constant, then that frame is said to be inertial. So, by definition, an inertial reference frame is a reference frame where Newton's first law holds valid. Newton's first law applies to objects with...
7.0K
Relative Motion Analysis using Rotating Axes
449
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
449
Relative Motion Analysis using Rotating Axes - Acceleration
323
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
323
Curvilinear Motion: Normal and Tangential Components
387
When a car traverses a curved road, its motion can be elucidated by breaking it down into tangential and normal components. The car-centric coordinates attached to the vehicle move with it.
The positive direction of the t-axis aligns with the increasing position of the car along the curved path, denoted by the unit vector ut. Simultaneously, the n-axis, perpendicular to the t-axis, dissects the curved path into differential arc segments, each forming the arc of a circle with a radius of...
The positive direction of the t-axis aligns with the increasing position of the car along the curved path, denoted by the unit vector ut. Simultaneously, the n-axis, perpendicular to the t-axis, dissects the curved path into differential arc segments, each forming the arc of a circle with a radius of...
387
Non-inertial Frames of Reference
5.8K
A reference frame accelerating or decelerating relative to an inertial frame is a non-inertial frame. To help understand this, consider what taking off in an airplane, turning a corner in a car, riding a merry-go-round, and the circular motion of a tropical cyclone all have in common. All these systems are accelerating, decelerating, or rotating relative to the Earth; hence, they all are non-inertial frames. All these systems exhibit inertial forces, which merely seem to arise from motion,...
5.8K
Relative Motion Analysis - Acceleration
340
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
340


