运动感知动态图形神经网络用于视频压缩传感
概括
这项研究引入了一个图形神经网络 (GNN) 来从压缩快照压缩成像 (SCI) 数据中重建高速视频. 新的运动感知GNN有效地捕捉了远程的空间和时间依赖性,以改进视频重建.
科学领域:
- 计算机视觉 计算机视觉
- 信号处理 信号处理
- 机器学习 机器学习
背景情况:
- 视频快照压缩成像 (SCI) 使用2D探测器捕获高速视频,将它们压缩成单个测量.
- 现有的重建方法很难有效地建模远程空间和时间依赖,这对于准确的视频恢复至关重要.
研究的目的:
- 为视频SCI重建开发一种灵活和强大的方法.
- 为了有效地建模像素在空间和时间之间的非局部相互作用,无论距离.
主要方法:
- 建议采用图形神经网络 (GNN) 方法来建模非局部交互.
- 开发了一个运动感知动态GNN,结合了运动感知动态采样,跨度节点采样,全球知识整合和图形聚合.
主要成果:
- 拟议的GNN方法有效地捕捉了远程的空间和时间依赖.
- 广泛的模拟和真实数据实验证明了模型的有效性和效率.
- 可视化证实了动态采样操作,增强了视频SCI重建.
结论:
- 运动感知动态GNN为视频SCI重建提供了显著的进步.
- 该模型处理非局部交互的能力提高了恢复高速视频的质量和效率.
更多相关视频
相关概念视频
Relative Motion Analysis using Rotating Axes
459
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
459
Absolute Motion Analysis- General Plane Motion
219
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
219
Relative Motion Analysis using Rotating Axes-Problem Solving
400
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
400
Sequence Networks of Rotating Machines
99
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
99
Relative Motion Analysis - Acceleration
349
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
349
Relative Motion Analysis using Rotating Axes - Acceleration
330
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
330


