Motion-Aware Dynamic Graph Neural Network for Video Compressive Sensing
These videos have been matched automatically. Contact us if they are not relevant.
These videos have been matched automatically. Contact us if they are not relevant.
View abstract on PubMed
Summary
This summary is machine-generated.This study introduces a graph neural network (GNN) to reconstruct high-speed videos from compressed snapshot compressive imaging (SCI) data. The novel motion-aware GNN effectively captures long-range spatial and temporal dependencies for improved video reconstruction.
Area Of Science
- Computer Vision
- Signal Processing
- Machine Learning
Background
- Video snapshot compressive imaging (SCI) captures high-speed video frames using a 2D detector, compressing them into a single measurement.
- Existing reconstruction methods struggle to efficiently model long-range spatial and temporal dependencies crucial for accurate video recovery.
Purpose Of The Study
- To develop a flexible and robust approach for video SCI reconstruction.
- To efficiently model non-local interactions between pixels in space and time, regardless of distance.
Main Methods
- A graph neural network (GNN) approach is proposed to model non-local interactions.
- A motion-aware dynamic GNN is developed, incorporating motion-aware dynamic sampling, cross-scale node sampling, global knowledge integration, and graph aggregation.
Main Results
- The proposed GNN approach effectively captures long-range spatial and temporal dependencies.
- Extensive simulations and real-data experiments demonstrate the effectiveness and efficiency of the model.
- Visualizations confirm the dynamic sampling operations enhance video SCI reconstruction.
Conclusions
- The motion-aware dynamic GNN offers a significant advancement in video SCI reconstruction.
- The model's ability to handle non-local interactions improves the quality and efficiency of recovering high-speed video frames.
These videos have been matched automatically. Contact us if they are not relevant.
These videos have been matched automatically. Contact us if they are not relevant.
Related Concept Videos
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...