Related Experiment Video
Updated: Aug 3, 2025
11:34
High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques
Published on: December 3, 2013
15.7K
Masked360: Enabling Robust 360-degree Video Streaming with Ultra Low Bandwidth Consumption
IEEE Transactions on Visualization and Computer Graphics
|April 7, 2023
Summary
Masked360 offers efficient 360-degree video streaming by transmitting masked frames and a neural network model for client-side reconstruction. This approach significantly reduces bandwidth and enhances robustness against packet loss for high-quality streaming.
Area of Science:
- Computer Science
- Electrical Engineering
- Multimedia Systems
Background:
- 360-degree video streaming faces challenges with limited bandwidth and network instability.
- Existing methods struggle to deliver high-quality immersive experiences under adverse network conditions.
Purpose of the Study:
- To propose Masked360, a novel neural-enhanced framework for efficient and robust 360-degree video streaming.
- To significantly reduce bandwidth consumption while improving resilience to packet loss.
Main Methods:
- Developed Masked360, transmitting masked low-resolution frames and a lightweight neural network (MaskedEncoder) to clients.
- Implemented optimization techniques including complexity-based patch selection and redundant patch transmission.
- Utilized client-side reconstruction via MaskedEncoder to restore original video frames.
Main Results:
- Achieved 4K 360-degree video streaming at bandwidths as low as 2.4 Mbps.
- Demonstrated significant improvements in video quality: 5.24-16.61% in PSNR and 4.74-16.15% in SSIM compared to baselines.
- Showcased robustness against packet loss through the reconstruction process.
Conclusions:
- Masked360 provides a practical solution for bandwidth-efficient and robust 360-degree video streaming.
- The neural-enhanced framework effectively reconstructs video frames, enhancing quality and user experience.
- The proposed optimizations and reconstruction method address key challenges in immersive video delivery.
Related Concept Videos
01:22Upsampling
275
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
275
01:20Stream Function
1.6K
In two-dimensional incompressible fluid flow, the continuity equation is essential for ensuring mass conservation, meaning that any change in fluid entering or exiting a region is balanced by a corresponding change elsewhere. For incompressible flow, where density remains constant, this requirement simplifies to the condition that the divergence of the velocity field must be zero. Mathematically, this is expressed as,
1.6K
01:27Uniform Depth Channel Flow
110
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
110
01:15Torque Free Motion
529
The torque-free motion refers to the movement of a rigid body in space when no external torques are acting upon it. This type of motion can be observed in environments where there are no external forces or frictions, like in outer space. For example, a rotation of Mars in space is a torque-free motion. Mars is an axisymmetric object, meaning it has an axis of symmetry along which it rotates, designated as the z-axis. The rotating frame of reference is defined such that the center of mass of...
529
01:02Gyroscope
3.4K
A gyroscope is defined as a spinning disk in which the axis of rotation is free to assume any orientation. When spinning, the orientation of the spin axis is unaffected by the orientation of the body that encloses it. The body or vehicle enclosing the gyroscope can be moved from place to place, while the orientation of the spin axis remains the same. This makes gyroscopes very useful in navigation, especially where magnetic compasses cannot be used, such as in crewed and crewless spacecraft,...
3.4K
01:20Downsampling
208
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
208