Reliable 3D video streaming considering region of interest
Ehsan Rahimi1, Chris Joslin1,2
11Department of Systems and Computer Engineering, Carleton University, 1125 Colonel By Dr, Ottawa, K1S 5B6 ON Canada.
EURASIP Journal on Image and Video Processing
|April 19, 2019
Summary
This study introduces a novel multiple description coding (MDC) method for stereoscopic 3D video streaming, enhancing reliability over unreliable networks. The approach prioritizes visually important objects, improving viewer experience and performance metrics like PSNR and SSIM.
Area of Science:
- Computer Science
- Electrical Engineering
- Multimedia Systems
Background:
- Increasing demand for 3D video streaming in wired and wireless networks necessitates robust transmission methods.
- Packet failure is a common issue in communication networks, impacting video quality.
- Existing multiple description coding (MDC) methods may not optimally handle the unique characteristics of 3D video content.
Purpose of the Study:
- To propose a new, reliable stereoscopic 3D video streaming method using MDC.
- To enhance video quality by focusing on visually significant objects within the scene.
- To improve resilience against packet loss in communication channels.
Main Methods:
- Developed a novel MDC strategy generating four 3D video descriptions.
- Utilized second-order statistics of depth map images to identify salient objects.
- Applied non-identical decimation for color video descriptions based on detected objects.
- Simulated scenarios with only one successful description delivery to test data recovery.
Main Results:
- The proposed MDC method demonstrated improved visual performance and reliability under simulated packet loss.
- Objective tests showed superior performance compared to Polyphase SubSampling (PSS) MDC and previous pixel-variation methods.
- PSNR and SSIM metrics confirmed significant improvements in reconstructed video quality.
Conclusions:
- The novel MDC approach effectively enhances stereoscopic 3D video streaming reliability.
- Prioritizing visually important objects leads to better subjective and objective video quality.
- The method offers a robust solution for transmitting 3D video over lossy communication networks.
Related Concept Videos
01:20Stream Function
2.1K
In two-dimensional incompressible fluid flow, the continuity equation is essential for ensuring mass conservation, meaning that any change in fluid entering or exiting a region is balanced by a corresponding change elsewhere. For incompressible flow, where density remains constant, this requirement simplifies to the condition that the divergence of the velocity field must be zero. Mathematically, this is expressed as,
2.1K
01:29Reliability and Validity
13.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.8K
01:03IR Frequency Region: Fingerprint Region
1.9K
IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the...
1.9K
01:27Steady Flow of a Fluid Stream
692
Consider a control volume, such as a pipe with solid boundaries, through which fluid flows and changes direction due to the impulse exerted by the resulting force from the pipe walls. In steady flow, the mass of fluid entering the control volume at a given time, t, with velocity v1, is equal to the mass leaving after infinitesimal time dt, with velocity v2.
During this process, the momentum of the fluid within the control volume remains constant over the time interval dt. By applying the...
During this process, the momentum of the fluid within the control volume remains constant over the time interval dt. By applying the...
692
01:25Distribution Reliability and Automation
502
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
502
02:40The Eukaryotic Promoter Region
18.7K
The eukaryotic promoter region is a segment of DNA located upstream of a gene. It contains an RNA polymerase binding site, a transcription start site, and several cis-regulatory sequences. The proximal promoter region is located in the vicinity of the gene and has cis-regulatory sequences and the core promoter. The core promoter is the binding site for RNA polymerase and is usually located between -35 and +35 nucleotides from the transcription start site. The distal promoter regions are...
18.7K