SASRT: Semantic-Aware Super-Resolution Transmission for Adaptive Video Streaming over Wireless Multimedia Sensor...

Area of Science:

• Wireless Multimedia Sensor Networks (WMSNs)
• Video Compression
• Adaptive Streaming

Background:

• Limited network resources in WMSNs impact user Quality of Experience (QoE).
• Existing video codecs (H.264, H.265) primarily address spatial and short-term redundancy, neglecting long-term temporal redundancy.
• Efficiently compressing long-term video redundancy is crucial for adaptive streaming in WMSNs without compromising QoE.

Purpose of the Study:

• To present a semantic-aware super-resolution transmission for adaptive video streaming system (SASRT) designed for WMSNs.
• To address the challenge of compressing long-term video redundancy while maintaining user experience and adaptive delivery.
• To optimize the allocation of network resources for video and semantic information.

Main Methods:

• Utilizing deep learning algorithms to extract video semantic information and enhance video quality.
• Encoding and uploading different bit-rate semantic and video data from multimedia sensors.
• Employing super-resolution technologies on the user side to enrich video quality.
• Formulating the optimization problem as a complexity-constrained nonlinear NP-hard problem.
• Proposing three adaptive strategies and a heuristic algorithm to solve the optimization problem.

Main Results:

• SASRT effectively compresses long-term video information redundancy.
• The system enriches user experience even with limited network resources.
• Network resource utilization is simultaneously improved.
• Semantic information extraction and adaptive bit-rate selection strategies are key components.

Conclusions:

• SASRT offers an effective solution for adaptive video streaming in WMSNs with limited resources.
• The semantic-aware approach balances data compression, quality enhancement, and network efficiency.
• Future work may focus on optimizing semantic information identification location and computational cost trade-offs.