虚拟现实远程存在:360度视频流与边缘计算辅助静态形压缩
IEEE transactions on visualization and computer graphics
|October 3, 2023
概括
本研究介绍了一种5G支持的虚拟现实系统,用于沉浸式360°视频通话. 它通过在蜂网络上采用高效的 foveated 压缩实现了视觉相同的流,使用的数据减少了 80%.
科学领域:
- 计算机科学 计算机科学
- 电气工程 电气工程
- 人与计算机的交互
背景情况:
- 移动设备和蜂网络越来越多地用于互联网访问.
- 通过蜂网络传输高质量的360度视频面临带宽限制.
- 像foveated染这样的低延迟技术对于高效的视频压缩至关重要,但在传统蜂网络上具有挑战性.
研究的目的:
- 展示一个端到端的虚拟现实远程存在系统,用于在5G毫米波 (mmW) 网络上播放高质量的360°视频.
- 为了在现代蜂网络上实现高效率的foveated压缩,与WiFi性能相提并论.
- 为了评估系统的视觉质量和用户对压缩视频的感知.
主要方法:
- 开发和实施一个端到端的虚拟现实远程存在系统,利用5G mmW无线电和移动边缘计算节点.
- 采用形压缩技术来降低360度视频流的带宽要求.
- 使用峰值信号与噪声比率 (PSNR) 和FOVVideoVDP进行技术评估,并与用户研究一起评估视觉质量和压缩灵敏度.
主要成果:
- 与4G网络相比,5G系统显著降低了延迟.
- 通过蜂网络实现高效率的foveated压缩,性能与WiFi相提并论.
- 显示视觉上无法区分的视频流,与未合的视频相比,数据减少高达80%.
结论:
- 开发的系统有效地克服了用于沉浸式360°视频流的蜂带宽限制.
- 5G技术与移动边缘计算和foveated压缩相结合,可以实现高效和高质量的虚拟现实远程存在.
- 该系统显示了在沉浸式视频应用中节省数据的巨大潜力,特别是在远程存在和视频通话方面.
相关概念视频
Depth Perception and Spatial Vision
700
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
700
Computed Tomography
4.6K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.6K
Fischer Projections
13.4K
Learning to draw Fischer projections of molecules and understanding their relevance plays a crucial role in the visual depiction of organic molecules. A Fischer projection is a two-dimensional projection on a planar surface to simplify the three-dimensional wedge–dash representation of molecules. This is especially helpful in the case of molecules with multiple chiral centers that can be difficult to draw. Here, all the bonds of interest are represented as horizontal or vertical lines.
13.4K
Endoscopic Procedures III: Video Capsule Endoscopy
180
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
180
Virtual Work for a System of Connected Rigid Bodies
403
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
403


