视窗预测与跨模态多尺度变压器用于360度视频流媒体
Yangsheng Tian1, Yi Zhong2, Yi Han3
1School Of Information Engineering, Wuhan University of Technology, LuoShi Road, Wuhan, 430070, Hubei, China. 369487529@qq.com.
Scientific reports
|August 19, 2025
概括
这项研究引入了一种新的模型,用于预测360度视频流中的用户视图. 交叉模态多尺度变压器 (CMMST) 通过考虑用户移动和视觉重要性来提高预测准确性.
科学领域:
- 计算机科学 计算机科学
- 多媒体系统 多媒体系统
- 人工智能的人工智能
背景情况:
- 高效的360°视频流媒体面临着高带宽需求和不可预测的用户视图端口的挑战.
- 当前的方法往往忽略了模式间的依赖性和个性化的用户偏好,导致预测准确度低于最佳.
研究的目的:
- 为360°视频流媒体开发一种新的视窗预测模型.
- 通过整合多种功能和特定用户数据来提高预测准确性和效率.
主要方法:
- 开发了一个跨模态多尺度变压器 (CMMST) 模型.
- 该模型整合了用户轨迹和多个尺度的视频突出特征.
- 采用跨模式的注意力机制来捕捉用户的偏好和观看模式.
主要成果:
- 与基线方法相比,CMMST模型显示出更高的性能.
- 即使使用更长的预测间隔,也保持了高预测精度.
- 该模型有效地捕捉了复杂的用户偏好和观看行为.
结论:
- 拟议的CMMST模型为自适应360°视频流提供了一个有前途的解决方案.
- 这种方法可以显著改善虚拟现实和其他沉浸式平台的用户体验.
- 多式联网功能和注意力机制的整合是准确预测视窗口的关键.
相关概念视频
Relative Motion Analysis using Rotating Axes
531
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
531
Vector Transformation in Rotating Coordinate Systems
1.8K
Consider a vector rotating about an axis with an angular velocity, such that its tip sweeps a circular path.
1.8K
Cross Product
330
The cross product is a fundamental concept in vector algebra that is a vector operation on two different vectors to obtain a third vector. Unlike the scalar product, the cross product results in a vector quantity perpendicular to both the original vectors.
The magnitude of the cross product is obtained by multiplying the magnitude of both the vectors and the sine of the angle between them. This means that a larger angle between the vectors will lead to a greater magnitude of the cross product.
The magnitude of the cross product is obtained by multiplying the magnitude of both the vectors and the sine of the angle between them. This means that a larger angle between the vectors will lead to a greater magnitude of the cross product.
330
Uniform Depth Channel Flow
144
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
144
Depth Perception and Spatial Vision
900
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
900
Scaling
315
In designing and analyzing filters, resonant circuits, or circuit analysis at large, working with standard element values like 1 ohm, 1 henry, or 1 farad can be convenient before scaling these values to more realistic figures. This approach is widely utilized by not employing realistic element values in numerous examples and problems; it simplifies mastering circuit analysis through convenient component values. The complexity of calculations is thereby reduced, with the understanding that...
315


