通过揭示人类视频感知表征,对视频质量进行盲人预测
概括
本研究引入了一种用于盲人视频质量评估 (VQA) 的新方法,通过对人类对时间扭曲的视觉感知进行建模. 该方法使用视频的几何性质来准确预测主观时间质量.
科学领域:
- 计算机视觉 计算机视觉
- 人与计算机的交互
- 信号处理 信号处理
背景情况:
- 盲人视频质量评估 (VQA) 在准确评估未经精选的视频中的时间扭曲方面面临挑战.
- 现有的方法缺乏人类视觉系统 (HVS) 如何感知时间视频质量的强大模型,阻碍了准确的预测.
- 在自然视频中发现时间直线定律为感知建模提供了新的途径.
研究的目的:
- 为盲人VQA开发一种新的方法,准确地模拟HVS对时间扭曲的感知.
- 引入基于视觉感知领域的几何性质的复杂时间扭曲的统一表示.
- 为精确的时间质量评估创建一个感知时间质量评估器 (PTQE).
主要方法:
- 设计了一种新的"videolet"单元,嵌入连续的来进行感知表现.
- 时间扭曲是通过测量与HVS的时间直度定律相对的角度和线性位移来量化.
- 一个PTQE是通过汇总来自单个视频小组的分数来构建的,以评估整体视频时间质量.
主要成果:
- 提出的感知表征有效地预测了主观的时间质量.
- 当PTQE与空间质量指标相结合时,可以在野生视频数据集上实现最先进的性能.
- 在没有参数调整的情况下,PTQE证明了数据集的概括性,并且在视频插入任务中显示了潜力.
结论:
- 模拟HVS对时间视频特征的感知,特别是几何性质,对于准确的盲视频QA至关重要.
- PTQE为评估时间视频质量提供了一个强大的,可泛化和无参数的解决方案.
- 这种方法对改善各种与时间相关的视频增强任务有影响.
相关概念视频
01:12Perceptual Constancy
368
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
368
01:15Depth Perception and Spatial Vision
610
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
610