时间融合:连续时间光场视频因子化
概括
本研究介绍了临时融合 (TF),这是一种用于无眼镜3D显示的新方法,可以减少视觉闪,并改善光场视频中的图像质量. TF增强了时间一致性和重建质量,以获得更舒适的观看体验.
科学领域:
- 计算机视觉 计算机视觉
- 显示技术 显示技术
- 3D 图形 3D 图形
背景情况:
- 分子显示器通过发射全抛物线光场而提供无眼镜的3D,而不会降低空间分辨率.
- 静态光场重建使用基于的低等级分解,但由于感知的连续时间性质,这会导致视频中的工件和闪.
研究的目的:
- 开发一种新的光场视频因子化框架,以解决无眼镜3D显示器中的文物和视觉不适.
- 将连续时间视力持续效应 (POV) 纳入因子化过程,以提高视觉质量.
主要方法:
- 引入了时间融合 (TF),一个框架,明确地将连续时间的POV效应制定为全球因子化目标.
- 在LCD子上开发了序列级的代更新,以及用于GPU实现的高效立方体智能分解算法.
- 设计了TF-C,用于低延迟应用程序的轻量级因果框架.
主要成果:
- 与基于框架的因子分解相比,TF/TF-C显著提高了时间一致性,减少了85%/91%的闪值.
- 重建质量得到了提高,PSNR值分别增加了5.0dB和3.7dB.
- 一个具有高刷新率液晶显示器的原型双层计分显示器在现实应用中展示了卓越的视觉质量.
结论:
- 时间融合框架有效地解决视觉闪,并提高光场视频的重建质量.
- 拟议的方法可以实现实际的GPU实现,并支持低延迟应用程序,为改善无眼镜3D体验铺平道路.
- 实验结果和原型演示验证了TF/TF-C在现实场景中的有效性.
相关概念视频
01:11Continuous -time Fourier Transform
269
The Fourier series is instrumental in representing periodic functions, offering a powerful method to decompose such functions into a sum of sinusoids. This technique, however, necessitates modification when applied to nonperiodic functions. Consider a pulse-train waveform consisting of a series of rectangular pulses. When these pulses have a finite period, they can be accurately represented by a Fourier series. Yet, as the period approaches infinity, resulting in a single, isolated pulse, the...
269
01:16Focusing of Light in the Eye
1.9K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
1.9K
01:21Linear Approximation in Time Domain
59
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
59
01:27Uniform Depth Channel Flow
58
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
58
02:16Light Acquisition
8.4K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.4K
01:20Deconvolution
127
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
127