一个现实世界动画超分辨率的基准与颜色退化和多尺度多频率对齐
概括
这项研究引入了一个新的超分辨率 (SR) 动画基准和方法,从低分辨率输入中改进了高分辨率生成. 颜色感知动画超分辨率 (CAASR) 方法实现了对2D和3D动画的最先进结果.
科学领域:
- 计算机视觉
- 图像处理
- 人工智能
背景情况:
- 动画超分辨率 (SR) 旨在将低分辨率 (LR) 的动画提升为高分辨率 (HR).
- 现有的SR方法通常会因为动画特有的降解而失败,与现实世界的图像问题不同.
- 数字动画面临着独特的压缩和传输工件,如颜色带和转移.
研究的目的:
- 推出一个新的基准,ADASR,为现实世界动画超分辨率.
- 提出一种新的方法,即颜色感知动画超分辨率 (CAASR),解决动画特定的退化问题.
- 改善2D和3D动画的高分辨率的恢复.
主要方法:
- 开发了ADASR数据集,包括2D和3D动画内容.
- 拟议的CAASR, 结合适合动画的颜色降解模拟.
- 实现了多个尺度和多个频率的调整机制以实现强大的特征提取.
主要成果:
- CAASR有效地解决了动画中的颜色带,屏蔽和颜色转移.
- 该方法在AVC数据集和新的ADASR数据集上实现了最先进的性能.
- 在2D和3D动画内容中展示了HR的卓越恢复.
结论:
- 拟议的ADASR基准和CAASR方法显著提升了动画超分辨率.
- CAASR的色彩感知方法和强大的特征提取是其成功的关键.
- 这些发现有助于工业应用需要高质量的动画恢复.
相关概念视频
Super-resolution Fluorescence Microscopy
7.6K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.6K
Upsampling
309
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
309


