MILI:从一个低分辨率图像的多人推断.
Kun Li1, Yunke Liu1, Yu-Kun Lai2
1Tianjin University, Tianjin 300350, China.
Fundamental research
|June 27, 2024
概括
这项研究引入了一个新的框架,用于从低分辨率图像中重建多个人. 该方法有效地处理阻塞,并改善特征提取,以便更好地进行3D人体姿势估计.
科学领域:
- 计算机视觉 计算机视觉
- 3D 人类重建 3D 人类重建
- 机器学习 机器学习
背景情况:
- 当前的多人重建技术在低分辨率图像中扎,人类占据的图像部分很小.
- 由于相机的局限性,低分辨率图像是常见的,这给准确的人体姿势估计带来了挑战.
研究的目的:
- 开发一个端到端的多任务框架,用于从低分辨率图像 (MILI) 进行多人推断.
- 增强从低分辨率数据中提取特征,并在多人场景中有效处理封闭.
主要方法:
- 利用对对的高分辨率和低分辨率图像来训练具有简单损失功能的恢复网络.
- 引入了一个闭塞感知面具预测网络,用于在3D网格回归过程中估计单个面具.
- 开发了一个多任务框架,用于强大的多人推断.
主要成果:
- 拟议的MILI框架在小规模和大规模数据集上显著优于最先进的方法.
- 从低分辨率图像进行多人重建的定量和质量改进.
- 恢复网络有效地从图像质量下降的特征中提取特征.
结论:
- MILI框架提供了一个强大的解决方案,用于从具有挑战性的低分辨率输入中进行3D人类重建.
- 遮蔽感知面具预测对于拥挤场景的准确重建至关重要.
- 这项工作提升了计算机视觉在分析现实世界的场景中复杂的人类互动的能力.
相关概念视频
01:15Depth Perception and Spatial Vision
627
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
627
01:37Super-resolution Fluorescence Microscopy
6.9K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
6.9K