从正写和透视图像中对自然物体形状的单眼重建
1Department of Cognitive Sciences, University of California, Irvine, Irvine, CA, United States.
Frontiers in neuroscience
|April 30, 2024
概括
人类对象通过利用两个对称平面和3D紧度,准确地感知3D对象形状,特别是自然的形状. 这一发现完善了从图像中进行3D形状重建的计算模型.
科学领域:
- 认知心理学 认知心理学
- 计算机视觉 计算机视觉
- 计算神经科学是一种神经科学.
背景情况:
- 人类对三维 (3D) 物体形状的感知对于与环境的相互作用至关重要.
- 以前用于3D形状重建的计算模型依赖于镜像对称性和3D紧性等约束.
- 了解视觉系统对准确3D形状感知的限制仍然是一个活跃的研究领域.
研究的目的:
- 研究人类在从二维图像 (正写和视角) 中重建3D形状方面的表现.
- 开发和验证3D形状重建的增强计算模型,以考虑人类的表现.
- 确定人类视觉系统用于3D形状感知的关键约束.
主要方法:
- 人类对象从正写和视角图像中重建了3D形状.
- 计算模型是通过在现有约束之外结合二次镜像对称约束来阐述的.
- 测试了一般化模型与不同图像类型的人类表现的相关性.
主要成果:
- 与随机多面体相比,人类受试者在感知自然3D形状方面表现出高精度.
- 透视图像比正写图像在性能上只带来了微不足道的改善.
- 增强的计算模型,包括两个对称平面和3D紧度,显示了与人类表现的高相关性.
结论:
- 人类视觉系统可能使用两个对称平面和两种形式的3D紧性来进行强大的3D形状重建.
- 已识别的约束为理解和建模人类3D形状感知提供了坚实的基础.
- 该研究验证了计算模型在3D形状重建任务中预测人类表现的能力.
相关概念视频
01:15Depth Perception and Spatial Vision
631
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
631
01:07Electron Microscope Tomography and Single-particle Reconstruction
2.4K
Transmission electron microscopy (TEM) can be used to determine the 3D structure of biological samples with the help of techniques such as electron microscope tomography and single-particle reconstruction. While single-particle reconstruction can examine macromolecules and macromolecular complexes in vitro conditions only, tomography permits the study of cell components or small cells in vivo.
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...
2.4K