从2D投影输入中学习3D转换的内部表示
Marissa Connor1, Bruno Olshausen2, Christopher Rozell3
1School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, U.S.A. marissa.c.connor@gmail.com.
Neural computation
|August 14, 2024
概括
本研究提出了一个计算模型,从二维运动中推断出3D结构,展示了生物视觉系统如何从视觉输入统计数据中学习3D转换.
科学领域:
- 计算神经科学是一种计算神经科学.
- 计算机视觉 计算机视觉 计算机视觉
- 数学建模的数学建模
背景情况:
- 生物视觉系统处理2D投影来感知3D结构.
- 了解3D转换的内部表示对于人工和生物智能至关重要.
研究的目的:
- 开发一个计算模型,从二维运动中推断出3D结构.
- 研究生物视觉系统如何从输入统计数据中学习3D转换.
- 在生物系统中展示适应性内部表示的概念验证.
主要方法:
- 使用多重运输运营商来建模3D点转换.
- 开发了一个旋转模型,从2D投射点运动中推断深度.
- 使用二维视觉刺激训练模型来学习旋转转换.
主要成果:
- 该模型成功地学习了Lie组的生成器,用于从2D输入中进行3D转换.
- 演示了模型从移动的2D点推断深度的能力.
- 展示了模型从2D训练数据中学习旋转转换的能力.
结论:
- 计算模型为理解生物视觉中的3D结构推理提供了一个框架.
- 这些发现表明,生物系统可以根据感官输入统计数据调整内部表示.
- 在结构-从-运动任务中,与人类心理物理性能相比,模型的表现显示出希望.
相关概念视频
Depth Perception and Spatial Vision
612
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
612
Coordinates and Map Projections
36
Coordinates and map projections are essential tools in accurately representing the Earth's surface for various applications, ranging from navigation to spatial analysis. The latitude and longitude coordinate system is a universally recognized framework for defining locations. Latitude specifies the distance of a point north or south of the equator, measured in degrees from 0° at the equator to 90° at the poles. Longitude indicates a location's position east or west of the prime meridian,...
36
Vector Transformation in Rotating Coordinate Systems
1.5K
Consider a vector rotating about an axis with an angular velocity, such that its tip sweeps a circular path.
1.5K
Vision
53.1K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.1K
Transformation of Plane Strain
159
When analyzing elongated structures like bars subjected to uniformly distributed loads, it is essential to understand the transformation of plane strain when coordinate axes are rotated. This transformation helps to assess how material deformation characteristics vary with orientation, which is crucial in materials science and structural engineering.
Under plane strain conditions, typical for members where one dimension significantly exceeds the others, deformations and resultant strains are...
Under plane strain conditions, typical for members where one dimension significantly exceeds the others, deformations and resultant strains are...
159
Relative Motion Analysis using Rotating Axes-Problem Solving
394
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
394


