立体人造复合眼用于在三维空间中的时空感知
Byungjoon Bae1, Doeon Lee1, Minseong Park1
1Department of Electrical and Computer Engineering, University of Virginia, Charlottesville, VA 22904, USA.
Science robotics
|May 15, 2024
概括
研究人员模仿了祈祷的视力,创造了用于3D物体跟踪的人工复合眼睛. 这种仿生成像仪提供了节能,精确的时空传感和跟踪,具有低延迟.
科学领域:
- 生物仿真工程 生物仿真工程
- 机器人和计算机视觉技术
- 神经科学和感官系统.
背景情况:
- 关节动物的眼睛擅长物体跟踪和广视野,但对静态物体缺乏深度感知.
- 大多数关节动物使用运动抛物线来追踪3D物体,与哺乳动物不同.
- 祈祷灵独特地结合了复合眼睛和立体眼睛,用于3D对象识别.
研究的目的:
- 用人工复合眼来模仿祈祷的视觉系统,用于3D时空对象感知和跟踪.
- 开发一个节能系统,在视觉信息处理方面具有最小的延迟.
- 探索边缘计算和传感能力的硬件和软件联合设计.
主要方法:
- 设计和制造立体合的人造复合眼睛,灵感来自祈祷灵的视力.
- 使用突触设备和联合分割学习算法实现了边缘处理.
- 评估了时空物体传感和光学流量跟踪精度和能耗.
主要成果:
- 生物仿真成像仪在3D空间中实现了精确的时空物体传感和跟踪,视野广.
- 该系统在追踪过程中显示出0.3厘米的平均平方误差.
- 能源消耗量约为4毫度,比传统的CMOS成像系统低400倍以上.
结论:
- 立体人造复合眼有效地复制了三维物体感知和跟踪的祈祷视觉.
- 用突触设备和联合学习进行边缘处理,可实现节能,低延迟的视觉传感.
- 这种仿生方法强调了将自然设计与共同设计的技术集成为先进的边缘计算和传感的潜力.
相关概念视频
01:15Depth Perception and Spatial Vision
631
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
631
01:24Vision
53.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.2K