一个节能的动态反图像信号处理器用于三维飞行时间传感器
Yongsoo Kim1,2, Jaehyeon So3, Chanwook Hwang3
1Department of Semiconductor and Display Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea.
Sensors (Basel, Switzerland)
|November 9, 2024
概括
我们为3D飞行时间 (ToF) 传感器开发了一种节能的图像信号处理器 (ISP). 这种动态反ISP提高了可移植设备上增强现实 (AR) 和虚拟现实 (VR) 应用的准确性和功率效率.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 硬件加速器 硬件加速器
背景情况:
- 使用3D飞行时间 (ToF) 传感器进行对象识别对于增强现实 (AR) 和虚拟现实 (VR) 至关重要.
- 精确分析的高质量图像处理需要大量的计算资源,挑战低功耗的便携式设备.
- 现有的方法在资源有限的环境中难以平衡精度和能源效率.
研究的目的:
- 为3D ToF传感器提出一种新的动态反配置图像信号处理器 (ISP).
- 为了提高AR/VR应用的图像处理的精度和能源效率.
- 为了使3D ToF传感器在低功耗,小形状元件设备中有效地利用.
主要方法:
- 动态区域提取:计算和后处理仅限于每个框架内的有效应用领域.
- 动态分辨率:适当的分辨率是通过自适应性来确定并应用于每个.
- 硬件效率高的实现:旨在提高处理速度和最大限度地降低功耗.
主要成果:
- 实现了每秒178 (fps) 的最大性能和高能效,高达123.15 fps/W.
- 使用手姿势估计 (HPE) 加速器证明了卓越的准确性,显示平均平均平方误差 (MSE) 为10.03毫米,而基线ISP的20.25毫米.
- 拟议的ISP有效地处理3D ToF传感器数据,同时保持高精度并显著降低功耗.
结论:
- 动态反ISP为准确和节能的3D ToF图像处理提供了可行的解决方案.
- 这种技术非常适合用于AR和VR中使用的低功耗,小形状因子设备.
- 拟议的ISP显著提高了性能和能源效率,与传统方法相比.
相关概念视频
Gyroscope
A gyroscope is defined as a spinning disk in which the axis of rotation is free to assume any orientation. When spinning, the orientation of the spin axis is unaffected by the orientation of the body that encloses it. The body or vehicle enclosing the gyroscope can be moved from place to place, while the orientation of the spin axis remains the same. This makes gyroscopes very useful in navigation, especially where magnetic compasses cannot be used, such as in crewed and crewless spacecraft,...
Relative Motion Analysis using Rotating Axes
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
Time and frequency -Domain Interpretation of PI Control
Proportional-Integral (PI) controllers are essential in many control systems to improve stability and performance. They are commonly used in everyday devices like thermostats to enhance system damping and reduce steady-state error. When the zero in the controller's transfer function is optimally placed, the system benefits significantly in terms of stability and accuracy.
Acting as a low-pass filter, the PI controller slows the system's response and extends settling times. This requires careful...
Acting as a low-pass filter, the PI controller slows the system's response and extends settling times. This requires careful...


