EventEgo3D++:从头戴式事件摄像头3D捕捉人类运动
Christen Millerdurai1,2, Hiroyasu Akada1, Jian Wang1
1Visual Computing and Artificial Intelligence, Max Planck Institute for Informatics, SIC, Stuhlsatzenhausweg E1 4, Saarbrücken, 66123 Saarland Germany.
概括
EventEgo3D++通过事件摄像头增强自我中心的3D人类运动捕捉,克服低光和快速运动的挑战. 这种新的方法在头戴设备应用中实现了卓越的精度和实时性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 人与计算机的交互
背景情况:
- 单眼自我中心的3D人体运动捕捉是很困难的,特别是在弱光和快速运动的情况下.
- 现有的RGB摄像机方法在头戴设备应用中常见的这些具有挑战性的条件下失败.
研究的目的:
- 介绍EventEgo3D++,使用带有鱼眼镜头的单眼事件摄像头捕捉人类3D运动的第一个方法.
- 在具有挑战性的环境中解决当前方法的局限性.
主要方法:
- 使用LNES表示的事件摄像头数据进行精确的3D重建.
- 开发一个带有事件摄像头的移动头戴设备 (HMD) 原型.
- 捕获真实和合成数据集,包括偏心RGB流和SMPL体模型.
主要成果:
- 与现有解决方案相比,EventEgo3D++表现出卓越的3D精度和稳定性.
- 在140Hz实现实时3D姿势更新.
- 在受控的工作室和野外环境中验证.
结论:
- EventEgo3D++推进了自我中心的3D人类运动捕捉的最先进技术.
- 事件摄像机在具有挑战性的场景中提供可靠的线索,以准确捕捉运动.
- 开发的数据集和方法为未来的研究提供了全面的资源.
相关概念视频
Gyroscope
3.6K
A gyroscope is defined as a spinning disk in which the axis of rotation is free to assume any orientation. When spinning, the orientation of the spin axis is unaffected by the orientation of the body that encloses it. The body or vehicle enclosing the gyroscope can be moved from place to place, while the orientation of the spin axis remains the same. This makes gyroscopes very useful in navigation, especially where magnetic compasses cannot be used, such as in crewed and crewless spacecraft,...
3.6K
Absolute Motion Analysis- General Plane Motion
751
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
751


