事件点网:仅从事件点云中恢复人类网格
IEEE transactions on visualization and computer graphics
|September 18, 2024
概括
本研究仅使用事件摄像头数据来探索人体网状恢复,绕过传统强度图像. 拟议的EventPointMesh框架成功地从稀疏的事件数据中重建人类形状,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 神经形态工程的神经形态工程
- 人类形状分析 人类形状分析
背景情况:
- 传统的人类网格恢复 (HMR) 依赖于强度图像,这些图像容易受到照明变化,隐私问题和高资源需求的影响.
- 事件摄像机通过捕捉高速度的亮度变化提供了替代方案,独立于照明条件,但它们在HMR中的应用尚未得到充分探索.
研究的目的:
- 调查仅使用事件摄像头数据重建人类形状的可行性.
- 为HMR开发一个新的框架,EventPointMesh,克服了基于强度的方法的局限性.
主要方法:
- 拟议的EventPointMesh框架将事件数据视为3D时空点云.
- 实施粗细的姿势特征提取策略,以捕捉全球和本地人体特征.
- 将分散事件点分组成对应于个体部位的细分部分,以便进行详细分析.
主要成果:
- 通过仅使用稀疏事件数据,证明了精确的人类网状复原.
- 在HMR任务中,EventPointMesh的表现优于现有的基线方法.
- 该方法通过结合全球和本地特征提取有效捕捉微妙的人类运动.
结论:
- 仅仅是事件摄像头数据就提供了足够的信息来进行强大的人体网格恢复.
- EventPointMesh为HMR提供了一种保护隐私,耐低光和高效的替代方案.
- 提出的方法推进了神经形态视觉在人类姿势和形状估计中的应用.
相关概念视频
01:00Elastic Collisions: Introduction
An elastic collision is one that conserves both internal kinetic energy and momentum. Internal kinetic energy is the sum of the kinetic energies of the objects in a system. Truly elastic collisions can only be achieved with subatomic particles, such as electrons striking nuclei. Macroscopic collisions can be very nearly, but not quite, elastic, as some kinetic energy is always converted into other forms of energy such as heat transfer due to friction and sound. An example of a nearly...
01:15Elastic Collisions: Case Study
Elastic collision of a system demands conservation of both momentum and kinetic energy. To solve problems involving one-dimensional elastic collisions between two objects, the equations for conservation of momentum and conservation of internal kinetic energy can be used. For the two objects, the sum of momentum before the collision equals the total momentum after the collision. An elastic collision conserves internal kinetic energy, and so the sum of kinetic energies before the collision equals...
01:20Mesh Analysis
Mesh analysis is a valuable method for simplifying circuit analysis using mesh currents as key circuit variables. Unlike nodal analysis, which focuses on determining unknown voltages, mesh analysis applies Kirchhoff's voltage law (KVL) to find unknown currents within a circuit. This method is particularly convenient in reducing the number of simultaneous equations that need to be solved.
A fundamental concept in mesh analysis is the definition of meshes and mesh currents. A mesh is a closed...
A fundamental concept in mesh analysis is the definition of meshes and mesh currents. A mesh is a closed...
01:10Mesh Analysis with Current Sources
Mesh analysis becomes simpler when analyzing circuits with current sources, whether independent or dependent. The presence of current sources reduces the number of equations required for analysis. Two cases illustrate this:
Current Source in One Mesh: The analysis process is straightforward when a current source is found in only one mesh within the circuit. Mesh currents are assigned as usual, with the mesh containing the current source excluded from the analysis. Kirchhoff's voltage law (KVL)...
Current Source in One Mesh: The analysis process is straightforward when a current source is found in only one mesh within the circuit. Mesh currents are assigned as usual, with the mesh containing the current source excluded from the analysis. Kirchhoff's voltage law (KVL)...
01:22Planar Rigid-Body Motion
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...