网格卷积用于3D人类姿势估计的3D姿势估计
IEEE transactions on pattern analysis and machine intelligence
|December 3, 2025
概括
本研究介绍了一种新的网格表示学习方法,用于从2D关键点对3D人体姿势进行估计. 拟议的GridConv方法在基准数据集上显著优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人与计算机的交互
背景情况:
- 从2D关键点对3D人体姿势的估计对于以人为中心的计算机视觉至关重要.
- 现有的方法在准确地表示和学习2D图形数据以进行3D提升方面面临挑战.
研究的目的:
- 开发一种新的网格表示学习范式,用于改进3D人类姿势估计.
- 引入GridConv和语义网格转换 (SGT) 以将2D姿势映射到正规的网格结构中.
- 通过注意力机制增强GridConv,并开发用于视频数据的时空网络.
主要方法:
- 使用基于语义网格转换 (SGT) 的 GridConv 制定了一个网格表示学习范式.
- 使用手工制作和可学习方法实施SGT,可学习版本显示出卓越的性能.
- 引入了一个注意模块来增强 GridConv 的上下文编码功能.
- 为单和视频输入分别开发了空间和空间时间网格提升网络.
主要成果:
- 拟议的电网提升网络在Human3.6M和MPI-INF-3DHP数据集上显著优于现有的方法.
- 手工和可学习的SGT方法都取得了有希望的结果,可学习的SGT表现更好.
- 增强的GridConv有了注意力,改善了对上下文线索的编码.
- 时空网络有效地捕获了空间和时间的联合变化.
结论:
- 使用GridConv的新型网格表示学习范式显示了3D人类姿势估计的巨大潜力.
- 提出的方法实现了最先进的结果,并展示了强大的概括能力.
- 该方法在各种基于关键点的任务中有效,包括3D手姿势估计,头姿势估计和动作识别.
更多相关视频
06:32Author Spotlight: Automated Deep Brain Stimulation for Parkinson's Disease - Exploring the Possibilities and Challenges of Home Monitoring
Published on: July 14, 2023
1.8K
06:20Author Spotlight: Development of an Automated Camera-Based System for Real-Time Blast Overpressure Monitoring and TBI Risk Assessment in Military Training
Published on: December 6, 2024
3.2K
相关概念视频
Deconvolution
527
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
527
Centroid of a Body: Problem Solving
1.8K
The centroid of a body is a crucial concept in engineering and physics. Finding the centroid of a body can help determine its stability, its balance point, and even its design. In this context, consider a thin wire bent in the form of a quarter circular arc. Polar coordinates are used to calculate the centroid. The wire is first divided into small differential elements of a length equal to the radius multiplied by the differential angle.
The x-coordinates and y-coordinates of each element's...
The x-coordinates and y-coordinates of each element's...
1.8K
Convolution Properties II
559
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
559
Curvilinear Motion: Rectangular Components
1.0K
Curvilinear motion characterizes the movement of a particle or object along a curved path, notably evident when envisioning a car navigating a winding road. If the car starts at point A, its position vector is established within a fixed frame of reference, where the ratio of the position vector to its magnitude signifies the unit vector pointing in the position vector's direction.
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
1.0K
Three-Dimensional Force System:Problem Solving
1.3K
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
1.3K
Three-Dimensional Force System
2.8K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.8K
