Boosting integral-based human pose estimation through implicit heatmap learning

Area of Science:

• Computer Vision
• Machine Learning

Background:

• Human pose estimation methods include heatmap-, regression-, and integral-based approaches.
• Integral-based methods offer advantages like end-to-end learning but suffer from lower performance.
• Existing methods struggle with ambiguity in shape and variance for implicit heatmaps.

Purpose of the Study:

• To revisit and enhance integral-based approaches for human pose estimation.
• To propose a novel implicit heatmap learning framework to mitigate ambiguity issues.
• To achieve competitive performance while retaining the benefits of integral-based methods.

Main Methods:

• Introduced Simple Implicit Heatmap Normalization (SIHN) to replace softmax normalization for efficient keypoint localization.
• Proposed Differentiable Spatial-to-Distributive Transform (DSDT) to map implicit heatmaps to transformation coefficients, resolving shape and variance ambiguity.
• Implemented a Wasserstein Distance-based Constraint (WDC) for stable supervision during implicit heatmap generation.

Main Results:

• The proposed framework effectively mitigates shape and variance ambiguity in implicit heatmaps.
• Achieved competitive performance against traditional heatmap-based approaches on MSCOCO and MPII datasets.
• Maintained the inherent advantages of integral-based methods, such as end-to-end learning.

Conclusions:

• The novel implicit heatmap learning framework significantly enhances integral-based human pose estimation.
• The proposed SIHN, DSDT, and WDC methods effectively address keypoint ambiguity and improve performance.
• This research offers a promising direction for advancing integral-based human pose estimation techniques.