Robust 2D Human Pose Estimation with Parallel Graph-Attention Modeling and Entropy-Aware Feature Decoding

Area of Science:

• Computer Vision
• Artificial Intelligence
• Machine Learning

Background:

• 2D human pose estimation is challenged by occlusion and background interference, leading to uncertainty in visual representations.
• Existing methods struggle to effectively integrate local and global information for robust keypoint localization.

Purpose of the Study:

• To propose PMNet, a Parallel Modeling Network, for robust and efficient 2D human pose estimation.
• To address representational entropy caused by occlusion and clutter using complementary modeling approaches.

Main Methods:

• PMNet integrates explicit graph-based structural modeling and implicit self-attention-based semantic modeling via parallel pathways.
• Key components include a criss-cross attention module, adaptive nonlinear fusion, and error-compensated decoding.
• The framework jointly captures local dependencies and global contextual relationships among keypoints.

Main Results:

• PMNet achieved state-of-the-art performance on MPII (92.42% PCKh@0.5) and COCO (77.3% AP) benchmarks.
• Ablation studies confirmed the effectiveness of individual components, showing improved signal-to-noise ratios and heatmap concentration.
• Qualitative visualizations demonstrated enhanced robustness and accuracy in challenging scenarios.

Conclusions:

• PMNet offers a robust and efficient solution for 2D human pose estimation, effectively handling occlusion and background interference.
• The parallel modeling approach successfully balances structural and semantic information, reducing uncertainty.
• The framework shows significant potential for real-world applications like surveillance and autonomous systems.