Deep Human Parsing with Active Template Regression.

Area of Science:

• Computer Vision
• Machine Learning
• Image Analysis

Background:

• Human parsing, the decomposition of human images into semantic regions, is a complex task.
• Existing methods often struggle with accuracy and precision in identifying fashion and body parts.

Purpose of the Study:

• To develop a novel framework for human parsing that improves accuracy and robustness.
• To formulate human parsing as an active template regression (ATR) problem.

Main Methods:

• The active template regression (ATR) framework uses learned mask templates and active shape parameters (position, scale, visibility) to generate precise semantic region masks.
• Deep Convolutional Neural Networks (CNNs) are employed to predict mask template coefficients and active shape parameters.
• Two separate CNNs are utilized: one with max-pooling for coefficients and one without max-pooling for precise shape parameter prediction.
• Fusion of network outputs and super-pixel smoothing are used for final result refinement.

Main Results:

• The ATR framework significantly outperforms state-of-the-art methods for human parsing.
• Achieved an F1-score of 64.38%, a substantial improvement over the previous 44.76%.

Conclusions:

• The proposed active template regression (ATR) framework offers a superior approach to human parsing.
• The method demonstrates significant advancements in accurately segmenting fashion and body regions in images.