Unsupervised Video Matting via Sparse and Low-Rank Representation

Area of Science:

• Computer Vision
• Image and Video Processing

Background:

• Existing video matting methods struggle with spatial and temporal consistency.
• Nonlocal priors in matting can lead to suboptimal sample selection and noise introduction.

Purpose of the Study:

• To develop a novel unsupervised video matting method.
• To achieve spatially and temporally consistent matting results.

Main Methods:

• Proposed a sparse and low-rank representation model for video matting.
• Utilized sparse representation for adaptive sample selection and nonlocal structure construction.
• Employed low-rank representation for global consistency of nonlocal structures.

Main Results:

• The method achieves high-quality matting across diverse challenging conditions.
• Demonstrated superior performance compared to existing unsupervised matting methods on benchmark datasets.
• Generated spatially and temporally consistent video mattes.

Conclusions:

• The proposed sparse and low-rank representation effectively addresses limitations of previous methods.
• This approach yields state-of-the-art unsupervised video matting performance.
• The method is robust to illumination changes, feature ambiguity, and motion.