Click to Correction: Interactive Bidirectional Dynamic Propagation Video Object Segmentation Network

Shuting Yang ¹, Xia Yuan ², Sihan Luo ²

⁰Institute of Agricultural Economy and Information Technology, Ningxia Academy of Agriculture and Forestry Sciences, Yinchuan 750002, China.

Sensors (basel, Switzerland) +

|

October 16, 2024

View abstract on PubMed

Summary

This study introduces a new interactive video object segmentation network that uses click inputs for precise results. The method achieves state-of-the-art performance with minimal user interaction, improving segmentation quality.

Area Of Science

Computer Vision
Image Processing
Machine Learning

Background

High-quality video object segmentation is a complex challenge in visual computing.
Interactive segmentation methods can enhance segmentation accuracy.
Existing methods may require significant user input or struggle with scale variations.

Purpose Of The Study

To propose a novel multi-round interactive dynamic propagation network for instance-level video object segmentation.
To leverage click interactions for improved segmentation accuracy and efficiency.
To achieve state-of-the-art results with reduced user effort.

Main Methods

Developed a network with a user interaction segmentation module and a bidirectional dynamic propagation module.
Designed a prior segmentation network within the interaction module to handle user-clicked objects of varying scales.
Employed bidirectional propagation and fusion of segmentation masks across multiple interaction rounds.

Main Results

The proposed method demonstrated state-of-the-art segmentation results on benchmark datasets.
Achieved high-precision video object segmentation.
Required significantly fewer click interactions compared to existing methods.

Conclusions

The multi-round interactive dynamic propagation network effectively enhances video object segmentation.
Click-based interaction combined with dynamic propagation offers a promising approach for precise and efficient segmentation.
The method shows potential for real-world applications demanding accurate object tracking and segmentation.

Keywords:

bidirectional propagation click-based interactive interactive segmentation video object segmentation