Spatial-Temporal Consistency Based on Semi-Supervised Learning for Echocardiography Video Segmentation

Echocardiography video segmentation is critical for cardiovascular disease diagnosis. However, it still suffers from the challenge of dual-level bias. This challenge derives from the frame-level bias in temporal dimension and the object-level bias in the spatial dimension on echocardiography video. To overcome this challenge, we propose a spatial-temporal consistency (STC) model based on semi-supervised learning for echocardiography video segmentation. This model aligns and fuses inter-frame and inter-object context-aware feature representations. First, the STC explores a temporal context-aware (TCA) module to focus on motion differences between frames. This module extracts temporal correlation through inter-frame attention to compensate for important temporal semantic information. Second, the STC proposes a multi-object semantic adaptation (MSA) module that not only adaptively calibrates frame-level feature and object-level feature, but also fuses these features at different layers. Finally, the STC considers spatial-temporal consistency constraint to reduce prediction error among multiple MSA modules, thereby achieving low-entropy prediction. Extensive experiments demonstrate that the STC achieves state-of-the-art performance for echocardiography video segmentation.