Multi-attention enhanced encoder-decoder network with hybrid transformer bottleneck for echocardiography image...

Automatic segmentation of 2D echocardiograms is a critical step in diagnosing and assessing heart diseases. Convolutional Neural Networks (CNNs), such as U-Net, have proven effective for medical image segmentation, but they often fall short in capturing long-range dependencies because convolution operations are inherently local. While transformer models capture the global context, they also may not be good in fine-grained localization. This study aims to develop a novel deep learning architecture that addresses these limitations by combining the strengths of CNNs and transformers for improved segmentation accuracy in 2D echocardiograms. We propose a novel encoder-decoder framework enriched with multiple attention mechanisms and hybrid bottleneck combining a Vision Transformer (ViT) and a Multi Receptive Field Block (MRFB). The integration of a ViT enables the modeling of long-range dependencies, while the MRFB improves multi-scale feature extraction and is specifically designed to improve the representation of spatial features and reduce the loss of spatial information. Enhanced by multiple attention mechanisms and deep supervision with Atrous Spatial Pyramid Pooling (ASPP), our model robustly captures both local and global contexts. Trained and validated on the CAMUS dataset, it achieves Dice Similarity Coefficients of 91.11±0.19, 87.60±0.11, and 87.85±0.29 for left ventricle endocardium, epicardium, and left atrium in two-chamber views, and 92.25±0.17, 87.29±0.17, and 91.71±0.10 in four-chamber views. Our model outperforms pure CNN-based (such as UNet), pure transformer-based (such as Swin-unet), and CNN-Transformer hybrid (such as UNETR-2d) architectures, achieving superior segmentation accuracy and robustness. Code is publicly available on the paper's https://github.com/saeedchamani/CAMUS_Segmentation_Hybrid_Bottleneck repository.