LENS: A mammography-specific hybrid CNN-Transformer with lesion-aware evidence modeling

Artificial Intelligence (AI) models for mammography classification is prone to shortcut learning because diagnostically relevant evidence is typically sparse, localized, and easily dominated by non-lesion background context. This study aimed to develop a mammography-specific framework that integrates lesion-focused evidence with global image representations to improve classification performance and provide more clinically interpretable decision support.

We propose LENS, a hybrid CNN-Transformer family designed specifically for mammography. LENS combines a lightweight multi-scale convolutional neural network (CNN) backbone with an alternating local-global Transformer encoder. In addition to global image representations, a weakly supervised lesion-aware branch identifies and aggregates suspicious regional evidence to support image-level prediction. LENS was evaluated on the large-scale VinDrMammo dataset for the three-class mammography task and compared to advanced architectures, including ConvNeXt, DINOv2, GMIC, and Swin Transformer under a unified experimental protocol.

LENS-Base achieved the highest overall Accuracy of 85.5%, Macro F1-score of 79.6%, and Matthews correlation coefficient of 0.65. Quantitative localization evaluation results indicated that the selected regional evidence frequently overlapped with annotated abnormalities. Furthermore, these promising results come with fewer parameters and lower FLOPs.

LENS integrates local lesion-related features with global anatomical context to achieve improved class-balanced mammography classification while providing quantitatively supported lesion-focused evidence. These findings suggest that LENS is a promising framework for AI-assisted mammography screening.