Related Experiment Videos
An explainable dual-branch transformer-ConvNeXt framework for robust lung histopathology classification
1School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, India.
Introduction:
Accurate histopathological discrimination of lung adenocarcinoma (ACA) and squamous cell carcinoma (SCC) from benign tissue is a clinically demanding task in which the two malignant subtypes are frequently confused even by trained pathologists.
Methods:
We present a dual-branch deep learning framework that couples a hierarchical shifted-window vision transformer (SwinV2-CR-Tiny) with a fully-convolutional masked-autoencoder-pretrained convolutional network (ConvNeXtV2-Tiny) to capture complementary global-contextual and local-textural representations of haematoxylin-and-eosin (H&E) stained tissue. The two branches are integrated through a learnable cross-feature gating module, refined by feature-space gated-modulation heads, and compressed by an Electric-Eel-Foraging-Optimizer (EEFO)-driven feature-selection stage. A Crested-Porcupine-Optimizer (CPO) calibrates class weighting and a Fennec-Fox-Optimizer (FFO) tunes per-class decision thresholds, while training combines Macenko stain normalization, CLAHE, MixUp/CutMix augmentation, a focal loss with label smoothing, Sharpness-Aware Minimization (SAM) and Stochastic Weight Averaging (SWA). Predictive uncertainty is quantified by Monte-Carlo (MC) dropout and model decisions are explained with Grad-CAM++ and Integrated Gradients. The model was evaluated on a stratified 70/15/15 partition of the LC25000 lung cohort (15,000 images; 5,000 per class).
Results:
The proposed model attains a test accuracy of 94.04%, macro-F1 of 0.9404, macro one-vs-rest AUC of 0.9886 and Cohen's κ of 0.9107, with near-perfect benign separation (sensitivity 0.999) and the residual error concentrated in the clinically expected ACA↔SCC confusion. Contrary to our prior expectation, MC-dropout predictive uncertainty did not separate misclassified from correctly classified cases on this cohort (mean across-pass standard deviation 0.0261 for errors versus 0.0269 for correct predictions). We additionally report a negative calibration finding: the model is systematically under-confident and naive temperature scaling increased the expected calibration error.
Discussion:
The negative uncertainty result is attributed to the same confidence-suppressing training objective and is reported rather than omitted. We further discuss the data-provenance characteristics of LC25000 that constrain the interpretation of absolute accuracy. The framework offers an interpret-able, transparently-evaluated decision-support pipeline whose error profile aligns with established lung-cancer histomorphology.