Related Experiment Video
Updated: Jul 16, 2026

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
Published on: April 21, 2023
Systematic Evaluation of Vision Transformers for Automated Cervical Cancer Classification: Optimization, Statistical
Nisreen Albzour1, Sarah S Lam1
1School of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY 13902, USA.
Abstract:
Background/Objectives: Manual Pap smear analysis for cervical cancer screening is limited by inter-observer variability, time constraints, and restricted expert availability. Although convolutional neural networks (CNNs) have automated cervical cell classification, they remain limited in modeling long-range spatial dependencies and often lack clinical interpretability. Methods: In this study, Vision Transformer (ViT) architectures were systematically optimized to enhance automated cervical cancer screening and improve interpretability. The Herlev dataset (917 images: 242 normal, 675 abnormal) was utilized to optimize ViT-Tiny, a lightweight ViT architecture designed for reduced computational complexity, through a comprehensive evaluation of augmentation strategies, class weighting, and hyperparameters. Results: The optimal configuration achieved a cross-validation accuracy of approximately 95% (94.89% for the best replicated configuration), in which random horizontal flipping and class weighting (0.7 × 1.3) were identified as most effective. Gradient-weighted Class Activation Mapping (Grad-CAM) analysis confirmed that model attention corresponded to clinically relevant morphological features, including nuclei regions, cell boundaries, and chromatin texture, which align with cytopathological criteria. Conclusions: These findings indicate that Vision Transformers can deliver accurate and interpretable decision support for cervical cancer screening by combining competitive classification performance with attention-based transparency relevant to medical AI. Further validation on larger, multi-center datasets remains necessary before clinical deployment.
