Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Unsupervised large-cone-angle artifact suppression for CBCT reconstruction via neural radiance fields.

Optics express·2026

Same author

Imaging foundation model for universal enhancement of non-ideal measurement CT.

Nature communications·2026

Same author

STNAGNN: Data-driven Spatio-temporal Brain Connectivity beyond FC.

Proceedings of machine learning research·2026

Same author

HYPERBOLIC MODEL AGGREGATION FOR FEDERATED LEARNING IN FMRI.

Proceedings. IEEE International Symposium on Biomedical Imaging·2026

Same author

Chebulinic Acid Exerts Anti-rotavirus Effects through the p38MAPK/ERK1/2 Signaling Pathway.

Current pharmaceutical design·2026

Same author

[Clinical efficacy and safety of totally laparoscopic subtotal gastrectomy with cardia-gastric fundus preservation in middle-upper gastric cancer].

Beijing da xue xue bao. Yi xue ban = Journal of Peking University. Health sciences·2026

Same journal

Distributionally Robust Feature Selection.

Advances in neural information processing systems·2026

Same journal

On the Identifiability of Hybrid Deep Generative Models: Meta-Learning as a Solution.

Advances in neural information processing systems·2026

Same journal

Unlocking hidden biomolecular conformational landscapes in diffusion models at inference time.

Advances in neural information processing systems·2026

Same journal

JADE: Joint Alignment and Deep Embedding for Multi-Slice Spatial Transcriptomics.

Advances in neural information processing systems·2026

Same journal

Learning to Route: Per-Sample Adaptive Routing for Multimodal Multitask Prediction.

Advances in neural information processing systems·2026

Same journal

Emergence and Evolution of Interpretable Concepts in Diffusion Models.

Advances in neural information processing systems·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Jul 20, 2025

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

Class-Aware Adversarial Transformers for Medical Image Segmentation.

Chenyu You¹, Ruihan Zhao², Fenglin Liu³

¹Yale University.

Advances in Neural Information Processing Systems

|August 3, 2023

Summary

This summary is machine-generated.

CASTformer, a novel adversarial transformer, enhances 2D medical image segmentation by incorporating multi-scale features and class-aware modules. This approach significantly improves accuracy over existing transformer models.

More Related Videos

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Published on: April 21, 2023

Related Experiment Videos

Last Updated: Jul 20, 2025

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Published on: April 21, 2023

Area of Science:

Computer Vision
Medical Image Analysis
Artificial Intelligence

Background:

Transformers show promise in medical image analysis for long-range dependency modeling.
Current transformer models face limitations in feature capture, multi-scale representation, and segmentation accuracy.

Purpose of the Study:

To introduce CASTformer, an adversarial transformer model designed to overcome limitations in 2D medical image segmentation.
To improve the accuracy and feature representation capabilities of transformer-based medical image segmentation.

Main Methods:

Utilized a pyramid structure for multi-scale feature representation and variation handling.
Developed a class-aware transformer module to learn discriminative object regions with semantic structures.
Employed an adversarial training strategy with a transformer-based discriminator for enhanced feature capture.

Main Results:

CASTformer achieved significant improvements over state-of-the-art transformer-based methods on three benchmarks.
Demonstrated absolute Dice score improvements ranging from 2.54% to 5.88% compared to previous models.
Qualitative experiments highlighted model transparency and the benefits of transfer learning for reduced dataset size.

Conclusions:

CASTformer offers a superior approach to 2D medical image segmentation compared to existing transformer models.
The model's multi-scale and class-aware design effectively addresses limitations in feature representation and accuracy.
CASTformer shows potential as a foundational model for various downstream medical image analysis tasks.