Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Leveraging Mixture Alignment for Multi-Source Domain Adaptation.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2025
Same author

Minimal data poisoning attack in federated learning for medical image classification: An attacker perspective.

Artificial intelligence in medicine·2024
Same author

Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review.

Sensors (Basel, Switzerland)·2023
Same author

AAP-MIT: Attentive Atrous Pyramid Network and Memory Incorporated Transformer for Multisentence Video Description.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2022
Same author

Facial Expression Recognition in Videos using Dynamic Kernels.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2020
Same author

Robust manifold broad learning system for large-scale noisy chaotic time series prediction: A perturbation perspective.

Neural networks : the official journal of the International Neural Network Society·2019

Related Experiment Video

Updated: Jul 2, 2025

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
04:48

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

399

Memory Guided Transformer With Spatio-Semantic Visual Extractor for Medical Report Generation.

Peketi Divya, Yenduri Sravani, Chalavadi Vishnu

    IEEE Journal of Biomedical and Health Informatics
    |February 29, 2024
    PubMed
    Summary

    This study introduces a novel spatio-semantic visual extractor (SSVE) to improve automatic radiology report generation. The SSVE enhances transformer models by capturing fine-grained image details, leading to more accurate and efficient diagnostic reports.

    More Related Videos

    Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
    04:48

    Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

    Published on: November 30, 2022

    2.7K
    A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
    04:23

    A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

    Published on: April 21, 2023

    1.8K

    Related Experiment Videos

    Last Updated: Jul 2, 2025

    Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
    04:48

    Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

    Published on: July 5, 2024

    399
    Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
    04:48

    Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

    Published on: November 30, 2022

    2.7K
    A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
    04:23

    A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

    Published on: April 21, 2023

    1.8K

    Area of Science:

    • Medical Imaging
    • Artificial Intelligence
    • Radiology

    Background:

    • Medical imaging report generation is time-consuming and prone to errors, especially for inexperienced radiologists.
    • Automatic reporting systems aim to improve diagnostic accuracy and efficiency.
    • Transformer models show promise for report generation but struggle with capturing detailed image features.

    Purpose of the Study:

    • To develop an improved method for automatic radiology report generation.
    • To enhance transformer models' ability to extract spatial and semantic information from medical images.
    • To enable more detailed and accurate radiology reports.

    Main Methods:

    • Proposed a spatio-semantic visual extractor (SSVE) integrated into a ResNet 101 backbone.
    • Incorporated a deformable network for spatially invariant features and a semantic network for multi-scale semantic information.
    • Fused network representations to capture fine-grained image details.

    Main Results:

    • The proposed SSVE model demonstrated superior performance compared to existing methods.
    • The model effectively captures multi-scale spatial and semantic information from radiology images.
    • Enhanced detail in generated reports leading to improved diagnostic potential.

    Conclusions:

    • The SSVE significantly improves the quality and accuracy of transformer-based medical report generation.
    • This approach addresses limitations in capturing fine-grained details in current models.
    • The method holds potential for enhancing diagnostic efficiency and accuracy in radiology.