Related Experiment Video
Updated: Mar 24, 2026

Quantitative Visualization and Detection of Skin Cancer Using Dynamic Thermal Imaging
Published on: May 5, 2011
A novel multi-agent spatiotemporal fusion framework for intelligent skin cancer diagnosis
Peiyao Zheng1, Jin Yang2, Xuanru Wen3
1College of Traditional Chinese Medicine, Hubei University of Chinese Medicine, Hubei, China.
Introduction:
Skin cancer is one of the most common malignancies worldwide, and early-stage diagnosis remains challenging due to its morphological similarity to benign lesions. Most existing computer-aided diagnostic systems rely on single static images, overlooking temporal information that is critical for distinguishing progressive malignancy.
Methods:
We propose a novel multi-agent spatiotemporal fusion framework to enhance diagnostic accuracy. The framework consists of three key components: (1) a spatial agent based on a convolutional neural network for high-fidelity static feature extraction; (2) a temporal agent employing gated recurrent units to model longitudinal lesion evolution; and (3) a collaboration agent that dynamically fuses spatial and temporal representations via an attention-based weighting strategy.
Results:
Experiments on large-scale public dermoscopic datasets showed that our method achieved an accuracy of 94.5%, an F1-score of 93.8%, and an AUC of 0.97-outperforming traditional machine learning models, CNN classifiers, and 3D-CNN baselines. Ablation studies further confirmed the critical contribution of temporal modeling and adaptive fusion, particularly in differentiating early melanoma from atypical nevi.
Discussion:
This work highlights the potential of spatiotemporal modeling to improve early skin cancer detection and provides a promising direction for AI-assisted diagnosis of other chronic diseases requiring longitudinal monitoring.
More Related Videos
09:37Combining Reflectance Confocal Microscopy with Optical Coherence Tomography for Noninvasive Diagnosis of Skin Cancers via Image Acquisition
Published on: August 18, 2022
07:13Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities
Published on: October 27, 2023