Related Experiment Video
Updated: Jun 26, 2025
A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
Published on: April 21, 2023
Multimodal transformer graph convolution attention isomorphism network (MTCGAIN): a novel deep network for detection
Yulong Wang1, Yande Ren2, Yuzhen Bi2
1College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao, China.
Background:
In clinic, the subjectivity of diagnosing insomnia disorder (ID) often leads to misdiagnosis or missed diagnosis, as ID may have the same symptoms as those of other health problems.
Methods:
A novel deep network, the multimodal transformer graph convolution attention isomorphism network (MTGCAIN) is proposed in this study. In this network, graph convolution attention (GCA) is first employed to extract the graph features of brain connectivity and achieve good spatial interpretability. Second, the MTGCAIN comprehensively utilizes multiple brain network atlases and a multimodal transformer (MT) to facilitate coded information exchange between the atlases. In this way, MTGCAIN can be used to more effectively identify biomarkers and arrive at accurate diagnoses.
Results:
The experimental results demonstrated that more accurate and objective diagnosis of ID can be achieved using the MTGCAIN. According to fivefold cross-validation, the accuracy reached 81.29% and the area under the receiver operating characteristic curve (AUC) reached 0.8760. A total of nine brain regions were detected as abnormal, namely right supplementary motor area (SMA.R), right temporal pole: superior temporal gyrus (TPOsup.R), left temporal pole: superior temporal gyrus (TPOsup.L), right superior frontal gyrus, dorsolateral (SFGdor.R), right middle temporal gyrus (MTG.R), left middle temporal gyrus (MTG.L), right inferior temporal gyrus (ITG.R), right median cingulate and paracingulate gyri (DCG.R), left median cingulate and paracingulate gyri (DCG.L).
Conclusions:
The brain regions in the default mode network (DMN) of patients with ID show significant impairment (occupies four-ninths). In addition, the functional connectivity (FC) between the right middle occipital gyrus and inferior temporal gyrus (ITG) has an obvious correlation with comorbid anxiety (P=0.008) and depression (P=0.005) among patients with ID.
