Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Magnetic Resonance Imaging01:24

Magnetic Resonance Imaging

Magnetic resonance imaging (MRI) is a noninvasive medical imaging technique based on a phenomenon of nuclear physics discovered in the 1930s, in which matter exposed to magnetic fields and radio waves was found to emit radio signals. In 1970, a physician and researcher named Raymond Damadian noticed that malignant (cancerous) tissue gave off different signals than normal body tissue. He applied for a patent for the first MRI scanning device in clinical use by the early 1980s. The early MRI...
Brain Imaging01:14

Brain Imaging

Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans),  magnetic resonance imaging (MRI),  functional magnetic resonance imaging (fMRI), and Transcranial Magnetic Stimulation (TMS).

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Dynamic Fusion of Genomics and Functional Network Connectivity in UK Biobank Reveals Schizophrenia-Related SNP Manifolds.

Human brain mapping·2026
Same author

SELF-CLUSTERING GRAPH TRANSFORMER APPROACH TO MODEL RESTING STATE FUNCTIONAL BRAIN ACTIVITY.

Proceedings. IEEE International Symposium on Biomedical Imaging·2026
Same author

Multimodal Brain Growth Patterns: Insights from Canonical Correlation Analysis and Deep Canonical Correlation Analysis with Auto-Encoder.

Information (Basel)·2025
Same author

Graph-based deep learning models in the prediction of early-stage Alzheimers.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same author

Scepter: Weakly Supervised Framework for Spatiotemporal Dense Prediction of 4D Dynamic Brain Networks.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same author

Brain community detection in the general children population.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Spatio-functional parcellation of resting state fMRI.

Proceedings. IEEE Southwest Symposium on Image Analysis and Interpretation·2025
Same journal

COVID-19 PNEUMONIA CHEST X-RAY PATTERN SYNTHESIS BY STABLE DIFFUSION.

Proceedings. IEEE Southwest Symposium on Image Analysis and Interpretation·2025
Same journal

AUTOMATED DETECTION OF MALARIAL RETINOPATHY USING TRANSFER LEARNING.

Proceedings. IEEE Southwest Symposium on Image Analysis and Interpretation·2020
Same journal

A Maximum-Likelihood Approach for ADC Estimation of Lesions in Visceral Organs.

Proceedings. IEEE Southwest Symposium on Image Analysis and Interpretation·2014
Same journal

A Clustering Algorithm for Liver Lesion Segmentation of Diffusion-Weighted MR Images.

Proceedings. IEEE Southwest Symposium on Image Analysis and Interpretation·2010
See all related articles

Related Experiment Video

Updated: Jun 16, 2026

Co-analysis of Brain Structure and Function using fMRI and Diffusion-weighted Imaging
17:06

Co-analysis of Brain Structure and Function using fMRI and Diffusion-weighted Imaging

Published on: November 8, 2012

Multimodal Fusion of Structural and Diffusion MRI for Intelligence Prediction.

Ram Sapkota1, Bishal Thapaliya1, Jingyu Liu1

  • 1Translational Research in Neuroimaging and Data Science (TReNDS) Center, Georgia State University, Atlanta, USA.

Proceedings. IEEE Southwest Symposium on Image Analysis and Interpretation
|June 15, 2026
PubMed
Summary
This summary is machine-generated.

This study developed a deep learning framework to predict children's cognitive outcomes using brain imaging. Simple feature concatenation of gray matter and white matter data yielded the best prediction results.

Keywords:
diffusion MRIfusionintelligencemulti-modalitystructural MRI

Related Experiment Videos

Last Updated: Jun 16, 2026

Co-analysis of Brain Structure and Function using fMRI and Diffusion-weighted Imaging
17:06

Co-analysis of Brain Structure and Function using fMRI and Diffusion-weighted Imaging

Published on: November 8, 2012

Area of Science:

  • Neuroscience
  • Artificial Intelligence
  • Developmental Psychology

Background:

  • Multimodal neuroimaging offers comprehensive brain insights but faces integration challenges.
  • Predicting cognitive outcomes in children is crucial for understanding neurodevelopment.

Purpose of the Study:

  • To develop and evaluate a deep learning-based multimodal fusion framework for predicting cognitive outcomes in children.
  • To compare different fusion strategies for integrating structural MRI (gray matter density) and diffusion MRI (white matter fractional anisotropy) data.

Main Methods:

  • Utilized data from the Adolescent Brain Cognitive Development (ABCD) Study.
  • Extracted modality-specific features using separate convolutional neural networks (CNNs).
  • Integrated features via concatenation, multi-head attention, and transformer encoder-based fusion.

Main Results:

  • Direct feature concatenation achieved the highest predictive performance (test correlation of 0.44).
  • Multimodal models outperformed single-modality approaches, demonstrating the added value of data integration.
  • Guided Grad-CAM identified key gray matter and white matter regions influencing intelligence prediction.

Conclusions:

  • Deep learning-based multimodal fusion is effective for predicting cognitive outcomes in children.
  • Simple feature concatenation is a robust strategy for integrating neuroimaging modalities.
  • The framework provides interpretable insights into brain-region contributions to cognitive abilities.