Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Brain Imaging01:14

Brain Imaging

Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans),  magnetic resonance imaging (MRI),  functional magnetic resonance imaging (fMRI), and Transcranial Magnetic Stimulation (TMS).

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Gridography tractography reveals communication between key areas from global workspace and integrated information theories of consciousness.

Scientific reports·2025
Same author

Standardizing Corneal Transplantation Records Using openEHR: Case Study.

JMIR medical informatics·2024
Same author

A Framework for Representing, Building and Reusing Novel State-of-the-Art Three-Dimensional Object Detection Models in Point Clouds Targeting Self-Driving Applications.

Sensors (Basel, Switzerland)·2023
Same author

OpenEHR modeling: improving clinical records during the COVID-19 pandemic.

Health and technology·2021
Same author

Data Mining for Cardiovascular Disease Prediction.

Journal of medical systems·2021
Same author

A Proof of Concept of a Mobile Health Application to Support Professionals in a Portuguese Nursing Home.

Sensors (Basel, Switzerland)·2019

Related Experiment Video

Updated: Jul 2, 2026

Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images
06:48

Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images

Published on: January 7, 2019

9.4K

Sensory Representation of Neural Networks Using Sound and Color for Medical Imaging Segmentation.

Irenel Lopo Da Silva1, Nicolas Francisco Lori2,3, José Manuel Ferreira Machado2

  • 1IT Department, Computer Engineering, School of Engineering, University of Minho, 4704-553 Braga, Portugal.

Journal of Imaging
|December 24, 2025
PubMed
Summary

This study presents a new method to visualize and sonify brain imaging data using deep learning. This sensory representation aids in understanding brain activity for medical, research, and creative uses.

Keywords:
deep learningfMRIimage segmentationsensory representationsparse graph neural networks

More Related Videos

Multicolor 3D Printing of Complex Intracranial Tumors in Neurosurgery
14:15

Multicolor 3D Printing of Complex Intracranial Tumors in Neurosurgery

Published on: January 11, 2020

7.6K
Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
04:48

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

3.3K

Related Experiment Videos

Last Updated: Jul 2, 2026

Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images
06:48

Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images

Published on: January 7, 2019

9.4K
Multicolor 3D Printing of Complex Intracranial Tumors in Neurosurgery
14:15

Multicolor 3D Printing of Complex Intracranial Tumors in Neurosurgery

Published on: January 11, 2020

7.6K
Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
04:48

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

3.3K

Area of Science:

  • Neuroimaging
  • Artificial Intelligence
  • Data Visualization

Background:

  • Interpreting complex brain imaging data like structural magnetic resonance imaging (MRI) is challenging.
  • Current methods lack intuitive, multisensory approaches for broad accessibility.

Purpose of the Study:

  • To develop a novel framework for sensory representation of neuroimaging data.
  • To enhance the interpretability of brain activity patterns through visual and auditory outputs.
  • To explore the potential of "auditory biomarkers" for pathological identification.

Main Methods:

  • Utilizing deep learning, specifically U-Net models, for high-precision segmentation of MRI data.
  • Converting MRI predictions into color-coded visual maps.
  • Generating stereophonic and MIDI sonifications from imaging features.

Main Results:

  • Demonstrated technical feasibility and robustness of the sensory representation pipeline.
  • Successfully encoded spatial, intensity, and anomalous features into perceivable visual and auditory cues.
  • Enabled intuitive interpretation of cortical activation patterns.

Conclusions:

  • The multisensory approach significantly enhances the interpretability of complex neuroimaging data.
  • The framework supports clinical decision-making, cognitive research, and creative applications.
  • Future work will focus on clinical validation and dynamic sonification using functional MRI (fMRI).