Related Experiment Video
Updated: Jan 10, 2026

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology
Published on: March 8, 2024
Higher-order sonification of the human brain
Francisco-Shu Kitaura1,2, Emi-Pauline Kitaura3, Niels Janssen4,5,6
1Instituto de Astrofísica de Canarias, C/ Vía Láctea, s/n, E-38205, San Cristóbal de La Laguna, Spain. fkitaura@ull.edu.es.
Abstract:
Sonification, the process of translating data into sound, has recently gained traction as a tool for both disseminating scientific findings and enabling visually impaired individuals to analyze data. Despite its potential, most current sonification methods remain limited to one-dimensional data, primarily due to the absence of practical, quantitative, and robust techniques for handling multi-dimensional datasets. We analyze structural magnetic resonance imaging (MRI) data of the human brain by integrating two- and three-point statistical measures in Fourier space: the power spectrum and bispectrum. These quantify the spatial correlations of three-dimensional voxel intensity distributions, yielding reduced bispectra that capture higher-order interactions. To illustrate the potential of the approach, we focus on one representative reduced-bispectrum configuration (Q019036) in the OASIS-3 dataset (864 imaging sessions) and provide audio renderings for five age groups (40-50, 50-60, 60-70, 70-80, 80-100 years). As context, prior work with this configuration reported an age-prediction MAE of ≈4.2 years based on neural networks, trained on bispectrum-derived features-not through sonification itself. But here we emphasize sonification rather than predictive benchmarking. Finally, we treat these audio examples as exploratory illustrations rather than a perceptual evaluation. Our results demonstrate that the information loss (e.g., normalized mean squared error) during the reconstruction of the original bispectra, specifically in configurations sensitive to brain aging, from the sonified signal is minimal. Future studies should include systematic statistical inference and perceptual validation to assess the robustness and perceptual utility of the method. Nevertheless, the approach presented here already provides a general framework for encoding multi-dimensional data into time-series-like arrays suitable for sonification, thereby opening new avenues for scientific exploration and improving accessibility for a broader audience.
Related Concept Videos
Organization of the Brain
Hindbrain
The hindbrain, located at the base of the brain, plays a vital role in regulating automatic processes that sustain life. It includes the medulla oblongata, which is essential for...
Brain Waves
Brain Imaging
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Cerebral Hemispheres
Hearing

