Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Neural Circuits01:25

Neural Circuits

1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Inter-individual and inter-site neural code conversion without shared stimuli.

Nature computational science·2025
Same author

Visual Image Reconstruction from Brain Activity via Latent Representation.

Annual review of vision science·2025
Same author

Spurious reconstruction from brain activity.

Neural networks : the official journal of the International Neural Network Society·2025
Same author

How emotion is experienced and expressed in multiple cultures: a large-scale experiment across North America, Europe, and Japan.

Frontiers in psychology·2024
Same author

Reconstructing visual illusory experiences from human brain activity.

Science advances·2023
Same author

Multiple types of navigational information are independently encoded in the population activities of the dentate gyrus neurons.

Proceedings of the National Academy of Sciences of the United States of America·2022

Related Experiment Video

Updated: Sep 14, 2025

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.1K

Natural sounds can be reconstructed from human neuroimaging data using deep neural network representation.

Jong-Yun Park1,2, Mitsuaki Tsukamoto2, Misato Tanaka1,2

  • 1Department of Intelligence Science and Technology, Graduate School of Informatics, Kyoto University, Kyoto, Japan.

Plos Biology
|July 23, 2025
PubMed
Summary

Researchers developed a new method to reconstruct sounds from brain activity using deep neural networks (DNNs) and functional MRI (fMRI). This approach successfully decodes auditory features, enabling plausible sound reconstructions despite fMRI

More Related Videos

Modeling the Functional Network for Spatial Navigation in the Human Brain
05:55

Modeling the Functional Network for Spatial Navigation in the Human Brain

Published on: October 13, 2023

1.2K
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.8K

Related Experiment Videos

Last Updated: Sep 14, 2025

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.1K
Modeling the Functional Network for Spatial Navigation in the Human Brain
05:55

Modeling the Functional Network for Spatial Navigation in the Human Brain

Published on: October 13, 2023

1.2K
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.8K

Area of Science:

  • Neuroscience
  • Auditory Perception
  • Machine Learning

Background:

  • Decoding visual information from brain activity using fMRI is advanced, but auditory reconstruction remains difficult due to temporal complexities and fMRI limitations.
  • Deep neural networks (DNNs) offer hierarchical auditory features that may bridge the gap in reconstructing complex soundscapes.
  • Understanding neural representations of sound is crucial for advancing brain-computer interfaces and auditory prosthetics.

Purpose of the Study:

  • To develop and evaluate a novel method for reconstructing auditory experiences from brain activity.
  • To investigate the efficacy of using decoded deep neural network (DNN) features for sound reconstruction.
  • To assess the perceptual plausibility and generalization capabilities of the reconstructed sounds.

Main Methods:

  • Integrated brain decoding of DNN-derived auditory features with an audio-generative model.
  • Utilized functional MRI (fMRI) data to capture population neural responses in the auditory cortex.
  • Compared decoded DNN features against traditional spectrotemporal and modulation-based features.

Main Results:

  • Decoded DNN features significantly outperformed other feature types, enabling perceptually plausible sound reconstructions across various categories.
  • Reconstructions accurately captured short-term spectral properties and timbre (e.g., speech, music), but not long temporal sequences.
  • The method demonstrated generalization across sound categories and reflected attended sounds during a selective auditory attention task.

Conclusions:

  • The proposed framework successfully maps brain activity to auditory experiences, advancing sound reconstruction from neural data.
  • DNN features are effective for decoding auditory information, offering a promising avenue for future auditory research and applications.
  • While limited by fMRI's temporal resolution, the approach represents a significant step towards understanding and reconstructing internal auditory representations.