Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Association between motor cortex grey matter loss and inability to control an ECoG-based implanted Brain-Computer Interface in ALS.

medRxiv : the preprint server for health sciences·2026
Same author

Across-speaker articulatory reconstruction from sensorimotor cortex for generalizable brain-computer interfaces.

Journal of neural engineering·2026
Same author

Longitudinal study of gesture decoding in a clinical trial participant with ALS.

medRxiv : the preprint server for health sciences·2025
Same author

Multimodal integration of longitudinal noninvasive diagnostics for survival prediction in immunotherapy using deep learning.

Journal of the American Medical Informatics Association : JAMIA·2025
Same author

Large-scale fMRI dataset for the design of motor-based Brain-Computer Interfaces.

Scientific data·2025
Same author

Special issue on brain-computer interfaces: highlighting research from the 10th International Brain-Computer Interface Meeting.

Journal of neural engineering·2025

Related Experiment Video

Updated: Jun 17, 2026

Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding
11:25

Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding

Published on: July 26, 2013

43.4K

Direct speech reconstruction from sensorimotor brain activity with optimized deep learning models.

Julia Berezutskaya1,2, Zachary V Freudenburg1, Mariska J Vansteensel1

  • 1Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht 3584 CX, The Netherlands.

Journal of Neural Engineering
|July 19, 2023
PubMed
Summary

Optimizing machine learning models for speech reconstruction from brain activity significantly improves brain-computer interface (BCI) communication for paralyzed individuals. This method decodes intelligible speech directly from neural data.

Keywords:
audio reconstructionbrainbrain–computer interfacesdeep neural networkselectrocorticographyneural decodingspeech

More Related Videos

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.0K
Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
13:12

Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping

Published on: August 12, 2019

45.6K

Related Experiment Videos

Last Updated: Jun 17, 2026

Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding
11:25

Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding

Published on: July 26, 2013

43.4K
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.0K
Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
13:12

Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping

Published on: August 12, 2019

45.6K

Area of Science:

  • Neuroscience
  • Biomedical Engineering
  • Computer Science

Background:

  • Brain-computer interfaces (BCIs) are crucial for restoring communication in individuals with severe motor paralysis.
  • Speech decoding from neural data is a promising BCI strategy.
  • Optimizing decoding strategies is essential for effective BCI development.

Purpose of the Study:

  • To optimize and validate a speech reconstruction decoding approach using electrocorticography (ECoG) recordings.
  • To assess the performance of speech decoding from sensorimotor cortex neural activity.

Main Methods:

  • Utilized high-density ECoG recordings during a speech production task.
  • Employed machine learning for optimizing speech reconstruction models.
  • Validated decoding accuracy for individual words and speech intelligibility.

Main Results:

  • Machine learning optimization is critical for achieving top reconstruction performance.
  • Individual word decoding accuracy ranged from 92% to 100% (chance level 8%).
  • Direct speech reconstruction from sensorimotor cortex activity yielded intelligible speech.

Conclusions:

  • Model optimization is key for effective speech decoding in BCIs.
  • Reconstruction-based speech decoding from sensorimotor cortex shows significant potential for next-generation communication BCIs.