Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

52.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Listeners rapidly adapt to current conditions: "Good-enough" adaptation in multitalker speech perception.

Journal of experimental psychology. General·2025
Same author

Effects of experience on recognition of speech produced with a face mask.

Cognitive research: principles and implications·2022
Same author

Rethinking the McGurk effect as a perceptual illusion.

Attention, perception & psychophysics·2021
Same author

Effects of face masks on speech recognition in multi-talker babble noise.

PloS one·2021
Same author

The time-course of speech perception revealed by temporally-sensitive neural measures.

Wiley interdisciplinary reviews. Cognitive science·2020
Same author

A graph-theoretic approach to identifying acoustic cues for speech sound categorization.

Psychonomic bulletin & review·2020

Related Experiment Video

Updated: Jul 11, 2025

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.4K

Decoding speech sounds from neurophysiological data: Practical considerations and theoretical implications.

McCall E Sarrett1,2, Joseph C Toscano1

  • 1Department of Psychological and Brain Sciences, Villanova University, Villanova, Pennsylvania, USA.

Psychophysiology
|November 10, 2023
PubMed
Summary

Machine learning enhances electroencephalography (EEG) analysis for speech perception. This study shows EEG data can reveal phonetic differences not seen with traditional methods, improving cognitive neuroscience research.

Keywords:
Analysis/Statistical MethodsAuditory ProcessesEEGERPsLanguage/SpeechMachine Learning

More Related Videos

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.5K
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.0K

Related Experiment Videos

Last Updated: Jul 11, 2025

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.4K
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.5K
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.0K

Area of Science:

  • Cognitive Neuroscience
  • Computational Neuroscience
  • Speech Processing

Background:

  • Machine learning (ML) applications in cognitive neuroscience are growing.
  • Implementation of ML in scalp-recorded electroencephalography (EEG) remains limited.
  • Event-related potential (ERP) analysis is a common EEG technique for speech sound research.

Purpose of the Study:

  • To explore ML techniques for analyzing EEG data in speech perception.
  • To identify optimal EEG signal features for ML-based phonetic discrimination.
  • To investigate the temporal dynamics of phonetic feature decoding from neural activity.

Main Methods:

  • Support vector machines (SVMs) were used to analyze EEG data from a speech sound study.
  • EEG signal features (trials averaged, time points, polynomial fit) were manipulated for ML accuracy.
  • Phoneme pairs were classified using SVMs to detect subtle EEG differences.
  • Timecourse of phonetic feature decoding (voicing, manner, place) was characterized.

Main Results:

  • ML analysis identified optimal EEG features for distinguishing speech sound voicing.
  • SVMs detected EEG signal differences between phonemes not apparent with conventional ERP analysis.
  • Neural activity allowed decoding of voicing and manner of articulation features.
  • Place of articulation was not decodable from the neural activity in this study.

Conclusions:

  • ML offers valuable tools for advancing EEG analysis in speech neuroscience.
  • This research provides practical recommendations for applying ML to EEG speech data.
  • Findings contribute to understanding the neural basis of speech perception and phonetic representations.