Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Classification of Signals

Classification of Signals

In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...

Perceiving Loudness, Pitch, and Location

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...

Hearing

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.

Perception of Sound Waves

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...

Higher Mental Functions of the Brain: Language

Higher Mental Functions of the Brain: Language

Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...

Language and Cognition

Language and Cognition

Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Measuring language proficiency in bilingual children using EEG-based neural tracking of continuous speech.

Brain and language·2026

Same author

Large Language Models Reveal the Neural Tracking of Linguistic Context in Attended and Unattended Multi-Talker Speech.

bioRxiv : the preprint server for biology·2026

Same author

Large language models reveal the neural tracking of linguistic context in attended and unattended multi-talker speech.

Imaging neuroscience (Cambridge, Mass.)·2026

Same author

EEG-based decoding of auditory attention to conversations with turn-taking speakers.

Hearing research·2026

Same author

Behavioral constructs and neural correlates of descriptive and responsive speech in post-stroke aphasia.

Cortex; a journal devoted to the study of the nervous system and behavior·2025

Same author

ALICE: Improved Speech in Noise Understanding with Self-guided Hearing Care.

Trends in hearing·2025

Search research articles

Related Experiment Video

Updated: Jun 17, 2025

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

Classifying coherent versus nonsense speech perception from EEG using linguistic speech features.

Corentin Puffay^1,2, Jonas Vanthornhout³, Marlies Gillis³

¹Department Neurosciences, KU Leuven, ExpORL, Leuven, Belgium. corentin.puffay@kuleuven.be.

Scientific Reports

|August 14, 2024

Summary

This study shows deep learning models can objectively measure speech understanding by analyzing brainwaves (EEG). The models differentiate between understood and misunderstood languages, and even detect comprehension differences within the same language.

Keywords:

CNN Deep learning EEG decoding Linguistics

More Related Videos

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Related Experiment Videos

Last Updated: Jun 17, 2025

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Area of Science:

Neuroscience
Computational Linguistics
Signal Processing

Background:

Neural processing of speech involves analyzing relationships between speech signals and brain activity.
Understanding how the brain processes native versus foreign languages, especially when not understood, is crucial for cognitive science.

Purpose of the Study:

To investigate neural processing differences between native and foreign languages using electroencephalogram (EEG) and linguistic features.
To develop and validate a deep learning model for objectively measuring speech understanding.

Main Methods:

Experiments involved recording EEG signals from native Dutch speakers exposed to comprehensible, incomprehensible, and shuffled-word stimuli.
A deep learning model was employed to track linguistic features of speech signals, correlating them with EEG data.
The model incorporated lexical segmentation features to account for acoustic processing.

Main Results:

The deep learning model successfully distinguished between coherent (understood) and nonsense (unintelligible) language stimuli.
Significant differences in neural tracking patterns were observed between comprehensible and incomprehensible speech, even within the same language.
The study demonstrated objective measurement of speech understanding is feasible.

Conclusions:

Deep learning frameworks show promise for objectively assessing speech comprehension.
Neural tracking of linguistic features can reveal differences in how the brain processes understood versus misunderstood speech.
This approach offers a novel method for studying language processing and understanding.