Low-Frequency Entrainment to Visual Motion Underlies Sign Language Comprehension

Area of Science:

• Neuroscience
• Linguistics
• Cognitive Science

Background:

• Neural activity in listeners tracks acoustic envelope fluctuations, aiding speech comprehension.
• This neural entrainment to the acoustic signal is fundamental for language processing.

Purpose of the Study:

• To investigate cortical tracking of visual dynamics in sign language comprehension.
• To determine the contribution of different EEG response frequencies to sign language understanding.
• To explore the role of predictive processing in fluent signers.

Main Methods:

• Used electroencephalography (EEG) to record brain activity in sign language users.
• Analyzed brain responses to both forward and time-reversed sign language videos.
• Employed machine learning for brain state classification to assess frequency contributions.

Main Results:

• Lower EEG frequencies (0.2-4 Hz) achieved 100% classification accuracy in identifying brain states related to comprehension.
• Higher EEG frequencies provided less informative data regarding cortical tracking of the visual envelope.
• Cortical tracking of the visual envelope is primarily driven by lower frequency responses.

Conclusions:

• Sign language comprehension is strongly associated with neural tracking of lower visual frequencies.
• Fluent signers likely utilize a predictive processing strategy based on their linguistic knowledge.
• The findings highlight the importance of visual envelope dynamics in sign language processing.