Predictability modulates neurocognitive semantic processing of non-verbal narratives.

Area of Science:

• Cognitive Neuroscience
• Psycholinguistics
• Visual Cognition

Background:

• Predictability influences semantic processing in language.
• Its role in non-verbal modalities, like visual narratives, is less understood.

Purpose of the Study:

• To investigate if predictability affects neural responses in non-verbal visual comprehension.
• To examine cognitive processes in predicting upcoming events in comic sequences.

Main Methods:

• Adults viewed comic sequences with varying predictability (high cloze, low cloze, anomalous).
• Electroencephalography (EEG) recorded neural responses.
• Cloze probability scores were used to quantify predictability.

Main Results:

• Neural responses, specifically N400 effects, were modulated by predictability.
• N400 effects decreased as target panels became more predictable.
• Predictability plays a significant role in processing sequential visual information.

Conclusions:

• Predictability impacts semantic processing in visual narratives similarly to language.
• This provides evidence for the domain-general nature of semantic processing in the brain.
• Cognitive mechanisms for prediction may be shared across sensory modalities.