Auditory Dominance in Processing Chinese Semantic Abnormalities in Response to Competing Audio-visual Stimuli

Area of Science:

• Cognitive Neuroscience
• Psycholinguistics
• Neuroscience

Background:

• Language is processed through both visual (written) and auditory (spoken) modalities.
• When conflicting information is presented, individuals may favor one modality, but the dominant one and its neural basis are unclear.

Purpose of the Study:

• To investigate the dominant modality during audio-visual language conflict.
• To explore the neural mechanisms underlying this audio-visual competition using electroencephalography (EEG).

Main Methods:

• Participants were presented with Chinese sentences containing conflicting visual and auditory information.
• Behavioral responses (accuracy) and electroencephalographic (EEG) data were recorded.

Main Results:

• A prominent auditory dominance was observed during audio-visual conflict.
• Higher accuracy (ACC) and larger N400 amplitudes in posterior occipital-parietal areas were found in the auditory mismatch condition.

Conclusions:

• Auditory speech demonstrates superiority over visual characters in audio-visual conflict scenarios.
• The findings extend the understanding of neural mechanisms in audio-visual competition for Chinese language processing.