The Action-Sentence Compatibility Effect in ASL: the role of semantics vs. perception

Area of Science:

• Cognitive Science
• Linguistics
• Neuroscience

Background:

• Embodied cognition theories suggest sensorimotor systems aid language processing.
• The Action-Sentence Compatibility Effect (ACE) demonstrates motor facilitation congruent with sentence-implied motion.
• Sign languages present a unique case where visual motion direction conflicts with semantic meaning.

Purpose of the Study:

• To investigate whether perceived sign movement or verb semantics influence the ACE in American Sign Language (ASL).
• To determine the role of sensorimotor engagement in understanding visual-manual languages.
• To explore the interplay between visual perception and semantic processing in sign language comprehension.

Main Methods:

• Deaf ASL signers participated in a semantic judgment task.
• Participants viewed signed sentences depicting motion (toward or away).
• Motor response compatibility was measured in relation to visual motion and verb semantics.

Main Results:

• A significant congruency effect was observed.
• This effect correlated with the verb's semantics, not the perceived direction of hand movement.
• Findings suggest semantic processing takes precedence over visual motion perception in modulating motor simulation.

Conclusions:

• The motor system is actively involved in processing visual-manual languages like ASL.
• Motor simulations during sign language comprehension are primarily driven by semantic content.
• This research highlights the brain's sophisticated integration of sensorimotor and semantic information in language.