Inconsistent use of gesture space during abstract pointing impairs language comprehension

Area of Science:

• Cognitive Science
• Linguistics
• Psychology

Background:

• Pointing to concrete objects is a known communication strategy.
• The communicative effectiveness of abstract pointing (gestures to empty space) is less understood.
• Previous research suggests abstract pointing may offer limited communicative value, often providing redundant information.

Purpose of the Study:

• To investigate whether abstract pointing influences language comprehension.
• To determine if perceivers are sensitive to abstract pointing cues.
• To explore the potential communicative function of abstract pointing in discourse.

Main Methods:

• A mismatch paradigm was used with participants watching video interviews.
• Abstract pointing gestures were established in space to represent concepts.
• Event-related brain potentials (ERPs) measured responses to consistent and inconsistent gesture-speech pairings.

Main Results:

• Increased N400 and P600 ERP components were observed when gestures and speech were inconsistent.
• Inconsistent abstract pointing impaired language comprehension.
• Abstract pointing influenced comprehension even when not essential for the task.

Conclusions:

• Abstract pointing can be used to establish referents in "gesture space."
• Abstract pointing influences language processing and comprehension.
• Abstract pointing demonstrates a potential communicative function in discourse.