Interpreting nonverbal cues to deception in real time

Area of Science:

• Cognitive Psychology
• Pragmatics
• Nonverbal Communication

Background:

• Listeners often associate non-linguistic behaviors with deception.
• Speech disfluencies influence deception judgments early in reference comprehension.
• The role of nonverbal cues, specifically gestures, in deception detection is less understood.

Purpose of the Study:

• To investigate the integration of speaker gestures into listeners' judgments of deception.
• To determine if and when associations between nonverbal cues and deception emerge.
• To explore the rapid influence of nonverbal behavior on pragmatic judgments.

Main Methods:

• Participants watched and heard videos of a speaker describing an object's location.
• Participants viewed images of the named object and a distractor object, indicating their belief.
• Eye-tracking and mouse-tracking recorded participant behavior; experiments focused on visual cues and adaptor gestures.

Main Results:

• A speaker's nonverbal behavior, including gestures, rapidly influences listeners' pragmatic judgments.
• Listeners form associations between visual cues and perceived deception.
• Communication is fundamentally multimodal, integrating verbal and nonverbal information.

Conclusions:

• Nonverbal cues are rapidly integrated into deception detection.
• Pragmatic judgments are influenced concurrently by spoken content and nonverbal behavior.
• This supports the multimodal nature of human communication.