Facilitating question identification through natural intensity eyebrow movements in virtual avatars

Area of Science:

• Psychology
• Linguistics
• Human-Computer Interaction

Background:

• Recognizing social actions, or speech acts, early in conversation is crucial for understanding intent and enabling rapid responses.
• Fast conversational turns, especially for questions, are vital as delays can signal dispreferred responses.
• Multimodal face-to-face interactions utilize visual cues, particularly from the face, to support rapid conversational dynamics.

Purpose of the Study:

• To investigate if early eyebrow movements, with natural intensities, facilitate question identification.
• To determine if specific eyebrow movement intensities are more effective in recognizing questions.

Main Methods:

• Participants viewed videos of avatars with manipulated eyebrow movements (frowns or raises versus no movement).
• Participants indicated whether the avatar's utterance was a question or a statement.
• Accuracy and response times were measured.

Main Results:

• Higher accuracy was observed for identifying questions accompanied by eyebrow frowns.
• Faster response times were recorded for questions with both eyebrow frowns and eyebrow raises.
• No significant effect of specific movement intensity on question recognition was found.

Conclusions:

• Eyebrow movements, representative of naturalistic multimodal behavior, aid in the rapid recognition of questions.
• The presence of eyebrow movements, rather than their specific intensity, appears key for facilitating question identification.
• Facial signals play a significant role in the efficiency of conversational interactions.