Communicative constraints affect oro-facial gestures and acoustics: Whispered vs normal speech.

Area of Science:

• Linguistics
• Speech Communication
• Psycholinguistics

Background:

• Understanding the interplay between vocalizations and non-verbal communication is crucial for deciphering human interaction.
• Previous research has explored facial expressions and acoustic properties separately, but their combined effect under varying communicative conditions remains less understood.

Purpose of the Study:

• To investigate the relationship between acoustic signals and oro-facial expressions (gestures) under different speaking conditions.
• To test hypotheses regarding the intensification of gestures based on factors like whispering, visual contact, and utterance type (question vs. statement).

Main Methods:

• A motion capture experiment was conducted with 17 native German speakers.
• Participants' speech and oro-facial movements were recorded under controlled conditions varying auditory and visual feedback.

Main Results:

• Partial support was found for the hypothesis that intensified oro-facial expressions occur when speakers whisper, lack visual contact, and produce questions.
• A trade-off was observed where enhanced gestures and longer duration compensated for reduced fundamental frequency.
• Gestures were also enhanced when the listener was not visible, suggesting a role beyond listener-specific needs.

Conclusions:

• The findings do not exclusively support either the 'hand-in-hand' or 'trade-off' hypotheses.
• Oro-facial gestures appear to serve a broader communicative purpose, aiding the speaker in achieving overarching communicative goals rather than solely benefiting the listener.