Analyzing nonverbal listener responses using parallel recordings of multiple listeners

Area of Science:

• Psychology
• Communication Studies
• Human-Computer Interaction

Background:

• Nonverbal communication plays a crucial role in dyadic interactions.
• Previous research often overlooks the impact of audience visibility on listener behavior.
• Understanding listener responses is key to improving communication effectiveness.

Purpose of the Study:

• To investigate the influence of being observed versus unobserved on nonverbal listener behaviors.
• To compare the nonverbal responses of multiple listeners in a controlled setting.
• To correlate listener nonverbal cues with speaker behaviors like gaze and pauses.

Main Methods:

• Analysis of a novel corpus featuring multiple parallel recorded listeners.
• Comparison of nonverbal behaviors (timing, form) between visible and non-visible listeners.
• Correlation analysis between listener responses and speaker actions (e.g., gaze direction, pauses).

Main Results:

• Significant differences in nonverbal listener responses were observed between visible and non-visible conditions.
• Listener behaviors varied in timing and form depending on whether they were seen by the speaker.
• Speaker's gaze and pauses were correlated with specific nonverbal listener responses.

Conclusions:

• Audience visibility significantly modulates nonverbal listener behavior.
• The study highlights the importance of considering the full listener context in communication research.
• Findings have implications for designing more naturalistic human-computer interaction and improving communication training.