Automated Video Analysis of Non-verbal Communication in a Medical Setting

Area of Science:

• Medical Communication
• Human-Computer Interaction
• Behavioral Analysis

Background:

• Non-verbal communication is crucial for physician-patient rapport and health outcomes.
• Current methods for analyzing non-verbal interactions are labor-intensive human coding.
• Scalability of studies is limited by manual analysis of medical interactions.

Purpose of the Study:

• To present an automated video analysis tool for quantifying non-verbal interactions in medical settings.
• To evaluate the tool's effectiveness in distinguishing between different interaction styles.
• To analyze interpersonal motion synchrony and entrainment during simulated physician-patient encounters.

Main Methods:

• Developed an automated video analysis tool for non-verbal interaction measurement.
• Tested the tool on videos of subjects interacting with an actor portraying a physician.
• Compared two scenarios: minimal physician engagement versus active listening and attentiveness.

Main Results:

• Significant differences in interpersonal motion synchrony and entrainment were observed between scenarios.
• The active listening scenario demonstrated greater synchrony and more symmetric followership.
• Active listening also showed increased high-frequency motion (jitter), a potential marker of followership.

Conclusions:

• The automated tool effectively differentiates non-verbal interaction dynamics.
• Active listening enhances interpersonal synchrony and followership in medical communication.
• This approach can analyze physician-patient interactions regarding synchrony and dominance in various medical contexts.