Related Experiment Videos
Automatic analysis of multimodal group actions in meetings
Iain McCowan1, Daniel Gatica-Perez, Samy Bengio
1IDIAP Research Institute, Rue du Simplon 4, CP 592, CH-1920 Martigny, Switzerland. mccowan@idiap.ch
Summary
Recognizing group actions in meetings is improved by modeling participant interactions. Multimodal analysis, using audiovisual features, enhances understanding of group dynamics and meeting events.
Area of Science:
- Computer Science
- Artificial Intelligence
- Human-Computer Interaction
Background:
- Analyzing group actions in meetings is crucial for understanding collaborative dynamics.
- Previous models often overlook the interactive nature of individual contributions to group behavior.
Purpose of the Study:
- To investigate the recognition of group actions in meetings by modeling participant interactions.
- To evaluate the effectiveness of Hidden Markov Model (HMM)-based approaches using audiovisual features.
- To demonstrate the benefits of a multimodal approach for meeting analysis.
Main Methods:
- A framework modeling group actions as emergent properties of individual interactions.
- Utilizing Hidden Markov Models (HMMs) for group action recognition.
- Employing audiovisual features derived from individual participant monitoring.
Main Results:
- Modeling participant interactions significantly improves group action recognition accuracy.
- Visual modality provides valuable information even for primarily audio-driven events.
- The proposed multimodal approach offers enhanced meeting analysis capabilities.
Conclusions:
- Interactions between participants are essential for accurate group action recognition in meetings.
- Multimodal analysis, integrating visual and audio data, is beneficial for comprehensive meeting understanding.