Related Experiment Video
Updated: Jun 21, 2026

Automated Interactive Video Playback for Studies of Animal Communication
Published on: February 9, 2011
MushyPeek: a framework for online investigation of audiovisual dialogue phenomena
1KTH Speech, Music & Hearing, Stockholm, Sweden. edlund@speech.kth.se
Abstract:
Evaluation of methods and techniques for conversational and multimodal spoken dialogue systems is complex, as is gathering data for the modeling and tuning of such techniques. This article describes MushyPeek, an experiment framework that allows us to manipulate the audiovisual behavior of interlocutors in a setting similar to face-to-face human-human dialogue. The setup connects two subjects to each other over a Voice over Internet Protocol (VoIP) telephone connection and simultaneously provides each of them with an avatar representing the other. We present a first experiment which inaugurates, exemplifies, and validates the framework. The experiment corroborates earlier findings on the use of gaze and head pose gestures in turn-taking.
More Related Videos
09:27Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
Related Concept Videos
Qualitative Analysis
There are two main approaches to qualitative analysis:...
Qualitative Analysis
For instance, group IV...
Auditory Perception
Introducing Social Perception
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Language and Cognition