Related Experiment Videos
A system for three-dimensional visualization of human jaw motion in speech
1Institut de la Communication Parlée, Grenoble, France.
Journal of Speech, Language, and Hearing Research : JSLHR
|November 5, 1997
Summary
Researchers developed a 3D visualization system to display human jaw motion during speech. This system reconstructs jaw movements using optoelectronic data for educational and speech recognition research.
Area of Science:
- Biomechanics
- Speech Science
- Computer Graphics
Background:
- Accurate 3D reconstruction of human jaw motion is increasingly feasible with advanced measurement systems and computational power.
- Understanding jaw kinematics during speech is crucial for various research and educational applications.
Purpose of the Study:
- To describe a novel visualization system for displaying three-dimensional (3D) human jaw movements during speech.
- To enable real-time 3D animation of jaw motion driven by kinematic data.
Main Methods:
- Jaw motion data was captured using an optoelectronic measurement system (Optotrak) alongside speech signals.
- Six kinematic variables (three orientation angles, three positions) fully described jaw motion as a rigid skeletal structure.
- These variables drove a real-time 3D animation of a skeletal jaw and upper skull.
Main Results:
- The system successfully visualizes 3D jaw movements in real-time, synchronized with speech.
- Users can manipulate the viewpoint, replay segments, and vary display speed.
- Individual or combined kinematic degrees of freedom can be displayed alongside the audio track.
Conclusions:
- The developed system provides a powerful tool for visualizing complex 3D jaw motion during speech.
- It serves as an educational resource and aids research in audio-visual speech recognition.
- The software and source code are available to researchers.