Related Experiment Videos
[Virtual audiovisual talking heads: articulatory data and models--applications]
1GIPSA-lab, ENSIEG, Domaine Universitaire, BP46, 38402 Saint Martin d'Hères, France. Pierre.Badin@gipsa-lab.inpg.fr
Revue De Laryngologie - Otologie - Rhinologie
|April 15, 2010
Summary
This study models speech production using orofacial articulator measurements. These models enable realistic virtual talking head animations for enhanced audiovisual speech research.
Area of Science:
- Experimental phonetics and speech production research.
- Biomedical imaging and biomechanical modeling of speech articulators.
Context:
- Understanding the complex biomechanics of speech production is crucial for advancing speech technology and clinical applications.
- Existing methods for analyzing speech articulators often lack sufficient detail in both shape and dynamic movement.
Purpose:
- To present experimental techniques for characterizing the shape and movement of speech articulators.
- To describe the development and application of linear models for orofacial organs.
- To demonstrate the creation of high-quality animations of articulators for virtual talking heads.
Summary:
- Utilizes experimental techniques like MRI, CT, and EMA to gather speaker-specific data on jaw, face, lips, tongue, and velum.
- Develops linear biomechanical models of these articulators with high geometrical and temporal resolution.
- Integrates these models into a virtual talking head system capable of producing augmented audiovisual speech and enabling perception tests.
Impact:
- Enables the reconstruction of realistic and high-quality animations of speech articulators.
- Facilitates the creation of virtual talking heads for augmented audiovisual speech synthesis and perception studies.
- Suggests potential for diverse applications in speech research, education, and assistive technologies.
Related Concept Videos
01:24Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...
01:12Modeling and Similitude
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...