有表达力的说话的阿凡达
IEEE transactions on visualization and computer graphics
|March 4, 2024
概括
我们介绍了一套新的数据集和方法,用于创建有表现力的说话化身,使虚拟现实 (VR) 中的真实情感交流成为可能. 这促进了风格化角色的动画,以增强虚拟交互.
科学领域:
- 计算机图形和虚拟现实
- 人与计算机的交互
- 人工智能的人工智能
背景情况:
- 风格化的化身对于虚拟现实 (VR) 协作至关重要,但产生明确的情感表达仍然具有挑战性.
- 由于依赖人类面部特征,现有的方法经常失败,这些特征不适合风格化的化身设计.
研究的目的:
- 为了解决在风格化化身中产生情感表达的困难.
- 介绍一种新的数据集和相应的生成方法,用于情感交谈的化身.
主要方法:
- 开发了情绪交谈阿凡达数据集,这是一个由6个风格化角色展示7种不同的情绪的视频集.
- 创建了一个伴随着情绪的说话的化身生成方法,允许情绪操纵.
- 通过基于音频的木偶戏,最先进的比较和用户研究来验证该方法.
主要成果:
- 证明了数据集和生成方法在产生情感表达的说话化身方面的有效性.
- 用户研究证实了该方法在为风格化角色生成令人信服的情感表达的能力.
- 拟议的方法在生成音频驱动的化身动画方面优于现有的技术.
结论:
- 情感说话的化身数据集和生成方法显著推进了表达式风格化身的创建.
- 这项工作在虚拟现实环境中促进了更自然,更有吸引力的沟通.
- 开发的技术在动画化身中具有广泛的应用,用于沉浸式虚拟体验.
相关概念视频
Therapeutic Communication
4.5K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
4.5K
Emotional Expression
220
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
220
Empathy
9.6K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
9.6K
Muscles for Facial Expressions
2.0K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
2.0K
Facial Feedback Hypothesis
152
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
152
Nonconscious Mimicry
4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K


