开发具有情境敏感面部表情的交互式数字人
Fan Yang1, Lei Fang1, Rui Suo2
1Department of Emotion Engineering, Sangmyung University, Seoul 03016, Republic of Korea.
Sensors (Basel, Switzerland)
|August 28, 2025
概括
这项研究引入了一种新的数字人体系统, 该框架可实现动态,语义响应和多情感生成,以改善人机交互.
科学领域:
- 计算机视觉
- 人与计算机的交互
- 人工智能
背景情况:
- 传统的数字人体系统难以处理复杂的情绪和实时响应.
- 限制包括多种情绪的同时出现,动态表达和语义准确性.
研究的目的:
- 提出一个数字人体系统框架, 整合多式情绪识别和复合面部表情生成.
- 通过"语音语义解析-多模态情感识别-行动单位 (AU) 级3D面部表情控制"建立复合情感表达的实时管道.
主要方法:
- 在AffectNet数据集上使用ResNet18进行情感分类.
- 在虚幻引擎上开发了一种动作单元 (AU) 运动曲线驱动模块,用于动态情感合成.
- 使用预先训练的生成转换器 (GPT) 进行语义分析并产生语言驱动的面部反应.
主要成果:
- 显示了面部动画质量的显著改善.
- 自然性从3.54增加到3.94和语义一致性从3.44增加到3.80.
- 验证了系统对现实和情感一致的实时表达能力.
结论:
- 拟议的系统为具有情感互动的高保真数字人提供了完整的技术框架.
- 提供先进数字化人类发展的实用基础.
- 成功解决当前数字人脸表情系统的局限性.
相关概念视频
Facial Feedback Hypothesis
244
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
244
Muscles for Facial Expressions
2.7K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
2.7K


