学习真实的唇部动作的人形面部机器人机器人
Yuhang Hu1, Jiong Lin1, Judah Allen Goldfeder2
1Department of Mechanical Engineering, Columbia University, New York, NY, USA.
Science robotics
|January 14, 2026
概括
研究人员开发了一种新型的人形机器人面部,具有先进的唇音同步功能. 该系统使用自主监督学习来产生现实的唇部动作,改善机器人跨多种语言的沟通.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 唇部运动对于人类沟通至关重要,但人形机器人却难以实现真实的唇部音频同步.
- 现有的机器人系统缺乏机械复杂性,依赖于预先定义的规则,限制了适应性和自然性.
研究的目的:
- 开发一个人形机器人面部,能够微妙和同步的唇部运动.
- 通过先进的人工智能和机械设计,克服机器人唇部发音的局限性.
主要方法:
- 设计了一个人形机器人面部,柔软的唇和10度自由度的驱动机制.
- 通过使用变量自编码器 (VAE) 和面部动作变压器实现了自我监督的学习管道.
- 启用了直接从语音音频中自主推断唇部轨迹的自主推断,没有预定义的运动.
主要成果:
- 与基于振幅的基线相比,拟议的方法实现了更可视连贯的唇音同步.
- 学习的同步模型展示了在培训期间没有遇到的10种语言的概括性.
- 机器人表现出改进和更现实的语音表达.
结论:
- 开发的系统显著提高了人造机器人中的唇音同步.
- 自主监督学习为创建可适应和现实的机器人面部表情提供了一种强大的方法.
- 这一进步为更自然,更有吸引力的人机通信铺平了道路.
相关概念视频
Muscles for Facial Expressions
4.7K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
4.7K
Facial Feedback Hypothesis
588
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
588
Planar Rigid-Body Motion
982
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
982
Modeling and Similitude
617
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
617
Virtual Work for a System of Connected Rigid Bodies
728
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
728


