Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Muscles for Facial Expressions01:14

Muscles for Facial Expressions

4.7K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
4.7K
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

588
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
588
Planar Rigid-Body Motion01:22

Planar Rigid-Body Motion

982
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
982
Modeling and Similitude01:12

Modeling and Similitude

617
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
617
Virtual Work for a System of Connected Rigid Bodies01:06

Virtual Work for a System of Connected Rigid Bodies

728
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
728

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Extreme dynamic symmetry enables omnidirectional and multifunctional robots.

Science robotics·2026
Same author

Robot metabolism: Toward machines that can grow by consuming other machines.

Science advances·2025
Same author

Author Correction: Ab initio structure solutions from nanocrystalline powder diffraction data via diffusion models.

Nature materials·2025
Same author

Ab initio structure solutions from nanocrystalline powder diffraction data via diffusion models.

Nature materials·2025
Same author

Human-robot facial coexpression.

Science robotics·2024
Same author

Unveiling intra-person fingerprint similarity via deep contrastive learning.

Science advances·2024

Related Experiment Video

Updated: Jan 17, 2026

Author Spotlight: Advancements in the Fabrication of Synthetic Vocal Fold Models for Phonetic and Robotic Applications
06:24

Author Spotlight: Advancements in the Fabrication of Synthetic Vocal Fold Models for Phonetic and Robotic Applications

Published on: January 5, 2024

1.3K

Learning realistic lip motions for humanoid face robots.

Yuhang Hu1, Jiong Lin1, Judah Allen Goldfeder2

  • 1Department of Mechanical Engineering, Columbia University, New York, NY, USA.

Science Robotics
|January 14, 2026
PubMed
Summary

Researchers developed a novel humanoid robot face with advanced lip-audio synchronization capabilities. This system uses self-supervised learning to generate realistic lip movements, improving robot communication across multiple languages.

More Related Videos

Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation
06:53

Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation

Published on: March 1, 2017

13.8K
SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots
11:01

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

Published on: November 24, 2015

13.7K

Related Experiment Videos

Last Updated: Jan 17, 2026

Author Spotlight: Advancements in the Fabrication of Synthetic Vocal Fold Models for Phonetic and Robotic Applications
06:24

Author Spotlight: Advancements in the Fabrication of Synthetic Vocal Fold Models for Phonetic and Robotic Applications

Published on: January 5, 2024

1.3K
Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation
06:53

Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation

Published on: March 1, 2017

13.8K
SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots
11:01

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

Published on: November 24, 2015

13.7K

Area of Science:

  • Robotics
  • Artificial Intelligence
  • Human-Computer Interaction

Background:

  • Lip motion is crucial for human communication, yet anthropomorphic robots struggle with realistic lip-audio synchronization.
  • Existing robotic systems lack mechanical complexity and rely on predefined rules, limiting adaptability and naturalness.

Purpose of the Study:

  • To develop a humanoid robot face capable of nuanced and synchronized lip movements.
  • To overcome limitations in robotic lip articulation through advanced AI and mechanical design.

Main Methods:

  • Designed a humanoid robot face with soft silicone lips and a 10-degree-of-freedom actuation mechanism.
  • Implemented a self-supervised learning pipeline using a variational autoencoder (VAE) and facial action transformer.
  • Enabled autonomous inference of lip trajectories directly from speech audio without predefined movements.

Main Results:

  • The proposed method achieved more visually coherent lip-audio synchronization compared to amplitude-based baselines.
  • The learned synchronization model demonstrated generalization across 10 languages not encountered during training.
  • The robot exhibited improved and more realistic speech articulation.

Conclusions:

  • The developed system significantly enhances lip-audio synchronization in anthropomorphic robots.
  • Self-supervised learning offers a powerful approach for creating adaptable and realistic robotic facial expressions.
  • This advancement paves the way for more natural and engaging human-robot communication.