Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Representation Learning for Interpersonal and Multimodal Behavior Dynamics: A Multiview Extension of Latent Change Score Models.

Proceedings of the ... ACM International Conference on Multimodal Interaction. ICMI (Conference)·2025
Same author

Beyond Additive Fusion: Learning Non-Additive Multimodal Interactions.

Findings of ACL. EMNLP. Conference on Empirical Methods in Natural Language Processing·2025
Same author

Computational Analysis of Expressive Behavior in Clinical Assessment.

Annual review of clinical psychology·2025
Same author

Dynamic and dyadic relationships between facial behavior, working alliance, and treatment outcomes during depression therapy.

Journal of consulting and clinical psychology·2025
Same author

Advances in Behavioral Science Using Automated Facial Image Analysis and Synthesis.

IEEE signal processing magazine·2025
Same author

How Still? Parent-Infant Interaction During the Still-Face and Later Infant Attachment.

Infant and child development·2025

Related Experiment Video

Updated: Mar 26, 2026

A Test Bed to Examine Helmet Fit and Retention and Biomechanical Measures of Head and Neck Injury in Simulated Impact
07:30

A Test Bed to Examine Helmet Fit and Retention and Biomechanical Measures of Head and Neck Injury in Simulated Impact

Published on: September 21, 2017

9.4K

Robust Full-Motion Recovery of Head by Dynamic Templates and Re-registration Techniques.

Jing Xiao1, Tsuyoshi Moriyama1, Takeo Kanade1

  • 1Robotics Institute, Carnegie Mellon University.

International Journal of Imaging Systems and Technology
|January 29, 2016
PubMed
Summary

This study introduces a real-time method for recovering full 3D head motion from video using a cylindrical head model. The approach achieves robust head pose estimation and enables accurate facial expression analysis.

More Related Videos

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

14.8K
Movement Retraining using Real-time Feedback of Performance
08:16

Movement Retraining using Real-time Feedback of Performance

Published on: January 17, 2013

13.9K

Related Experiment Videos

Last Updated: Mar 26, 2026

A Test Bed to Examine Helmet Fit and Retention and Biomechanical Measures of Head and Neck Injury in Simulated Impact
07:30

A Test Bed to Examine Helmet Fit and Retention and Biomechanical Measures of Head and Neck Injury in Simulated Impact

Published on: September 21, 2017

9.4K
Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

14.8K
Movement Retraining using Real-time Feedback of Performance
08:16

Movement Retraining using Real-time Feedback of Performance

Published on: January 17, 2013

13.9K

Area of Science:

  • Computer Vision
  • Biomedical Engineering
  • Robotics

Background:

  • Accurate head pose estimation is crucial for human-computer interaction and behavioral analysis.
  • Existing methods often struggle with non-rigid motion, occlusion, and changing lighting conditions.

Purpose of the Study:

  • To develop a robust, real-time method for recovering full 3D head motion (rotations and translations) from monocular video.
  • To enhance facial expression analysis by stabilizing head movements.

Main Methods:

  • Utilizes a cylindrical head model and an initial reference template for pose recovery.
  • Employs iteratively re-weighted least squares (IRLS) with image gradients for non-rigid motion and occlusion.
  • Dynamically updates templates to handle self-occlusion, lighting changes, and temporary out-of-view scenarios.
  • Re-registers images to a reference template to minimize accumulated errors.

Main Results:

  • Achieved real-time performance with average 3D rotation recovery accuracy of approximately 3 degrees.
  • Demonstrated robustness in experiments with synthetic and real image sequences, including large pitch (40°) and yaw (75°) angles.
  • Enabled 98% accuracy in automatic blink recognition when integrated into a facial expression analysis system.

Conclusions:

  • The proposed method offers a reliable solution for real-time 3D head motion recovery.
  • Its robustness to challenging conditions makes it suitable for analyzing spontaneous facial behavior.
  • The technique significantly improves the accuracy of subsequent facial analysis tasks, such as blink detection.