Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 24, 2026

Three-Dimensional Mapping of the Rotation of Interactive Virtual Objects with Eye-Tracking Data
06:36

Three-Dimensional Mapping of the Rotation of Interactive Virtual Objects with Eye-Tracking Data

Published on: October 18, 2024

Three-dimensional face pose detection and tracking using monocular videos: tool and application.

Fadi Dornaika1, Bogdan Raducanu

  • 1Institut Géographique National, 94165 Saint-Mandé, France. fadi.dornaika@ign.fr

IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
|April 2, 2009
PubMed
Summary

This study introduces a real-time tracker for 3D head pose and facial actions using low-quality video. The system enhances human-robot interaction by enabling camera control through head pose estimation.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The Minimum Semantic Content (MSC) Dataset: A Large, Balanced Resource for Computational Aesthetics Research.

Scientific data·2026
Same author

Parallel VMamba and Attention-Based Pneumonia Severity Prediction from CXRs: A Robust Model with Segmented Lung Replacement Augmentation.

Diagnostics (Basel, Switzerland)·2025
Same author

Artificial intelligence in bone metastasis analysis: Current advancements, opportunities and challenges.

Computers in biology and medicine·2025
Same author

Enhancing MRI brain tumor classification: A comprehensive approach integrating real-life scenario simulation and augmentation techniques.

Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics (AIFB)·2024
Same author

D-TrAttUnet: Toward hybrid CNN-transformer architecture for generic and subtle segmentation in medical images.

Computers in biology and medicine·2024
Same author

Environmental Constraints for Intelligent Internet of Deep-Sea/Underwater Things Relying on Enterprise Architecture Approach.

Sensors (Basel, Switzerland)·2024

Area of Science:

  • Computer Vision
  • Robotics
  • Human-Computer Interaction

Background:

  • Accurate 3D head pose and facial action tracking are crucial for natural human-machine interaction.
  • Existing methods often require high-quality video or complex setups, limiting their applicability.

Purpose of the Study:

  • To develop a robust real-time tracker for simultaneous 3D head pose and facial action estimation from monocular, low-quality video.
  • To propose an automatic initialization scheme for the tracker.
  • To demonstrate the application of this tracker in enhancing human-robot interaction, specifically for an AIBO robot.

Main Methods:

  • A real-time tracking system for simultaneous 3D head pose and facial action estimation.
  • An automatic 3D face pose initialization scheme using a 2D face detector and an eigenface system.

More Related Videos

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
12:39

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

Artificial Intelligence-Based System for Detecting Attention Levels in Students
06:37

Artificial Intelligence-Based System for Detecting Attention Levels in Students

Published on: December 15, 2023

Related Experiment Videos

Last Updated: Jun 24, 2026

Three-Dimensional Mapping of the Rotation of Interactive Virtual Objects with Eye-Tracking Data
06:36

Three-Dimensional Mapping of the Rotation of Interactive Virtual Objects with Eye-Tracking Data

Published on: October 18, 2024

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
12:39

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

Artificial Intelligence-Based System for Detecting Attention Levels in Students
06:37

Artificial Intelligence-Based System for Detecting Attention Levels in Students

Published on: December 15, 2023

  • Integration of the tracking system with an AIBO robot for camera orientation control based on user head pose.

    • Main Results:

    • The proposed tracker successfully estimates 3D head pose and facial actions in real-time from low-quality video.
    • The automatic initialization scheme provides a robust starting point for the tracker.
    • Experiments demonstrated effective control of the AIBO robot's camera orientation via user head pose estimation.

    Conclusions:

    • The developed real-time tracking system is robust and effective for monocular, low-quality video.
    • The proposed initialization method enhances the tracker's performance.
    • This technology has direct applications in telepresence, virtual reality, video games, and advanced human-robot interaction systems.