Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Aug 3, 2025

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
04:23

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Published on: April 21, 2023

1.9K

Precise Facial Landmark Detection by Reference Heatmap Transformer.

Jun Wan, Jun Liu, Jie Zhou

    IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
    |April 8, 2023
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Lvvibriocin-GK effectively reduced skin ulcer syndrome of Apostichopus japonicus by eliminating surface bacteria, modulating gut microbiota, and enhancing host immune responses.

    Fish & shellfish immunology·2025
    Same author

    Multiscale Organization of Neural Networks in a 3D Bioprinted Matrix.

    Advanced science (Weinheim, Baden-Wurttemberg, Germany)·2025
    Same author

    Spatial distribution patterns and formation of global spermatophytes.

    Journal of integrative plant biology·2025
    Same author

    P-Band Center Engineering of Sulfur to Weaken Fe─S Bond Toward Superior Sodium-Ion Storage.

    Advanced materials (Deerfield Beach, Fla.)·2025
    Same author

    Dark nectar pouches are visually similar to colored nectar in bird-pollinated flowers.

    Ecology·2025
    Same author

    An in vivo study of the ameliorative effect of supplementation with Lacticaseibacillus paracasei Glory LP16 in immunocompromised mice.

    Scientific reports·2025
    Same journal

    Style-Aware Contrastive Test-Time Adaptation: A Dual-Cache Model for Robust Vision-Language Alignment.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
    Same journal

    Semantic Frame Interpolation.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
    Same journal

    Physics-Guided Cross-Modal Decoupling with Test-Time Adaptation for Hyperspectral Image Restoration.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
    Same journal

    Change-Prior-Guided Unsupervised Change Detection of Heterogeneous Remote Sensing Images.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
    Same journal

    AgonicDreamer: Enhancing Multi-View Consistency in Text-to-3D Generation via Rectified Score Distillation.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
    Same journal

    BiCM-Prompt: Bidirectional Cross-Modal Prompt Tuning for Class-Incremental Learning on Multisource Remote Sensing Images.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
    See all related articles

    This study introduces a Reference Heatmap Transformer (RHT) to improve facial landmark detection accuracy, especially in challenging conditions like large poses and occlusions. The RHT effectively transforms reference heatmap information for more precise landmark prediction.

    Area of Science:

    • Computer Vision
    • Machine Learning
    • Artificial Intelligence

    Background:

    • Facial landmark detection methods often struggle with accuracy under challenging conditions such as large poses, occlusions, and complex lighting.
    • Existing methods relying on appearance features and heatmaps face limitations in learning discriminative representations and effective shape constraints.

    Purpose of the Study:

    • To propose a novel Reference Heatmap Transformer (RHT) for enhancing the precision of facial landmark detection.
    • To address the limitations of current methods in handling pose variations, occlusions, and illumination complexities.

    Main Methods:

    • The Reference Heatmap Transformer (RHT) incorporates a Soft Transformation Module (STM) and a Hard Transformation Module (HTM) to refine reference heatmap information and facial shape constraints.

    More Related Videos

    Author Spotlight: Three-Dimensional Cephalometric Landmark Annotation Demonstration on Human Cone Beam Computed Tomography Scans
    10:23

    Author Spotlight: Three-Dimensional Cephalometric Landmark Annotation Demonstration on Human Cone Beam Computed Tomography Scans

    Published on: September 8, 2023

    2.8K
    A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
    12:39

    A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

    Published on: January 18, 2020

    7.7K

    Related Experiment Videos

    Last Updated: Aug 3, 2025

    A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
    04:23

    A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

    Published on: April 21, 2023

    1.9K
    Author Spotlight: Three-Dimensional Cephalometric Landmark Annotation Demonstration on Human Cone Beam Computed Tomography Scans
    10:23

    Author Spotlight: Three-Dimensional Cephalometric Landmark Annotation Demonstration on Human Cone Beam Computed Tomography Scans

    Published on: September 8, 2023

    2.8K
    A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
    12:39

    A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

    Published on: January 18, 2020

    7.7K
  • A Multi-Scale Feature Fusion Module (MSFFM) is utilized to integrate transformed heatmap features with semantic features from original images, improving feature representation.
  • This approach is novel in exploring the transformation of reference heatmap information to boost facial landmark detection.

    • Main Results:

    • The proposed RHT method demonstrates superior performance compared to existing state-of-the-art techniques on challenging benchmark datasets.
    • Experimental results confirm the effectiveness of the RHT in improving landmark detection accuracy under adverse conditions.
    • The integration of reference heatmap transformation and multi-scale feature fusion significantly enhances feature representations.

    Conclusions:

    • The Reference Heatmap Transformer (RHT) offers a significant advancement in facial landmark detection, particularly for unconstrained facial images.
    • The method's ability to leverage and transform reference heatmap information provides a robust solution for complex scenarios.
    • This research opens new avenues for improving the accuracy and robustness of facial analysis systems.