Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Automatic recognition of eye blinking in spontaneously occurring behavior.

Jeffrey F Cohn1, Jing Xiao, Tsuyoshi Moriyama

  • 1Department of Psychology, University of Pittsburgh, Pittsburgh, Pennsylvania 15260, USA. jeffcohn@pitt.edu

Behavior Research Methods, Instruments, & Computers : a Journal of the Psychonomic Society, Inc
|November 1, 2003
PubMed
Summary

This study introduces a novel system for recognizing discrete facial actions, like eye blinks, in spontaneous, real-world videos. The system achieves high accuracy (98%) even with challenging conditions such as head motion and occlusion.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Representation Learning for Interpersonal and Multimodal Behavior Dynamics: A Multiview Extension of Latent Change Score Models.

Proceedings of the ... ACM International Conference on Multimodal Interaction. ICMI (Conference)·2025
Same author

Beyond Additive Fusion: Learning Non-Additive Multimodal Interactions.

Findings of ACL. EMNLP. Conference on Empirical Methods in Natural Language Processing·2025
Same author

Computational Analysis of Expressive Behavior in Clinical Assessment.

Annual review of clinical psychology·2025
Same author

Dynamic and dyadic relationships between facial behavior, working alliance, and treatment outcomes during depression therapy.

Journal of consulting and clinical psychology·2025
Same author

Advances in Behavioral Science Using Automated Facial Image Analysis and Synthesis.

IEEE signal processing magazine·2025
Same author

How Still? Parent-Infant Interaction During the Still-Face and Later Infant Attachment.

Infant and child development·2025

Area of Science:

  • Computer Vision
  • Human-Computer Interaction
  • Affective Computing

Background:

  • Automatic facial expression recognition traditionally focuses on posed emotions under controlled settings.
  • Existing systems struggle with spontaneous facial behavior, non-frontal poses, head motion, and occlusions.

Purpose of the Study:

  • To develop and evaluate a system for detecting discrete facial actions in spontaneous facial behavior.
  • To overcome limitations of previous research by handling real-world video complexities.

Main Methods:

  • The system recovers 3D motion parameters and stabilizes facial regions.
  • It extracts both motion and appearance information for action unit recognition.
  • The approach was tested on challenging video data from diverse subjects during interviews.

Related Experiment Videos

Main Results:

  • The system successfully detects discrete facial actions in spontaneous facial behavior.
  • Achieved 98% accuracy in recognizing eye blinks under challenging conditions.
  • Demonstrated robustness against non-frontal poses, head motion, and occlusions.

Conclusions:

  • The developed system significantly advances automatic facial action unit recognition in unconstrained environments.
  • It shows potential for applications requiring robust analysis of spontaneous facial expressions.
  • This research paves the way for more nuanced understanding of human behavior through facial analysis.