Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Facial Feedback Hypothesis

Facial Feedback Hypothesis

Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...

Modeling in Therapy

Modeling in Therapy

Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...

Autism Spectrum Disorder

Autism Spectrum Disorder

Autism spectrum disorder (ASD) is a neurodevelopmental condition marked by persistent deficits in social communication and interaction alongside restrictive and repetitive behaviors or interests. ASD is sometimes accompanied by intellectual impairment.
These core symptoms manifest differently among individuals, ranging from mild to severe. The disorder's complexity extends beyond its clinical presentation, encompassing a diverse range of biological, cognitive, and sociocultural influences.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Perceived Sensitivity of Sensor-Based Digital Health Data: Qualitative Interview Study.

JMIR mHealth and uHealth·2026

Same author

Cross-Modal Characterization of Infant Cry: Validation of a Chest-Surface Accelerometer in Extracting Acoustic Vocal Function Measures.

ArXiv·2026

Same author

A transdiagnostic AI-based measure of interpersonal coordination in autism and other conditions.

Molecular autism·2026

Same author

Automatic measurement of social gaze during naturalistic conversations in autism.

Journal of psychiatric research·2026

Same author

Subclinical neuropsychiatric trait variation in parents of children with autism spectrum disorder: a cohort study.

Molecular autism·2026

Same author

Micro-DualNet: Dual-Path Spatio-Temporal Network for Micro-Action Recognition.

ArXiv·2026

Search research articles

Related Experiment Video

Updated: Sep 10, 2025

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Published on: July 31, 2016

Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autism.

Evangelos Sariyanidi¹, Lisa Yankowitz¹, Robert T Schultz^1,2

¹Center for Autism Research, The Children's Hospital of Philadelphia, Philadelphia, PA, USA.

Proceedings of the ... International Conference on Automatic Face and Gesture Recognition. IEEE International Conference on Automatic Face & Gesture Recognition

|August 25, 2025

Summary

This summary is machine-generated.

A new Facial Basis system offers a comprehensive alternative to the Facial Action Coding System (FACS) for analyzing facial movements. This unsupervised method accurately captures all facial expressions, outperforming existing automated tools in predicting autism diagnosis.

More Related Videos

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos

Published on: December 7, 2018

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

Related Experiment Videos

Last Updated: Sep 10, 2025

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Published on: July 31, 2016

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos

Published on: December 7, 2018

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

Area of Science:

Computer Vision
Behavioral Science
Machine Learning

Background:

The Facial Action Coding System (FACS) is crucial for linking facial behavior to mental health but is labor-intensive and costly.
Automated Action Unit (AU) detection faces limitations in accuracy and coverage, hindering comprehensive facial expression analysis.
Existing methods struggle to represent the entirety of facial expressions, excluding many AUs.

Purpose of the Study:

To introduce Facial Basis, a novel, data-driven coding system for facial movement analysis.
To overcome the limitations of automated FACS coding, including manual annotation, limited movement repertoire, and non-additive unit combinations.
To provide a comprehensive and unsupervised approach for deconstructing facial expressions in videos.

Main Methods:

Developed a data-driven coding system, Facial Basis, with units representing localized, interpretable 3D facial movements.
Implemented an unsupervised learning framework, eliminating the need for manual annotation.
Ensured Facial Basis reconstructs all observable facial movements and that its units are additive.

Main Results:

Facial Basis accurately reconstructs all observable facial movements, unlike automated FACS which uses a limited set of AUs.
The system is unsupervised, bypassing the need for costly and time-consuming manual annotation.
Facial Basis units are additive, overcoming limitations of non-additive AU combinations in existing methods.
Facial Basis outperformed the leading AU detector in predicting autism diagnosis from video data.

Conclusions:

Facial Basis presents a significant advancement as the first FACS alternative for deconstructing facial expressions into localized movements from video.
The comprehensive and unsupervised nature of Facial Basis makes it a valuable tool for behavioral research.
This method holds promise for improving our understanding of facial behavior in relation to mental health conditions like autism.