Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Autism Spectrum Disorder01:19

Autism Spectrum Disorder

100
Autism spectrum disorder (ASD) is a neurodevelopmental condition marked by persistent deficits in social communication and interaction alongside restrictive and repetitive behaviors or interests. ASD is sometimes accompanied by intellectual impairment.
These core symptoms manifest differently among individuals, ranging from mild to severe. The disorder's complexity extends beyond its clinical presentation, encompassing a diverse range of biological, cognitive, and sociocultural influences.
100
Modeling in Therapy01:26

Modeling in Therapy

89
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
89

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Perceived Sensitivity of Sensor-Based Digital Health Data: Qualitative Interview Study.

JMIR mHealth and uHealth·2026
Same author

A transdiagnostic AI-based measure of interpersonal coordination in autism and other conditions.

Molecular autism·2026
Same author

Automatic measurement of social gaze during naturalistic conversations in autism.

Journal of psychiatric research·2026
Same author

Subclinical neuropsychiatric trait variation in parents of children with autism spectrum disorder: a cohort study.

Molecular autism·2026
Same author

Micro-DualNet: Dual-Path Spatio-Temporal Network for Micro-Action Recognition.

ArXiv·2026
Same author

Stop Right Now, Thank You Very Much: Psychopathic Traits, Externalizing Dimensions, and Interpersonal Proximity.

Journal of personality disorders·2026

Related Experiment Video

Updated: Jul 9, 2025

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos
05:32

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos

Published on: December 7, 2018

9.0K

Comparison of Human Experts and AI in Predicting Autism from Facial Behavior.

Evangelos Sariyanidi1, Casey J Zampella1, Ellis DeJardin1

  • 1Center for Autism Research, The Children's Hospital of Philadelphia, United States.

CEUR Workshop Proceedings
|December 1, 2023
PubMed
Summary

This study evaluates how well artificial intelligence can identify autism spectrum disorder from short videos compared to human experts and non-experts. The findings suggest that automated systems perform similarly to clinicians and may provide unique insights that human observers miss.

Keywords:
assistive healthcare technologiesautismdigital phenotypingcomputational psychiatrybehavioral analysismachine learningclinical decision-making

Frequently Asked Questions

More Related Videos

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome
08:31

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Published on: July 31, 2016

13.2K
Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

7.8K

Related Experiment Videos

Last Updated: Jul 9, 2025

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos
05:32

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos

Published on: December 7, 2018

9.0K
Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome
08:31

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Published on: July 31, 2016

13.2K
Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

7.8K

Area of Science:

  • Computational psychiatry and behavioral science
  • Artificial intelligence in autism diagnostics research

Background:

No prior work had resolved how automated diagnostic predictions align with human clinical judgment. That uncertainty drove this investigation into the comparative efficacy of machine learning versus human observers. Prior research has shown that computational analysis of behavior offers new avenues for mental healthcare. However, the degree to which these systems offer unique diagnostic value remains unclear. This gap motivated a direct assessment of algorithmic performance against human raters. Clinicians often rely on subtle facial cues during patient interactions. Whether machines can capture these same patterns is a subject of ongoing debate. Understanding these differences is necessary for the successful integration of technology into clinical workflows.

Purpose Of The Study:

The study aims to evaluate how algorithmic predictions of autism correspond with human clinical judgment. This investigation addresses the need to understand the utility of automated tools in mental healthcare. Researchers sought to determine if machines provide information beyond what clinicians can readily infer. The project compares the diagnostic performance of human experts and non-experts against a computational pipeline. By using short video clips, the team examined facial behavior in naturalistic settings. This comparison is vital for determining the role of technology in diagnostic decision-making. The authors intended to clarify whether AI can serve as a reliable assistive tool for clinicians. This work provides a foundation for integrating automated analysis into existing diagnostic workflows.

Main Methods:

The review approach involved a comparative analysis of diagnostic predictions from nineteen human observers and one automated pipeline. Researchers selected forty-two participants for the study based on their availability for naturalistic video recording. Each participant engaged in a three-minute conversation to provide sufficient behavioral data. The team recruited eight specialists and eleven non-specialists to perform the human evaluations. All raters viewed the same video clips to ensure a consistent baseline for comparison. The computational system processed facial behavior patterns to generate a diagnostic label for every subject. Investigators then calculated the accuracy of both human and machine predictions against known clinical outcomes. This structured evaluation allowed for a direct assessment of how machine learning models perform relative to human expertise.

Main Results:

The artificial intelligence algorithm achieved an average accuracy of 80.5% across the participant group. This performance is comparable to the 83.1% accuracy observed among autism experts. Clinical research staff without specialized training reached an average accuracy of 78.3%. The data indicate that machine predictions align closely with the success rates of human professionals. A key finding reveals that the algorithm correctly classified many cases where human raters failed. This pattern suggests that automated systems detect behavioral features that humans often overlook. The results show that the machine provides diagnostic information distinct from human observation. These metrics demonstrate the potential for computational tools to assist in clinical settings.

Conclusions:

The authors propose that artificial intelligence serves as a viable assistive tool for diagnostic decision-making. Their findings suggest that automated systems reach accuracy levels similar to specialized human clinicians. The researchers note that machine learning models often correctly classify cases where human raters struggle. This discrepancy indicates that algorithms might capture behavioral markers invisible to the naked eye. The study highlights the potential for technology to augment rather than replace professional judgment. These results support the use of computational pipelines in clinical research settings. The authors emphasize that AI provides information beyond what humans readily infer. Future integration may improve the reliability of diagnostic processes in mental health.

The researchers propose that the algorithm achieves 80.5% accuracy, which is statistically similar to the 83.1% accuracy of autism experts and the 78.3% accuracy of non-experts. The machine correctly identifies cases that human raters frequently misclassify.

The study utilized short, three-minute video clips of forty-two participants engaged in naturalistic conversations. These recordings served as the primary input for both the automated pipeline and the human evaluators.

The authors suggest that the three-minute duration is necessary to capture sufficient naturalistic facial behavior for the algorithm to function. This timeframe allows for the observation of dynamic social cues during conversation.

The researchers employed a cohort of nineteen human raters, consisting of eight specialists in autism and eleven clinical research staff members without specialized training. This group provided the baseline for human diagnostic performance.

The team measured diagnostic accuracy by comparing the predicted labels from the AI and the humans against the established clinical diagnosis of the forty-two participants. This metric quantifies the predictive power of each rater type.

The authors propose that their findings demonstrate the utility of AI as an augmentation tool. They suggest that combining human expertise with machine insights could improve the overall quality of clinical decision-making.