Multimodal AI for risk stratification in autism spectrum disorder: integrating voice and screening tools

Sookyung Bae1, Junho Hong2, Sungji Ha3

  • 1Department of Integrated Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea.

NPJ Digital Medicine
|August 21, 2025
PubMed

Insights

Early Autism Spectrum Disorder (ASD) screening is challenging. A new AI framework using mobile data accurately identifies children at high risk for ASD, enabling timely interventions and improving diagnostic efficiency.

Area of Science:

  • Artificial Intelligence
  • Developmental Pediatrics
  • Machine Learning

Background:

  • Early identification of Autism Spectrum Disorder (ASD) is critical for effective intervention but remains resource-intensive.
  • Current screening methods often require specialized personnel and significant time.
  • Scalable and accessible screening tools are needed to improve early detection rates.

Purpose of the Study:

  • To evaluate a novel, two-stage multimodal Artificial Intelligence (AI) framework for scalable Autism Spectrum Disorder (ASD) screening.
  • To assess the framework's accuracy in differentiating typically developing children from those at high risk or with ASD.
  • To determine the framework's ability to stratify risk and support early diagnostic pathways.

Main Methods:

  • A cohort of 1242 children aged 18-48 months participated.
  • A mobile application collected parent-child interaction audio and screening tool data (MCHAT, SCQ-L, SRS).
  • A two-stage AI model integrated multimodal data (text, audio, task success) for risk assessment, validated against ADOS-2.

Main Results:

  • Stage 1 achieved an AUROC of 0.942 in differentiating typically developing from high-risk/ASD children.
  • Stage 2 achieved an AUROC of 0.914 and 85.2% accuracy in distinguishing high-risk from ASD children.
  • The AI model's risk predictions showed strong agreement (79.59% accuracy) and significant correlation (Pearson r=0.830) with gold-standard ADOS-2 assessments.

Conclusions:

  • The developed AI framework offers a promising approach for accurate and scalable early ASD screening.
  • Leveraging mobile technology and deep learning enhances the potential for early risk stratification.
  • This framework can support timely interventions by facilitating earlier identification of children with ASD.

Related Concept Videos

Autism Spectrum Disorder01:19

Autism Spectrum Disorder

Autism spectrum disorder (ASD) is a neurodevelopmental condition marked by persistent deficits in social communication and interaction alongside restrictive and repetitive behaviors or interests. ASD is sometimes accompanied by intellectual impairment.
These core symptoms manifest differently among individuals, ranging from mild to severe. The disorder's complexity extends beyond its clinical presentation, encompassing a diverse range of biological, cognitive, and sociocultural influences.
336
Learning Disabilities01:25

Learning Disabilities

Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
271
Modeling in Therapy01:26

Modeling in Therapy

Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
145