Related Experiment Video
Updated: Sep 13, 2025
Cell-based Assay Protocol for the Prognostic Prediction of Idiopathic Scoliosis Using Cellular Dielectric Spectroscopy
Published on: October 16, 2013
The Artificial Intelligence-Assisted Diagnosis of Skeletal Dysplasias in Pediatric Patients: A Comparative Benchmark
Nikola Ilić1, Nina Marić2,3, Dimitrije Cvetković4
1Clinical Genetics Outpatient Clinic, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.
Background/Objectives:
Skeletal dysplasias are a heterogeneous group of rare genetic disorders with diverse and overlapping clinical presentations, posing diagnostic challenges even for experienced clinicians. With the increasing availability of artificial intelligence (AI) in healthcare, large language models (LLMs) offer a novel opportunity to assist in rare disease diagnostics. This study aimed to compare the diagnostic accuracy of two advanced LLMs, ChatGPT (version GPT-4) and DeepSeek, with that of a clinical expert panel in a cohort of pediatric patients with genetically confirmed skeletal dysplasias.
Methods:
We designed a prospective vignette-based diagnostic benchmarking study including 45 children with confirmed skeletal dysplasias from two tertiary centers. Both LLMs were prompted to provide primary and differential diagnoses based on standardized clinical case vignettes. Their outputs were compared with those of two human experts (a pediatric endocrinologist and a pediatric orthopedic surgeon), using molecular diagnosis as the gold standard.
Results:
ChatGPT and DeepSeek achieved a comparable diagnostic top-3 accuracy (62.2% and 64.4%, respectively), with a high intermodel agreement (Cohen's κ = 0.95). The expert panel outperformed both models (82.2%). While LLMs performed well on more common disorders, they struggled with ultra-rare and multisystemic conditions. In one complex case missed by experts, the DeepSeek model successfully proposed the correct diagnosis.
Conclusions:
LLMs offer a complementary diagnostic value in skeletal dysplasias, especially in under-resourced medical settings. Their integration as a supportive tool in multidisciplinary diagnostic workflows may enhance early recognition and reduce diagnostic delays in rare disease care.
