Validity of claims-based algorithms to identify neurodevelopmental disorders in children
Loreen Straub1, Brian T Bateman1,2, Sonia Hernandez-Diaz3
1Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.
Insights
Healthcare claims algorithms accurately identify many neurodevelopmental disorders (NDDs) in children, including autism spectrum disorder and ADHD. However, algorithms for developmental coordination disorder (DCD) require refinement for better accuracy in identifying true cases.
Area of Science:
- Pediatric Health
- Medical Informatics
- Neurodevelopmental Disorders
Background:
- Accurate identification of neurodevelopmental disorders (NDDs) is crucial for timely intervention and research.
- Healthcare claims data offer a large-scale resource but require validation for specific conditions.
Purpose of the Study:
- To validate the accuracy of healthcare claim-based algorithms for identifying various NDDs in children.
- To assess the positive predictive values (PPVs) of these algorithms against medical record reviews.
Main Methods:
- Children aged ≤14 years with NDDs were identified using claims data from two Boston hospitals (2010-2014).
- Fifty cases per NDD were randomly sampled for independent medical record review by two physicians.
- Positive predictive values (PPVs) and 95% confidence intervals (CIs) were calculated.
Main Results:
- High PPVs were observed for autism spectrum disorder (94%), ADHD (88%), learning disability (98%), speech/language disorder (98%), intellectual disability (82%), and behavioral disorder (92%).
- Developmental coordination disorder (DCD) algorithms showed a low PPV (38%), with many false positives due to varying criteria and co-occurring conditions.
Conclusions:
- Claims-based algorithms are generally reliable for studying common NDDs in children.
- Algorithm refinement, particularly for DCD, is necessary to improve classification accuracy and clinical utility.
Purpose:
To validate healthcare claim-based algorithms for neurodevelopmental disorders (NDD) in children using medical records as the reference.
Methods:
Using a clinical data warehouse of patients receiving outpatient or inpatient care at two hospitals in Boston, we identified children (≤14 years between 2010 and 2014) with at least one of the following NDDs according to claims-based algorithms: autism spectrum disorder/pervasive developmental disorder (ASD), attention deficit disorder/other hyperkinetic syndromes of childhood (ADHD), learning disability, speech/language disorder, developmental coordination disorder (DCD), intellectual disability, and behavioral disorder. Fifty cases per outcome were randomly sampled and their medical records were independently reviewed by two physicians to adjudicate the outcome presence. Positive predictive values (PPVs) and 95% confidence intervals (CIs) were calculated.
Results:
PPVs were 94% (95% CI, 83%-99%) for ASD, 88% (76%-95%) for ADHD, 98% (89%-100%) for learning disability, 98% (89%-100%) for speech/language disorder, 82% (69%-91%) for intellectual disability, and 92% (81%-98%) for behavioral disorder. A total of 19 of the 50 algorithm-based cases of DCD were confirmed as severe coordination disorders with functional impairment, with a PPV of 38% (25%-53%). Among the 31 false-positive cases of DCD were 7 children with coordination deficits that did not persist throughout childhood, 7 with visual-motor integration deficits, 12 with coordination issues due to an underlying medical condition and 5 with ADHD and at least one other severe NDD.
Conclusions:
PPVs were generally high (range: 82%-98%), suggesting that claims-based algorithms can be used to study NDDs. For DCD, additional criteria are needed to improve the classification of true cases.
More Related Videos
19:15Assessment and Evaluation of the High Risk Neonate: The NICU Network Neurobehavioral Scale
Published on: August 25, 2014
10:02Event Related Potentials ERPs and other EEG Based Methods for Extracting Biomarkers of Brain Dysfunction: Examples from Pediatric Attention Deficit/Hyperactivity Disorder ADHD
Published on: March 12, 2020
