Related Experiment Video
Updated: Jun 5, 2025

Assessment and Evaluation of the High Risk Neonate: The NICU Network Neurobehavioral Scale
Published on: August 25, 2014
Longitudinal Stability and Predictive Value of Socio/Emotional/Behavioral Screening in an Outpatient Pediatric
R Christopher Sheldrick1, Justin Birudavol2, Dina R Hirshfeld-Becker3
1Department of Psychiatry (RC Sheldrick), UMass Chan School of Medicine, Worcester, Mass.
Insights
Three common social/emotional/behavioral (SEB) screeners show moderate longitudinal stability in pediatric care. Threshold selection significantly impacts sensitivity and specificity, requiring careful consideration for accurate screening.
Area of Science:
- Pediatric health
- Mental health screening
- Behavioral science
Background:
- Annual social/emotional/behavioral (SEB) screening is recommended for pediatric visits.
- Existing SEB screeners have empirical support but limited data on longitudinal use.
- Few studies evaluate the long-term performance of SEB screeners in clinical practice.
Purpose of the Study:
- To analyze the longitudinal stability of three SEB screeners.
- To evaluate the association between SEB screener results and ICD codes.
- To inform the clinical application of SEB screening tools in pediatrics.
Main Methods:
- Analysis of electronic health records (EHR) from 9153 children and adolescents across seven pediatric clinics.
- Longitudinal assessment of three SEB screeners over a 3-year period.
- Evaluation of screener stability using intraclass correlation coefficients (ICC) and association with ICD codes.
Main Results:
- Moderate longitudinal stability was found for the Baby Pediatric Symptom Checklist (ICC=.57), Preschool Pediatric Symptom Checklist (ICC=.60), and Pediatric Symptom Checklist-17 (ICC=.69).
- Positive predictive values ranged from 40-65% across various thresholds.
- Higher thresholds increased specificity but decreased sensitivity, with a majority of ICD codes not predicted by positive screens.
Conclusions:
- Common SEB screeners demonstrate longitudinal stability comparable to longer measures.
- Recommended thresholds vary significantly across screeners, influencing diagnostic accuracy.
- Careful selection of thresholds is crucial for optimizing SEB screening sensitivity and specificity in pediatric settings.
Background:
In 2022, the American Academy of Pediatrics recommended annual social/emotional/behavioral (SEB) screening at preventive pediatric visits. Numerous SEB screeners have considerable empirical support for children of all ages. However, few studies inform the longitudinal use of SEB screeners in pediatrics.
Methods:
Using electronic health records (EHR) from seven pediatric clinics in a large hospital system, we analyze the longitudinal stability of three SEB screeners among 9153 children and adolescents who were screened multiple times over a 3-year period, and we evaluate associations with International Classification of Disease (ICD) codes for SEB diagnoses.
Results:
Moderate stability was documented for the Baby Pediatric Symptom Checklist (intraclass correlation coefficient [ICC]=.57), Preschool Pediatric Symptom Checklist (ICC=.60), and Pediatric Symptom Checklist-17 (ICC=.69). Stability of positive/negative results was sensitive to each screener's threshold. Across a range of thresholds that classify 7-20% of children as positive, all three screeners achieved positive predictive values (PPVs) of approximately 40-65% and diagnostic odds ratios ranging from 8 to 15. These findings compare favorably to published results for longer measures and structured interviews. Recommended thresholds varied markedly across screeners, and associations with ICD codes demonstrate that higher thresholds yield higher specificity but lower sensitivity (ie, a majority of ICD codes are not anticipated by positive screens).
Conclusions:
Three common SEB screeners display longitudinal stability similar to longer, more established measures. Results demonstrate that recommended thresholds vary markedly across measures and that choice of threshold strongly influences sensitivity and specificity, underscoring the need for greater attention to selection of thresholds.
More Related Videos
09:16Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
Published on: March 14, 2018
05:48The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients
Published on: June 12, 2020
Related Concept Videos
Longitudinal Studies
Longitudinal Research
Socioemotional Development during Infancy
Primary Temperament Types
Self-Report Tests of Personality