Related Experiment Video
Updated: Mar 1, 2026

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
Published on: March 14, 2018
[Reliability and validity of warning signs checklist for screening psychological, behavioral and developmental
1Section of Health and Nutrition and Water, Environment and Sanitation, United Nations Children's Fund, Beijing 100600, China.
Insights
This study validated a warning signs checklist for early childhood developmental problems. The checklist demonstrated good reliability and validity, making it suitable for community-based screening.
Area of Science:
- Child Development
- Developmental Psychology
- Public Health Screening
Background:
- Early identification of developmental problems in children is crucial for timely intervention.
- Existing screening tools require validation for diverse populations and settings.
- The National Health and Family Planning Commission (NHFPC) developed a warning signs checklist for early childhood development.
Purpose of the Study:
- To evaluate the reliability and validity of the NHFPC warning signs checklist.
- To determine the screening effectiveness of this checklist for early childhood developmental problems.
Main Methods:
- Stratified random sampling of 2,110 children aged 0-6 years across 11 Chinese provinces.
- Assessed test-retest and interrater reliability of the warning signs checklist.
- Evaluated criterion validity using the Age and Stage Questionnaire (ASQ) and Gesell Development Diagnosis Scale (GESELL).
Main Results:
- The checklist showed good test-retest and interrater reliability (≥0.7).
- Consistency with ASQ (Kappa=0.63) and GESELL (sensitivity=82.2%, specificity=77.7%) indicated good criterion validity.
- Screening positive rates varied from 10.8% to 26.2%, with a median testing time of 1 minute.
Conclusions:
- The NHFPC warning signs checklist meets basic requirements for psychological screening scales.
- The checklist is reliable, valid, quick to administer, and easy to use.
- It is suitable for screening psychological and behavioral problems in early childhood, particularly in community settings.
Abstract:
Objective: To evaluate the reliability and validity of warning signs checklist developed by the National Health and Family Planning Commission of the People's Republic of China (NHFPC), so as to determine the screening effectiveness of warning signs on developmental problems of early childhood. Method: Stratified random sampling method was used to assess the reliability and validity of checklist of warning sign and 2 110 children 0 to 6 years of age(1 513 low-risk subjects and 597 high-risk subjects) were recruited from 11 provinces of China. The reliability evaluation for the warning signs included the test-retest reliability and interrater reliability. With the use of Age and Stage Questionnaire (ASQ) and Gesell Development Diagnosis Scale (GESELL) as the criterion scales, criterion validity was assessed by determining the correlation and consistency between the screening results of warning signs and the criterion scales. Result: In terms of the warning signs, the screening positive rates at different ages ranged from 10.8%(21/141) to 26.2%(51/137). The median (interquartile) testing time for each subject was 1(0.6) minute. Both the test-retest reliability and interrater reliability of warning signs reached 0.7 or above, indicating that the stability was good. In terms of validity assessment, there was remarkable consistency between ASQ and warning signs, with the Kappa value of 0.63. With the use of GESELL as criterion, it was determined that the sensitivity of warning signs in children with suspected developmental delay was 82.2%, and the specificity was 77.7%. The overall Youden index was 0.6. Conclusion: The reliability and validity of warning signs checklist for screening early childhood developmental problems have met the basic requirements of psychological screening scales, with the characteristics of short testing time and easy operation. Thus, this warning signs checklist can be used for screening psychological and behavioral problems of early childhood, especially in community settings.
Related Concept Videos
Reliability and Validity
Self-Report Tests of Personality
Oppositional Defiant Disorder
Diagnostic Criteria and...
Attention-Deficit/Hyperactivity Disorder
Diagnostic Criteria and Symptoms
To diagnose ADHD, symptoms must manifest before age 12 and be evident across multiple settings....

