Related Experiment Video
Updated: Aug 23, 2026

Measuring the Functional Abilities of Children Aged 3-6 Years Old with Observational Methods and Computer Tools
Published on: June 20, 2020
Inter-rater reliability in assigning ICF codes to children with disabilities
Julie Ogonowski1, Rebecca Kronk, Carryn Rice
1University of Pittsburgh School of Medicine, Pennsylvania, USA.
Insights
Independent raters achieved good agreement when assigning International Classification of Functioning, Disability, and Health (ICF) codes for children with disabilities using structured assessment tools. Agreement varied by ICF domain and assessment measure.
Area of Science:
- Pediatric rehabilitation
- Disability assessment
- Health classification systems
Background:
- The International Classification of Functioning, Disability, and Health (ICF) provides a standardized framework for describing health and disability.
- Accurate coding of children's functional status is crucial for research, clinical practice, and policy.
- Standardized pediatric functional assessments are commonly used but their alignment with ICF coding requires investigation.
Purpose of the Study:
- To evaluate inter-rater reliability in assigning ICF Activities and Participation codes to children with disabilities.
- To determine if independent raters achieve consistent coding decisions based on standard functional assessment results.
Main Methods:
- Sixty children (9 months–17.75 years) with disabilities were assessed using the Vineland Adaptive Behavior Scales, Pediatric Evaluation of Disability Inventory (PEDI), or School Function Assessment (SFA).
- Two independent raters assigned ICF Activities and Participation codes based on assessment results.
- Cohen's kappa statistic was used to measure inter-rater reliability.
Main Results:
- Good agreement (kappa ≥ 0.70) was achieved for 23/40 ICF codes with the Vineland, 17/40 with PEDI, and 17/40 with SFA.
- Mean kappa reached ≥ 0.70 for the Self-care domain across all three tools.
- The Vineland demonstrated good agreement for Learning and Applying Knowledge and Mobility domains.
Conclusions:
- Developmentally structured assessment items that map to single ICF codes enhance rater agreement.
- For ICF domains beyond Self-care, alternative assessment strategies may be needed to improve coding accuracy for pediatric populations.
- This study highlights the importance of assessment tool design in reliable ICF code assignment for children.
Purpose:
The purpose of this study was to determine if independent raters would arrive at similar decisions about which codes from the Activities and Participation component of the International Classification of Functioning, Disability, and Health (ICF) to assign to children with disabilities based on the results of standard paediatric functional assessment measures.
Method:
Children (N = 60), 9 months to 17.75 years old, with a range of disabilities were assessed using either the Vineland Adaptive Behavior Scales (n = 20), the Pediatric Evaluation of Disability Inventory (PEDI) (n = 20), or the School Function Assessment (SFA) (n = 20). Two raters independently determined which of 40 codes from the Activities and Participation component of the ICF applied to each child based on items and standard scores from the assessment measure. The Cohen's kappa statistic was used as the measure of inter-rater reliability.
Results:
The kappa statistic was >/= 0.70, the criterion for good agreement in this study, for 23/40 codes using the Vineland, 17/40 codes using the PEDI, and 17/40 codes using the SFA. The mean kappa statistic reached >/= 0.70 for the Self care domain, using all three tools. The mean kappa statistic also reached >/= 0.70 for Learning and Applying Knowledge and Mobility using the Vineland.
Conclusions:
Independent raters reached high rates of agreement when assessment test items were structured developmentally and corresponded to a single ICF code. For domains other than Self care, alternative assessment strategies may be necessary to improve assigning ICF codes to children with disabilities.
More Related Videos
09:16Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
Published on: March 14, 2018
08:40Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019