Inter-rater reliability of video clips to assess for obstructive sleep apnea in children

S L Katz1, H Blinder2, N Dussah2

  • 1Children's Hospital of Eastern Ontario, Division of Pediatric Respirology, Department of Pediatrics, Ottawa, Ontario, Canada; Children's Hospital of Eastern Ontario Research Institute, Ottawa, Ontario, Canada; Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada.

Sleep Medicine
|April 6, 2025
PubMed

Insights

Video recordings show high reliability for screening pediatric obstructive sleep apnea (OSA). This method could offer a more accessible alternative to polysomnography for diagnosing this common childhood sleep disorder.

Area of Science:

  • Pediatric Sleep Medicine
  • Diagnostic Technologies

Background:

  • Pediatric obstructive sleep apnea (OSA) is linked to significant neurocognitive and cardiovascular issues.
  • Current diagnostic methods like polysomnography are resource-intensive, leading to diagnostic delays.
  • There is a critical need for efficient screening tools for pediatric OSA.

Purpose of the Study:

  • To evaluate the reliability and predictive accuracy of video recordings for screening pediatric obstructive sleep apnea (OSA).
  • To assess the performance of the Monash score using video data in a pediatric population.

Main Methods:

  • A cross-sectional study involving 109 children (3-18 years) suspected of having OSA.
  • Parents recorded 3-minute sleeping videos of their children.
  • Two blinded pediatric sleep physicians assessed videos using clinical impressions and the Monash score, with inter-rater reliability assessed via Cohen's Kappa and predictive accuracy via ROC analysis.

Main Results:

  • High inter-rater reliability was observed for both the Monash score (kappa 0.94) and clinician impression (kappa 0.84) of OSA presence and severity.
  • The Monash score demonstrated excellent ability to discriminate OSA presence (AUC 0.99).
  • Reliability was consistent across healthy children and those with comorbidities like Down syndrome, obesity, and autism.

Conclusions:

  • Video-based assessments, particularly using the Monash score, exhibit high inter-rater reliability for pediatric OSA screening.
  • Video recordings show promise as an accessible screening tool for pediatric OSA.
  • Further research is warranted to validate these findings against polysomnography in clinical settings.
Abstract