Hindsight judgement on ambiguous episodes of suspected infection in critically ill children: poor consensus amongst

Joachim E Fischer1, Federico G Seifarth, Oskar Baenziger

  • 1Department of Neonatology and Paediatric Intensive Care, University Children's Hospital, Steinwiesstrasse 75, 8032 Zurich, Switzerland. joachim.fischer@kispi.unizh.ch

Abstract

Insights

Expert agreement on suspected infections in pediatric intensive care is unreliable. This variability may explain inconsistent antibiotic prescribing, highlighting a need for clearer diagnostic criteria in critical care settings.

Area of Science:

  • Pediatric Critical Care Medicine
  • Infectious Diseases
  • Clinical Epidemiology

Background:

  • Diagnosing suspected infections in pediatric intensive care units (PICU) often lacks clear criteria, necessitating expert judgment.
  • Observed variability in antibiotic prescription rates in PICU is not fully explained by patient clinical data or comorbidities.
  • Expert disagreement in classifying suspected infection episodes may contribute to antibiotic prescribing variability.

Purpose of the Study:

  • To investigate the reliability of expert agreement in classifying suspected infection episodes in a PICU setting.
  • To assess the impact of expert disagreement on antibiotic prescribing variability.

Main Methods:

  • A 5-month prospective study included 183 patients with suspected infections and antibiotic prescriptions in a tertiary neonatal and pediatric ICU.
  • Three experts (two ICU physicians, one infectious disease specialist) independently classified infection episodes using predefined criteria.
  • Inter-rater reliability was assessed using Cohen's kappa statistic for 167 eligible episodes.

Main Results:

  • Only 48 out of 167 episodes (28.7%) were unambiguously classifiable by a priori criteria.
  • Limited agreement beyond chance was observed among the three experts (kappa = 0.32).
  • Agreement between the two ICU physicians was even lower (kappa = 0.19).

Conclusions:

  • The reliability of specialist agreement in retrospectively adjudicating suspected infection episodes in PICU is questionable.
  • Significant inter-expert variability in classifying infections may contribute to inconsistent antibiotic use in critically ill children.