Related Experiment Video
Updated: Aug 30, 2026

Protocol and Guidelines for Point-of-Care Lung Ultrasound in Diagnosing Neonatal Pulmonary Diseases Based on International Expert Consensus
Published on: March 6, 2019
Hindsight judgement on ambiguous episodes of suspected infection in critically ill children: poor consensus amongst
Joachim E Fischer1, Federico G Seifarth, Oskar Baenziger
1Department of Neonatology and Paediatric Intensive Care, University Children's Hospital, Steinwiesstrasse 75, 8032 Zurich, Switzerland. joachim.fischer@kispi.unizh.ch
Unlabelled:
Few episodes of suspected infection observed in paediatric intensive care are classifiable without ambiguity by a priori defined criteria. Most require additional expert judgement. Recently, we observed a high variability in antibiotic prescription rates, not explained by the patients' clinical data or underlying diseases. We hypothesised that the disagreement of experts in adjudication of episodes of suspected infection could be one of the potential causes for this variability. During a 5-month period, we included all patients of a 19-bed multidisciplinary, tertiary, neonatal and paediatric intensive care unit, in whom infection was clinically suspected and antibiotics were prescribed ( n=183). Three experts (two senior ICU physicians and a specialist in infectious diseases) were provided with all patient data, laboratory and microbiological findings. All experts classified episodes according to a priori defined criteria into: proven sepsis, probable sepsis (negative cultures), localised infection and no infection. Episodes of proven viral infection and incomplete data sets were excluded. Of the remaining 167 episodes, 48 were classifiable by a priori criteria ( n=28 proven sepsis, n= 20 no infection). The three experts only achieved limited agreement beyond chance in the remaining 119 episodes (kappa = 0.32, and kappa = 0.19 amongst the ICU physicians). The kappa is a measure of the degree of agreement beyond what would be expected by chance alone, with 0 indicating the chance result and 1 indicating perfect agreement.
Conclusion:
agreement of specialists in hindsight adjudication of episodes of suspected infection is of questionable reliability.
Insights
Expert agreement on suspected infections in pediatric intensive care is unreliable. This variability may explain inconsistent antibiotic prescribing, highlighting a need for clearer diagnostic criteria in critical care settings.
Area of Science:
- Pediatric Critical Care Medicine
- Infectious Diseases
- Clinical Epidemiology
Background:
- Diagnosing suspected infections in pediatric intensive care units (PICU) often lacks clear criteria, necessitating expert judgment.
- Observed variability in antibiotic prescription rates in PICU is not fully explained by patient clinical data or comorbidities.
- Expert disagreement in classifying suspected infection episodes may contribute to antibiotic prescribing variability.
Purpose of the Study:
- To investigate the reliability of expert agreement in classifying suspected infection episodes in a PICU setting.
- To assess the impact of expert disagreement on antibiotic prescribing variability.
Main Methods:
- A 5-month prospective study included 183 patients with suspected infections and antibiotic prescriptions in a tertiary neonatal and pediatric ICU.
- Three experts (two ICU physicians, one infectious disease specialist) independently classified infection episodes using predefined criteria.
- Inter-rater reliability was assessed using Cohen's kappa statistic for 167 eligible episodes.
Main Results:
- Only 48 out of 167 episodes (28.7%) were unambiguously classifiable by a priori criteria.
- Limited agreement beyond chance was observed among the three experts (kappa = 0.32).
- Agreement between the two ICU physicians was even lower (kappa = 0.19).
Conclusions:
- The reliability of specialist agreement in retrospectively adjudicating suspected infection episodes in PICU is questionable.
- Significant inter-expert variability in classifying infections may contribute to inconsistent antibiotic use in critically ill children.
Related Concept Videos
Pneumonia III: Complications and Assessment
Healthcare Associated Infections II: Preventive Measures
The best practices for preventing healthcare-associated infections include hand hygiene, patient risk...
Acute Kidney Injury IV: Diagnostic Studies and Prevention