Related Experiment Video
Updated: May 7, 2026

Non-Invasive Model of Neuropathogenic Escherichia coli Infection in the Neonatal Rat
Published on: October 29, 2014
Unsuccessful validation of 2004 model for predicting academic or behavioural limitations after childhood bacterial
R C J de Jonge1, M S Sanders, C B Terwee
1Department of Paediatric Infectious Diseases - Immunology and Rheumatology, VU University Medical Center, Amsterdam, The Netherlands; Department of Neonatology, Erasmus MC - Sophia Children's Hospital, Rotterdam, The Netherlands. r.c.j.dejonge@erasmusmc.nl.
Insights
A 2004 model predicting academic or behavioral issues in bacterial meningitis (BM) survivors failed external validation. The model is not suitable for clinical practice due to poor discrimination in a new cohort.
Area of Science:
- Pediatric Neurology
- Infectious Diseases
- Clinical Epidemiology
Background:
- A predictive model for academic or behavioral limitations in pediatric bacterial meningitis (BM) survivors was developed in 2004.
- The original model identified risk factors including male gender, low birthweight, and delayed antibiotic treatment.
Purpose of the Study:
- To validate the previously developed prediction model for academic or behavioral limitations in an independent cohort of Dutch school-age BM survivors.
- To assess the model's generalizability and clinical utility in a new patient population.
Main Methods:
- The study included 93 Dutch school-age survivors of bacterial meningitis.
- Risk factors for academic or behavioral limitations were collected from medical records.
- Model validation involved assessing discrimination (Area Under the Curve) and goodness of fit (Hosmer-Lemeshow test).
- Multiple imputation was used to handle missing data.
Main Results:
- The model showed good fit regarding expected versus observed cases (Hosmer-Lemeshow p > 0.05).
- However, model discrimination was poor, with an Area Under the Curve (AUC) of 0.53 in the validation cohort, compared to 0.83 in the development cohort.
- This indicates a significant decrease in the model's predictive accuracy in the independent cohort.
Conclusions:
- The external validation of the bacterial meningitis prediction model was unsuccessful.
- The model's poor performance in the independent cohort suggests it is not suitable for practical implementation in clinical settings.
- Further research may be needed to develop more robust predictive tools for long-term outcomes in pediatric BM survivors.
Aim:
In 2004, a model identifying children at risk of academic or behavioural limitations after bacterial meningitis (BM) was presented. Risk factors were male gender, low birthweight, lower educational level of the father, Streptococcus pneumoniae, lower cerebrospinal fluid (CSF) leucocyte count, delay between admission and start of antibiotics, dexamethasone <2 days, seizures and prolonged fever. The aim of this study was to validate that prediction model in an independent cohort.
Methods:
Academic or behavioural limitations were determined in 93 Dutch school-age BM survivors. Risk factors for limitations were obtained from medical files. Validation was performed by applying the model in the cohort, then assessing discrimination and goodness of fit. Multiple imputation techniques were used to deal with missing values.
Results:
Although fit of the model appeared good when it came to similarity of expected and observed cases (p-value of the Hosmer-Lemeshow test 0.24-0.57), discrimination was poor. Area under the curve (AUC) of the receiver operated characteristics (ROC) curve of the model was 0.83 (95% CI: 0.77-0.89) in the development cohort and 0.53 (95% CI: 0.41-0.65) in the validation cohort.
Conclusion:
External validation of the model was unsuccessful. It is not suitable for implementation in practice.
Related Concept Videos
Bacterial Meningitis I: Introduction
Bacterial Meningitis II: Pathophysiology
Viral Meningitis
