Related Experiment Video
Updated: Aug 19, 2026

Measuring the Functional Abilities of Children Aged 3-6 Years Old with Observational Methods and Computer Tools
Published on: June 20, 2020
Development, implementation and evaluation of an evidence-based paediatric early warning system improvement
Davina Allen1, Amy Lloyd2, Dawn Edwards3
1School of Healthcare Sciences, Cardiff University, Room 13.08, Eastgate House, Newport Road, Cardiff, CF24 0AB, UK. allenda@cardiff.ac.uk.
Insights
Implementing a paediatric early warning system (PUMA Programme) improved clinical outcomes in UK hospitals. Further research into rare event metrics is needed to enhance paediatric patient safety.
Area of Science:
- Healthcare Improvement
- Paediatric Patient Safety
- Clinical Systems Analysis
Background:
- United Kingdom paediatric mortality rates are high, with clinically missed deterioration as a contributing factor.
- A systems approach is needed to address this complex issue, as single interventions have limited evidence.
- Existing research underscores the necessity of integrated strategies for improving paediatric care.
Purpose of the Study:
- To develop and implement an evidence-based paediatric early warning system improvement programme (PUMA Programme) in UK hospitals.
- To evaluate the impact of the PUMA Programme on clinical outcomes using quantitative and qualitative methods.
- To assess the feasibility and effectiveness of contextually tailored system changes in improving paediatric patient safety.
Main Methods:
- The PUMA Programme was implemented in four UK hospitals (general and tertiary) using a propositional model, assessment tools, and structured facilitation.
- Interrupted time series analysis and qualitative case studies were employed for evaluation.
- A composite metric of adverse events (mortality, arrests, unplanned ICU/Higher Dependency Unit admissions) was the primary outcome measure.
Main Results:
- All participating hospitals identified areas for improvement and implemented contextually appropriate system changes.
- Three sites showed a decline in the adverse event rate trend.
- One site with strong organizational support for system-wide changes demonstrated a significant decline in adverse events (ß = -0.09, p < 0.001).
Conclusions:
- System-level improvements in paediatric early warning systems can positively impact clinical outcomes.
- The study highlights the need for alternative outcome measures and methodological advancements for rare events in paediatric research and quality improvement.
- Investment in novel metrics and methodologies can further enhance the potential of programmes like PUMA to reduce paediatric mortality and morbidity.
Background:
Paediatric mortality rates in the United Kingdom are amongst the highest in Europe. Clinically missed deterioration is a contributory factor. Evidence to support any single intervention to address this problem is limited, but a cumulative body of research highlights the need for a systems approach.
Methods:
An evidence-based, theoretically informed, paediatric early warning system improvement programme (PUMA Programme) was developed and implemented in two general hospitals (no onsite Paediatric Intensive Care Unit) and two tertiary hospitals (with onsite Paediatric Intensive Care Unit) in the United Kingdom. Designed to harness local expertise to implement contextually appropriate improvement initiatives, the PUMA Programme includes a propositional model of a paediatric early warning system, system assessment tools, guidance to support improvement initiatives and structured facilitation and support. Each hospital was evaluated using interrupted time series and qualitative case studies. The primary quantitative outcome was a composite metric (adverse events), representing the number of children monthly that experienced one of the following: mortality, cardiac arrest, respiratory arrest, unplanned admission to Paediatric Intensive Care Unit, or unplanned admission to Higher Dependency Unit. System changes were assessed qualitatively through observations of clinical practice and interviews with staff and parents. A qualitative evaluation of implementation processes was undertaken.
Results:
All sites assessed their paediatric early warning systems and identified areas for improvement. All made contextually appropriate system changes, despite implementation challenges. There was a decline in the adverse event rate trend in three sites; in one site where system wide changes were organisationally supported, the decline was significant (ß = -0.09 (95% CI: - 0.15, - 0.05); p = < 0.001). Changes in trends coincided with implementation of site-specific changes.
Conclusions:
System level change to improve paediatric early warning systems can bring about positive impacts on clinical outcomes, but in paediatric practice, where the patient population is smaller and clinical outcomes event rates are low, alternative outcome measures are required to support research and quality improvement beyond large specialist centres, and methodological work on rare events is indicated. With investment in the development of alternative outcome measures and methodologies, programmes like PUMA could improve mortality and morbidity in paediatrics and other patient populations.
More Related Videos
07:31Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
06:16Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
Related Concept Videos
Methods of Documentation II: POMR
Methods of Documentation III: PIE