Related Experiment Video
Updated: May 24, 2026
Setup and Execution of the Rapid Cycle Deliberate Practice Death Notification Curriculum
Published on: August 5, 2020
Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi
Abel Wakai1, Ronan O'Sullivan, Paul Staunton
1Emergency Care Research Unit, Division of Population Health Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland. awakai@rcsi.ie
Objective:
The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs).
Methods:
The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0.
Results:
The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7).
Conclusion:
Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.
Related Concept Videos
01:21Methods of Documentation III: PIE
01:30Methods of Documentation VII: EMR
01:30Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
01:27Nursing Clinical Information System
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
01:11Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care evaluation by...
01:15Methods of Documentation VI: Case Management Model
For example, a patient with a chronic illness...