Related Experiment Video
Updated: Aug 6, 2025
Setup and Execution of the Rapid Cycle Deliberate Practice Death Notification Curriculum
Published on: August 5, 2020
The Debriefing Assessment in Real Time (DART) tool for simulation-based medical education
Kaushik Baliga1, Louis P Halamek2, Sandra Warburton3
1Sydney Medical School, Westmead Hospital, Block K, Level 6, Sydney, NSW, 2145, Australia.
Background:
Debriefing is crucial for enhancing learning following healthcare simulation. Various validated tools have been shown to have contextual value for assessing debriefers. The Debriefing Assessment in Real Time (DART) tool may offer an alternative or additional assessment of conversational dynamics during debriefings.
Methods:
This is a multi-method international study investigating reliability and validity. Enrolled raters (n = 12) were active simulation educators. Following tool training, the raters were asked to score a mixed sample of debriefings. Descriptive statistics are recorded, with coefficient of variation (CV%) and Cronbach's α used to estimate reliability. Raters returned a detailed reflective survey following their contribution. Kane's framework was used to construct validity arguments.
Results:
The 8 debriefings (μ = 15.4 min (SD 2.7)) included 45 interdisciplinary learners at various levels of training. Reliability (mean CV%) for key components was as follows: instructor questions μ = 14.7%, instructor statements μ = 34.1%, and trainee responses μ = 29.0%. Cronbach α ranged from 0.852 to 0.978 across the debriefings. Post-experience responses suggested that DARTs can highlight suboptimal practices including unqualified lecturing by debriefers.
Conclusion:
The DART demonstrated acceptable reliability and may have a limited role in assessment of healthcare simulation debriefing. Inherent complexity and emergent properties of debriefing practice should be accounted for when using this tool.
Related Concept Videos
01:14SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
01:17Assessment of Diffusion and Perfusion
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this...