Related Experiment Video
Updated: May 22, 2026
SECONDs Administration Guidelines: A Fast Tool to Assess Consciousness in Brain-injured Patients
Published on: February 6, 2021
A Modified Delphi Consensus-Based Comprehensive Checklist and Angoff Standard for Assessment of Competency in Brain
Daniel S Harrison1,2, Neil Dhruva1, Jenna L Ford3
1Department of Neurology, Boston Medical Center, Boston, MA.
Objectives:
To develop a comprehensive checklist, define critical actions, and establish a minimal passing standard for adult and pediatric critical care clinicians as well as other clinicians to facilitate formative and summative assessment of brain death/death by neurologic criteria (BD/DNC) determination.
Design:
A prespecified three-round modified Delphi consensus process to define checklist items followed by a modified Angoff standard setting process to determine critical actions and item average ratings.
Setting:
Electronic surveys.
Subjects:
Selected authors of the 2023 Pediatric and Adult BD/DNC Consensus Practice Guideline, World Brain Death Project, and experts recommended by these authors ( n = 16) participated in the Delphi panel. Neurocritical Care United Council for Neurologic Subspecialties and Accreditation Council for Graduate Medical Education examination committee members ( n = 13) participated in Angoff standard setting.
Interventions:
None.
Measurements And Main Results:
A total of 98 unique checklist items related to assessment of prerequisites (23 items), performance of the clinical examination (28 items), apnea testing (36 items), and ancillary testing (11 items) were retained by the Delphi panel. Seven items were designated as critical actions based upon Angoff panelist consensus. The remaining 91 items were assigned item average ratings. The minimum passing score for an assessment including all noncritical items was set at 89%.
Conclusions:
These guideline-concordant consensus checklist items, including critical actions and noncritical actions with their assigned item average ratings, may be applied selectively to simulated cases of BD/DNC determination for adults and children to determine a minimum passing score and readiness for independent practice, mitigating the risk of inaccurate BD/DNC determination among critical care clinicians. Our process for systematically defining critical actions on a behavior checklist may be replicated for simulation-based summative assessment of learners in other critical care scenarios.
