MCQ tests in Advanced Trauma Life Support (ATLS©): Development and revision
Related Experiment Video
Updated: Mar 28, 2026

Setup and Execution Of the Blindfolded Code Training Exercise
Published on: March 29, 2019
Jacqueline Bustraan1, Walter Henny2, John B Kortbeek3
1PLATO, Leiden University, P.O. Box 9555, 2300 RB Leiden, The Netherlands.
Background:
In Advanced Trauma Life Support (ATLS©) courses, multiple choice question (MCQ) tests are used to assess student's post course knowledge. As part of the ninth Edition Revision Process, existing MCQ tests were reviewed and revised by an International MCQ Revision group. The aim of this study was to evaluate the revision procedure and its effects.
Methods:
Based on psychometric data and evidence based guidelines for adequate MCQ item and test development, a detailed stepwise approach was determined and followed to evaluate the existing MCQs, and to guide test item revision or replacement.
Results:
The MCQ Revision group composed three new draft test versions comprising of 40 MCQs each. These were beta-tested among ATLS Instructors in various countries involved in ATLS. Psychometric analysis demonstrated that a minority of MCQ items required revision to create three equally balanced tests. After these final adjustments, a new set of three validated MCQ tests was available for use in 9th edition ATLS provider courses. Beta testing was performed using instructors but not students. The failure rate amongst students of ATLS provider courses increased significantly after introduction of the new MCQ tests.
Conclusion:
ATLS tests were revised and updated using current evidence based guidelines and psychometric analysis. Difficulty of the tests was not initially beta-tested on students. Increasing test item discrimination and quality resulted in lower test scores by students.
More Related Videos
Related Concept Videos
Cardiopulmonary Resuscitation IV: Pharmacological Management
Cardiopulmonary Resuscitation II: ACLS Airway Management
Cardiopulmonary Resuscitation I: Adult
Cardiopulmonary Resuscitation III: AED Use
Cardiopulmonary Resuscitation V: Advanced Airway Management Techniques
Acute Coronary Syndrome IV: Interprofessional Care

