Using Performance Improvement Methods to Evaluate Processes for Writing Multiple-Choice Test Questions in the...

Area of Science:

• Educational Assessment
• Health Professions Education

Background:

• This article concludes a four-part series on creating and evaluating multiple-choice test items for post-licensure education.
• Previous installments covered the challenges and methods of test item development.

Purpose of the Study:

• To provide a replicable strategy for evaluating the organizational process of multiple-choice test question construction.
• To guide educators in developing and assessing test items effectively.

Main Methods:

• Described steps for implementing change in test item construction processes.
• Provided work tools to support the evaluation strategy.

Main Results:

• Educators require training in multiple-choice item construction, with many lacking prior instruction.
• Personalized mentorship significantly improved item construction skills.
• Asynchronous learning improved self-perceived knowledge but did not lead to competence.

Conclusions:

• Voluntary training alone is insufficient to ensure best practices without accountability and monitoring.
• Further research is needed to establish national standards for item construction in healthcare organizations.