Application of computerized adaptive testing in medical education

Area of Science:

• Medical Education
• Psychometrics
• Educational Technology

Background:

• Computerized adaptive testing (CAT) is not widely used in high-stakes or school-based medical examinations.
• Pilot studies and specific university implementations (Belgium, Hallym University) show initial applications.
• CAT is used in high-stakes international examinations like the Medical Council of Canada Qualifying Examination and the US NCLEX-RN.

Purpose of the Study:

• To review the current application and potential of CAT in medical education.
• To highlight the benefits and challenges of implementing CAT in medical assessments.
• To advocate for preparation for the future integration of CAT in medical licensing exams.

Main Methods:

• Literature review of CAT applications in medical education.
• Analysis of existing case studies and high-stakes examination examples.
• Discussion of theoretical underpinnings (Item Response Theory) and technological requirements.

Main Results:

• CAT offers accurate estimation of examinee ability and reduced examination time.
• Current adoption in medical education is limited but present in specific contexts.
• Successful implementation in high-stakes international nursing and medical licensing exams exists.

Conclusions:

• CAT presents significant advantages for medical education assessment.
• Increased medical teacher interest in psychometric theories and technology is crucial for CAT adoption.
• Proactive preparation is needed for the future widespread use of CAT in medical licensing examinations.