Related Experiment Videos
Introduction of patient video clips into computer-based testing: effects on item statistics and reliability estimates
Steven A Lieberman1, Ann W Frye, Stephanie D Litwins
1steven.lieberman@utmb.edu
Purpose:
Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown.
Method:
We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship.
Results:
Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions.
Conclusions:
The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.