[Comparative study of the application of a diagnostic test in postgraduate education, using 2 formats: computerized...

A diagnostic test was applied at the National Autonomous University of Mexico School of Medicine using a two-part format with 42 clinical cases and 210 multiple-choice items. Residents were randomized into two groups: group A (printed test) and group B (computerized test). Academic performance was measured by determination of media, standard deviation, and correct-answer score; the exam was measured by reliability, difficulty index, and discrimination index and question/item assessment were calculated for item analysis. Residents answered a survey questionnaire and time taken to answer was controlled. Results showed that the printed test had higher achievement; there was better reliability for computerized format, and resident opinion was more favorable toward computer use. The two parts of the test were analyzed and results were produced for the first part of the test; in part two, results were very similar. We conclude that lack of experience in computer use could be a determining factor in our results.