Use of Sociodemographic Information in Clinical Vignettes of Multiple-Choice Questions for Preclinical Medical...

This paper aims to characterize the use of demographic data in multiple-choice questions from a commercial preclinical question bank and determine if there is appropriate use of different distractors.

Multiple-choice questions for medical students often include vignettes describing a patient's presentation to help guide students to a diagnosis, but overall patterns of usage between different types of nonmedical patient information in question stems have yet to be determined.

Three hundred eighty of 453 randomly selected questions were included for analysis after determining they contained a clinical vignette and required a diagnosis. The vignettes and following explanations were then examined for the presence/absence of 11 types of demographic information, including age, sex/gender, and socioeconomic status. We compared both the usage frequency and relevance between the 11 information types.

Most information types were present in less than 10% of clinical vignettes, but age and sex/gender were present in over 95% of question stems. Over 50% of questions included irrelevant information about age and sex/gender, but 75% of questions did not include any irrelevant information of other types. Patient weight and environmental exposures were significantly more likely to be relevant than age or sex/gender.

Students using the questions in this study will frequently gain practice incorporating age and sex/gender into their clinical reasoning while receiving little exposure to other demographic information. Based on our findings, we posit that questions could include more irrelevant information, outside age and sex/gender, to better approximate real clinical scenarios and ensure students do not overvalue certain demographic data.

The online version contains supplementary material available at 10.1007/s40670-023-01778-z.