Investigating the Road to Equity: A Scoping Review of Solutions to Mitigate Implicit Bias in Assessment within...

In medical education, assessments have high-stakes implications. Yet, assessments are rife with unconscious bias, which contributes to inequitable social structures. Implicit bias in assessment must be addressed because medical educators use assessments to guide learning and promote development of physicians' careers. In this scoping review, the authors map the literature on implicit bias in assessment, as it applies to: 1) the types of implicit bias addressed, 2) the targets and types of interventions studied or proposed, and 3) how publications describe intervention efficacy.

The authors conducted a scoping review of the literature on interventions to mitigate implicit bias that was published between January 2010 and August 2023. Author pairs independently screened articles for inclusion and extracted data. Discrepancies were resolved with discussion and consensus. Qualitative and quantitative analysis was informed by Anderson et al's three assessment orientations: fairness, assessment for inclusion (AfI), and justice.

7,831 articles were identified; 54 articles were included. The majority (n = 37; 69%) of articles focus on implicit bias toward those underrepresented in medicine. Interventions to mitigate implicit bias were targeted toward admissions and applications, faculty training, recruitment, summative assessments, and evaluation templates. Interventions had fairness (n = 43; 96%) and AfI (n = 22; 49%) orientations; no articles used a justice-orientation. For the sub-set of research studies (n = 40), almost all (n = 34; 85%) examined a single program/institution.

This scoping review showed that more work is necessary to address different types of implicit biases, move scholarship beyond single-institution studies, refine existing interventions, and evaluate how efficacy is defined.