Early Lessons From Implementation of Holistic Review for Pediatric Surgery Fellowship Applicants

Holistic review (HR) considers applicants' unique identities and experiences rather than focusing on academic metrics. Though several residency programs have demonstrated increases in women and those underrepresented in medicine (URiM), this is the first study to examine HR in pediatric surgery (PS).

Using a retrospective review of applicants, demographic, academic, and non-academic metrics of traditional review (TR) [2015-2017] were compared to HR [2018-2022]. HR initiatives include expansion of faculty reviewers, implementation of a pre-screening rubric, and greater prioritization of non-academic factors. Chi-squared/Fisher's exact tests, Wilcoxon rank-sum tests, and two sample z-test for proportions were used where appropriate.

For 635 applicants (TR: 268, HR: 367), the proportion offered interviews in the TR and HR cohorts were similar (31.7 vs 36%, p = 0.30). Candidates selected for interview pre- and post-HR most commonly graduated from residency programs affiliated with PS fellowships (56.5 vs 50%, p = 0.65). After HR implementation, no change in proportion of women interviewees (TR: 52.9 vs HR: 54.5%, p = 0.93) was observed. Though URiM residents applying to PS remained consistently low (TR: 14.6 vs HR: 10.9%, p = 0.21), significantly more received interviews with HR (30.8 vs 42.5%, p = 0.001). The median number of peer-review publications per interviewee increased (17 vs 22, p = 0.02) as did non-academic achievements (leadership, service, athletic awards, etc.) per applicant (1.0 vs 1.5, p = 0.104), though the latter did not reach significance, demonstrating similar qualification of interviewees in HR and TR.

Holistic review of PS fellowship applications increased the proportion of URiM interviewees, despite a persistently low URiM proportion in the applicant pool. Furthermore, implementing HR did not sacrifice the caliber of interviewees, as publications and non-academic achievements increased by over 25% in the HR cohort.

IV.