Measuring continuing medical education conference impact and attendee experience: a scoping review

The aim was to comprehensively identify published research evaluating continuing medical education conferences, to search for validated tools and perform a content analysis to identify the relevant domains for conference evaluation.

We used scoping review methodology and searched MEDLINE® for relevant English or French literature published between 2008 and 2022 (last search June 3, 2022). Original research (including randomized controlled trials, non-randomized studies, cohort, mixed-methods, qualitative studies, and editorial pieces) where investigators described impact, experience, or motivations related to conference attendance were eligible. Citations were assessed in triplicate, and data extracted in duplicate.

Eighty-three studies were included, 69 (83%) of which were surveys or interview based, with the majority conducted at the end of or following conference conclusion. Of the 74 tools identified, only one was validated and was narrowly focused on a specific conference component. A total of 620 items were extracted and categorized into 4 a priori suggested domains (engagement-networking, education-learning, impact, scholarship), and an additional 4 identified through content analysis (value-satisfaction, logistics, equity-diversity-inclusivity, career influences). Time trends were evident, including the absence of items related to equity-diversity-inclusivity prior to 2019, and a focus on logistics, particularly technology and virtual conferences, since 2020.

This study identified 8 major domains relevant for continuing medical education conference evaluation. This work is of immediate value to individuals and organizations seeking to either design or evaluate a conference and represents a critical step in the development of a standardized tool for conference evaluation.