Usability Testing of a Web Tool for Dissemination and Implementation Science Models

Dissemination and Implementation science is dedicated to increasing the speed of evidence-based research translated into practice as guided by one or multiple D&I theories, models, and frameworks. The Dissemination and Implementation Models in Health Research and Practice web tool guides users on how to plan, select, combine, adapt, use, and assess theories, models, and frameworks. This paper describes usability testing to update the web tool. Iterative user testing was conducted with implementation science research and clinical participants to facilitate updates and optimize the functionality of the tool. A multi-step protocol involved quantitative and qualitative data collection including a survey, interviews, and a usability testing session. Data from the pre-testing surveys were summarized as frequencies. Data from the usability testing sessions were analyzed using a hybrid adapted deductive rapid matrix qualitative analysis. Data from the interviews were analyzed by deductive a priori coding. Fifteen interviewees represented different research and clinical groups and levels of expertise utilizing D&I TMFs. Participants were purposively selected to represent a range of disciplines and D&I expertise, all invited via one-time email. The 847 total interview comments were reduced by similarity to 259 comments, and 142 were feasible changes fitting the priorities of the web tool. Changes to content, format, and functionality are described in this paper. The iterative usability testing elicited improvements to the web tool including adding more examples, definitions, visuals, and tutorials and simplifying the written content. The web tool remains flexible for additions concerning health equity, de-implementation, and other issues.

The online version contains supplementary material available at 10.1007/s43477-024-00125-7.