The most used methods for evaluating health information technology systems usability: A scoping review

BackgroundHealth Information Technology (HIT) systems have become integral to today's health care. However, the success of such systems depends much on their usability because poor usability invites more errors and cognitive loads, ultimately affecting healthcare workers' efficiency and well-being.ObjectivesTo identify and summarize the most applied methods of HIT system evaluation, focusing on their impact on work environments and ergonomic practices.MethodsA scoping review of the literature available from January 2000 up to April 2024 was carried out. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist (PRISMA-ScR) was used. Searches were conducted in four databases. Literature was considered for inclusion if it focused on the HIT, provided information related to the usability of these systems, and provided empirical results of the usability testing. It was written in English.ResultsA total of 591 articles were initially retrieved. Manual searches of reference lists added 21 more articles. Ultimately, 48 articles met the inclusion criteria. The most used method for usability testing was the self-response category.ConclusionsWhile qualitative and quantitative methods have been used for usability testing, physiological methods remain underutilized. Eye tracking appeared in only a few studies, and its relationship to usability is still unclear. This study highlights the need to integrate ergonomic principles into HIT system design to enhance usability and support healthcare professional working conditions.