Related Experiment Video
Updated: Jul 9, 2026
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Towards responsible digital health implementation: A mixed-methods exploratory study developing a tool to assess
Bazuin Tom1,2, Michiel Sebastiaan Oerbekke2,3, Pauline Heus2,3
1Department of Surgery, University of Groningen, University Medical Centre Groningen, Groningen, The Netherlands.
Background:
Digital health technologies (DHTs) are increasingly implemented to improve efficiency, quality, and patient experience. However, conditions that could influence the impact on well-being of healthcare professionals (HCPs) are rarely assessed.
Objective:
To develop a tool to support policymakers, hospital administrators, and implementation teams in considering workforce experience and well-being implications of DHTs on HCPs.
Methods:
A mixed-methods study was conducted in three Dutch university medical centres. First, we re-analysed a scoping review on DHT-implementation, applying criteria focusing on HCP-related determinants and thematically analysing these within a modified Work-System model and Quintuple Aim framework. Second, we conducted a prioritisation survey using the Reweighted Priority-Setting tool to rank themes related to Care-team well-being, one of the Quintuple Aim domains. Third, we explored the highest-ranked themes in focus-groups and interviews with HCPs and stakeholders. Finally, we synthesised findings into a tool.
Results:
From 73 eligible studies we extracted determinants, generating themes and subthemes, of which 44 mapped to Care-team well-being, and were used as survey items. Twelve respondents (eight HCPs and four policy-staff) prioritised these. Top-ranked themes included perceived benefits, acceptance, involvement in development and implementation, 'champions', training and skills, communication, and role clarity. Analysis of two focus-groups and three interviews yielded six domains: acceptance, champions, process and development, role of the professional, communication, and training. These informed a 14-item checklist for use during DHT-implementation.
Conclusion:
We developed a reflective checklist to support structured consideration of conditions shaping workforce experience in DHT-implementation. The tool offers a starting point for embedding workforce conditions in DHT-governance.
