A Novel Hospital-to-Home System for Children With Medical Complexities: Usability Testing Study

Children with medical complexity (CMC) are a group of young people who have severe complex chronic conditions, substantial family-identified service needs, functional limitations, and high health care resource use. Technology-enabled hospital-to-home interventions designed to deliver comprehensive care in the home setting are needed to ease CMC family stress, provide proactive and comprehensive care to this fragile population, and avoid hospital admissions, where possible.

In this usability testing study, we aimed to assess areas of strength and opportunity within the DigiComp Kids system, a hospital-to-home intervention for CMC and their families and care providers.

Hospital-based clinicians, family members of medically complex children, and home-based clinicians participated in DigiComp Kids usability testing. Participants were recorded and tasked to think aloud while completing usability testing tasks. Participants were scored on the metrics of effectiveness, efficiency, and satisfaction, and the total usability score was calculated using the Single Usability Metric. Participants also provided insights into user experiences during the postusability testing interviews.

A total of 15 participants (5 hospital-based clinicians, 6 family members, and 4 home-based clinicians) participated in DigiComp Kids usability testing. The participants were able to complete all assigned tasks independently. Error-free rates for tasks ranged from 58% to 100%; the average satisfaction rating across groups was ≥80%, as measured by the Single Ease Question. Task times of participants were variable compared with the task times of an expert DigiComp Kids user. Single Usability Metric scores ranged from 80.5% to 89.5%. In qualitative interviews, participants stressed the need to find the right fit between user needs and the effort required to use the system. Interviews also revealed that the value of the DigiComp Kids system was in its ability to create a digital bridge between hospital and home, enabling participants to foster and maintain connections across boundaries.

Usability testing revealed strong scores across the groups. Insights gained include the importance of tailoring the implementation of the system to match individual user needs, streamlining key system features, and consideration of the meaning attached to system use by participants to allow for insight into system adoption and sustainment.