Usability Evaluation of EzList: A Digital Platform for Surgical Waitlist Management Using Standardized Metrics

This study evaluated the usability of easy-list (EzList), a Brazilian digital platform developed to optimize elective surgical waitlist management.

A summative usability assessment was conducted with ten surgeons and surgical residents, both with and without prior EzList experience, following IEC 62366:2015 and ISO 14971 standards. Participants completed seven representative clinical tasks. Usability was measured using the system usability scale (SUS) and the single usability metric (SUM), integrating scores for task completion, errors, task time, and satisfaction. Additional metrics included completion rate, error rate, time-based efficiency (TBE), assistance rate, learning rate, and workflow adherence. Observed use errors were classified by severity using a risk matrix based on ISO 14971:2019 combined with NISTIR 7804 severity levels, assessed independently by two clinical evaluators.

The SUM score was 70.8%, reflecting high task completion (95.7%) and satisfaction, but lower efficiency. The mean SUS score was 82.92 (SD = 15.92), indicating good to excellent perceived usability. The error rate averaged 27.9%, mainly related to comprehension and redundant steps, with tasks 2 and 6 requiring more time and assistance. TBE was 1.47%, slightly below the 1.78% benchmark. Learning curves varied, with a mean improvement of 16.3%. Posttask satisfaction was high; external assistance was needed in 14.3% of tasks.

The digital platform demonstrated adequate overall usability for its intended clinical context, with strong task completion and positive user perception. However, moderate error rates and efficiency gaps indicate specific areas requiring interface refinement before broader deployment. Variability in learning suggests the need for a more intuitive design to facilitate broader clinical adoption.