User-Centered Formative Evaluation of Cognitive Rehabilitation Software: Cognitive Walkthrough and System Usability...

Area of Science:

• Human-Computer Interaction
• Medical Device Software
• Digital Health

Background:

• Usability of medical device software is crucial for patient safety and treatment effectiveness.
• Poor usability in cognitive rehabilitation software can lead to errors, cognitive overload, and reduced therapeutic outcomes.
• Few studies have systematically evaluated cognitive rehabilitation software usability using human factors methods.

Purpose of the Study:

• To conduct a formative evaluation of tablet-based cognitive rehabilitation software.
• To identify potential user errors and interface design issues.
• To find opportunities for improving user experience and user interface (UI).

Main Methods:

• Employed the IEC 62366-1 framework for usability engineering.
• Utilized cognitive walkthrough (CW) for expert evaluation of use-related problems.
• Administered the System Usability Scale (SUS) for quantitative usability assessment with 5 occupational therapists.

Main Results:

• Identified 14 usability issues across 6 task scenarios, including button location and feedback.
• Key improvement areas: keypad layout, task progress visibility, and help content accessibility.
• Achieved a mean SUS score of 73.5 (acceptable usability, grade B-), with lower scores for system complexity.

Conclusions:

• Combined CW and SUS effectively identified usability challenges in cognitive rehabilitation software.
• Emphasized user-centered design and formative evaluation for safer, more effective digital interventions.
• Highlighted the practical application of IEC 62366-1 for iterative UI improvements in cognitive rehabilitation.