Towards Translation of Novel Neurorehabilitation Systems: A Practical Approach to Usability Testing

Usability testing is important for the effective translation of neurorehabilitation technologies but is often overlooked and under-reported. The aim of this paper is to present a method of collecting and analyzing usability data, using a think-aloud and semi-structured interview protocol and qualitative analysis techniques. We present a worked case study of this method with a novel neurorehabilitation system that utilizes thought-controlled robotics to partially restore lower-limb function of people with spinal cord injury (SCI). Five male participants (mean age = 32.6 years) with SCI who identified as users of related neurorehabilitation technologies completed the usability study. Video-recorded usability sessions utilized a combination of concurrent and retrospective think-aloud methods as well as semi-structured interviews. Recordings were analyzed to identify verbal and behavioral feedback from participants regarding system performance and acceptability. In total, 538 data points were logged, which were aggregated into 60 usability issues, 44 positive evaluations, and 31 strategies for improvement. The approach undertaken was novel in that we sought to not only capture usability issues but also system elements that were positively evaluated by intended users and strategies for improvement from the perspective of intended users. These observations will be used to inform the further development of the neurorehabilitation system.