Augmented Reality Feedback for Exoskeleton-Assisted Walking. A Feasibility Study

Powered lower limb exoskeletons have been used in recent decades to support and improve conventional gait rehabilitation programs. In this context, visual feedback is considered a valuable tool to facilitate patient learning and engagement. Treadmill-based lower limb robotic exoskeletons are commonly incorporated with traditional screens or virtual reality (VR) devices. However, these modalities are incompatible with over-ground robotic exoskeletons, in which users should pay attention to multiple elements of the open environment and more complex tasks. Recent advances in augmented reality (AR) technology have unlocked a new way of displaying 3D graphics in untethered wearable devices like Microsoft's Hololens 2 without occluding the rest of the user's field of view. These advances can be crucial in certain situations and position AR as an excellent candidate to improve visual feedback when using robotic exoskeletons. In this work, we present the development of an AR-based audio-visual feedback system that tracks the trunk rotation from an Inertial Measurement Unit (IMU) to aid in walking tasks assisted by a lower limb robotic exoskeleton. A preliminary study was done integrating the H3 robotic exoskeleton with Hololens 2. We observed that displaying posture information is feasible and could help mitigate the unnatural posture often imposed by a robotic exoskeleton.