A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia

Area of Science:

• Robotics
• Neuroscience
• Rehabilitation Engineering

Background:

• Tetraplegia severely impacts independence in daily activities.
• Existing assistive robotic manipulators (ARMs) often require hand-based controls, limiting their use for individuals with severe impairments.
• Restoring functional independence is crucial for improving quality of life.

Purpose of the Study:

• To create and validate a hands-free multimodal input system for controlling an ARM in virtual reality.
• To enable individuals with tetraplegia to perform essential daily tasks independently.
• To explore user preferences for input modalities to maximize control system utility.

Main Methods:

• Developed a multimodal input system integrating gyroscope, eye-tracking, and surface electromyography (sEMG).
• Mapped input modalities to ARM functions based on user preferences and residual capabilities.
• Validated the system in a virtual reality environment with participants with tetraplegia and non-disabled participants.

Main Results:

• Participants with tetraplegia preferred sEMG button functions over winking commands.
• Non-disabled participants showed varied preferences, highlighting the system's customizability.
• Replacing traditional buttons with sEMG did not significantly decrease performance.
• The system enabled completion of functional tasks like opening doors, operating dials, and eating/drinking.

Conclusions:

• The hands-free multimodal input system effectively restores independence for individuals with tetraplegia.
• Customizable control mapping is advantageous for diverse user needs.
• This technology holds significant potential for improving quality of life through enhanced autonomy.