Related Experiment Video
Updated: Nov 25, 2025

07:30
Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum
Published on: March 21, 2019
8.2K
Performance Analysis of a Head and Eye Motion-Based Control Interface for Assistive Robots
Sarah Stalljann1, Lukas Wöhle1, Jeroen Schäfer1
1Group of Sensors and Actuators, Department of Electrical Engineering and Applied Physics, Westphalian University of Applied Sciences, 45877 Gelsenkirchen, Germany.
Sensors (Basel, Switzerland)
|December 17, 2020
Summary
This study introduces a novel hands-free robot control system using head and eye movements for individuals with limited mobility. The multimodal system shows promise for assistive tasks, particularly for users with tetraplegia.
Area of Science:
- Robotics
- Human-Computer Interaction
- Rehabilitation Engineering
Background:
- Assistive robots aid individuals with limited mobility, but many require residual arm/hand function.
- Hands-free control systems are crucial for individuals with severe mobility impairments, such as tetraplegia.
- Combining control modalities can enhance user experience and system performance.
Purpose of the Study:
- To develop and evaluate a novel multimodal control system for assistive robots using head and eye motions.
- To assess the performance of head motion (Magnetic Angular Rate Gravity - MARG sensor) and eye tracking for discrete and continuous control tasks.
- To investigate the usability of the system in a practical assistive scenario, such as supporting a drinking action.
Main Methods:
- A low-cost, compact multimodal sensor system combining a MARG sensor for head motion and an eye tracker for gaze detection was developed.
- Experimental evaluation included discrete button activation and 2D continuous cursor control (Fitts's Law task) with ten able-bodied subjects.
- A usability study was conducted with a collaborative robot assisting a drinking action, including one subject with tetraplegia.
Main Results:
- Able-bodied subjects showed no significant difference in activation time or throughput between head and eye motion control.
- Eye tracking resulted in a significantly higher error rate in the Fitts's Law task for able-bodied users.
- The subject with tetraplegia performed better with eye tracking for button activation and successfully used the system for the drinking task.
Conclusions:
- The developed head and eye motion control system is a viable hands-free solution for assistive robots.
- The system demonstrates potential for individuals with severe mobility impairments, including tetraplegia.
- Further research with a larger cohort of individuals with tetraplegia is recommended to validate these findings.
Keywords:
Fitts’ LawMARGassistive technologycursor controleye trackermotion sensorsrobot controltetraplegia
