Development of a Sensing Platform Based on Hands-Free Interfaces for Controlling Electronic Devices

Area of Science:

• Biomedical Engineering
• Human-Computer Interaction
• Rehabilitation Technology

Background:

• Limited mobility significantly impacts independence and device interaction for individuals with disabilities.
• Existing sensing platforms often lack rapid customization for diverse user needs.
• There is a critical need for intuitive, non-invasive interfaces to empower users with impaired mobility.

Purpose of the Study:

• To develop and evaluate a novel sensing platform for hands-free control of electronic devices.
• To increase independence for individuals with mobility impairments through intuitive interaction.
• To assess the efficacy of a multi-modal sensing approach (voice, head, eye movements).

Main Methods:

• A new sensing scheme integrating voice commands, head movements, and eye gestures was developed.
• Non-invasive sensors including a microphone, accelerometer, and infrared oculography were utilized.
• The platform's output unit processed signals for controlling external devices, tested via power wheelchair navigation.

Main Results:

• Participants with severe disabilities achieved high performance using head controls (93.3% and 86.6% for volunteers A and B).
• Voice control yielded lower performance (63.3% and 66.6% for volunteers A and B).
• Head movement interface demonstrated superior effectiveness for most wheelchair navigation skills.

Conclusions:

• The developed sensing platform shows significant potential for enhancing user independence.
• Head movement control is a highly effective modality for power wheelchair navigation among users with severe disabilities.
• The findings provide valuable insights for tailoring hands-free interfaces to specific end-user requirements.