Facial Position and Expression-Based Human-Computer Interface for Persons With Tetraplegia.

Area of Science:

• Human-Computer Interaction
• Assistive Technology
• Computer Vision

Background:

• Individuals with tetraplegia face significant challenges in using standard computer interfaces.
• Existing assistive technologies often have limitations related to environmental factors like lighting.
• There is a need for robust and intuitive computer control methods for users with severe motor impairments.

Purpose of the Study:

• To develop and evaluate a novel human-computer interface for individuals with tetraplegia.
• To enable cursor control and navigation using facial movements detected by a monocular infrared depth camera.
• To improve user experience and system performance compared to existing assistive solutions.

Main Methods:

• The system, termed Facial position and expression Mouse (FM), utilizes a monocular infrared depth camera.
• An improved Randomized Decision Tree algorithm detects nose position and mouth status for cursor control.
• Nose motion is mapped to cursor motion using a nonlinear function for enhanced user comfort.
• The system's independence from illumination and color variations is a key feature.

Main Results:

• The proposed algorithm accurately and efficiently detects facial information.
• The infrared depth camera ensures reliable performance across different lighting conditions.
• Experimental results demonstrate superior performance over current assistive technologies in both quantitative and qualitative assessments.
• User experience is enhanced through intuitive and comfortable cursor control.

Conclusions:

• The developed Facial position and expression Mouse (FM) system offers a viable and effective solution for computer access for individuals with tetraplegia.
• The use of an infrared depth camera and an improved Randomized Decision Tree provides a robust and adaptable interface.
• This technology represents a significant advancement in assistive technology, improving digital inclusion for users with severe motor disabilities.