A text input system developed by using lips image recognition based LabVIEW for the seriously disabled

Area of Science:

• Biomedical Engineering
• Human-Computer Interaction
• Computer Vision

Background:

• Individuals with severe disabilities often face significant communication barriers.
• Existing assistive technologies may not fully address the needs of all disabled individuals.
• Lip movement analysis offers a potential non-invasive method for communication control.

Purpose of the Study:

• To develop and implement a text input system for the seriously disabled.
• To utilize lip image recognition for mouth-open and mouth-closed status detection.
• To integrate this system with a Morse-code text input mechanism for enhanced communication.

Main Methods:

• The system employs image processing techniques within LabVIEW to analyze the relative distance between upper and lower lips.
• A software subsystem identifies mouth-open or mouth-closed states.
• A hardware subsystem uses the PC's parallel port to transmit recognized mouth status to a Morse-code text input system.

Main Results:

• A functional text input system was successfully implemented by integrating the software and hardware subsystems.
• The system accurately recognizes mouth status (open/closed) using lip image analysis.
• The integrated system enables text input for users based on lip movements.

Conclusions:

• The developed lip image recognition system provides a viable text input method for the seriously disabled.
• This technology has the potential to significantly improve communication accessibility for individuals with severe disabilities.
• Further development could expand the application of this system in assistive technology.