Emergency, Pictogram-Based Augmented Reality Medical Communicator Prototype Using Precise Eye-Tracking Technology

Area of Science:

• Biomedical Engineering
• Assistive Technology
• Human-Computer Interaction

Background:

• Effective communication is vital for medical care, yet many patients face barriers due to health issues or language differences.
• Existing communication aids often have limitations in accuracy and accessibility for diverse patient populations.
• Individuals with communication disorders, brain injuries, or hearing loss require advanced solutions for daily interaction and medical needs.

Purpose of the Study:

• To develop and present a novel solution for medical communication utilizing advanced tracking and interface technologies.
• To address the communication challenges faced by patients with speech, movement, or language impairments.
• To enhance the quality of life and healthcare outcomes for individuals with various communication disabilities.

Main Methods:

• Development of a system for precise head and eye movement tracking.
• Implementation of an intuitive pictogram-based interface for user interaction.
• Integration of augmented reality (AR) and a secondary camera to enhance tracking accuracy.

Main Results:

• The developed solution accurately tracks user's head and eye movements for seamless interaction.
• The pictogram interface ensures ease of use for diverse users, including children and non-native speakers.
• Augmented reality and secondary camera significantly improve the precision of eye-tracking functionality.

Conclusions:

• The proposed solution offers a practical and accurate method for medical communication, reducing errors compared to traditional devices.
• This technology has significant potential to improve patient engagement, medical care accuracy, and overall quality of life.
• Applications range from enhanced family communication to critical emergency medical interventions, demonstrating broad utility.