Projection Mapping User Interface for Disabled People.

Area of Science:

• Human-Computer Interaction
• Assistive Technology
• Augmented Reality

Background:

• Communication barriers significantly impact individuals with severe motor and speech disabilities.
• Assistive technologies are crucial for enabling interaction with the environment for this population.

Purpose of the Study:

• To present a multifunctional user interface designed to improve communication efficiency and personal independence.
• To explore the use of projection mapping for natural augmented reality information presentation.

Main Methods:

• Development of a camera-projector system integrating a depth sensor and a projector.
• Detailed calibration procedure for the camera-projector system.
• Implementation of tabletop object detection and automatic projection mapping.
• Integration of multiple user input modalities.

Main Results:

• The system successfully performs object detection and projection mapping.
• The user interface is adaptable to diverse user needs and disabilities.
• Demonstrated potential for natural augmented reality information presentation.

Conclusions:

• The developed multifunctional user interface offers a promising solution for enhancing communication and independence.
• Projection mapping technology integrated with a camera-projector system provides an effective augmented reality approach.
• The system's adaptability makes it a valuable tool for individuals with various disabilities.