A haptic and auditory assistive user interface: helping the blinds on their computer operations.

Area of Science:

• Human-Computer Interaction
• Assistive Technology
• Usability Engineering

Background:

• Assistive devices often rely on single-modal feedback, potentially limiting user efficiency.
• Multi-modal feedback integrating haptic and auditory information offers a promising avenue for enhancing user interaction.
• Evaluating the impact of different feedback modalities on user performance is crucial for designing effective assistive technologies.

Purpose of the Study:

• To investigate the efficiency of assistive devices employing multi-modal feedback (haptic and auditory) for mouse operations.
• To compare the performance metrics of users interacting with haptic mouse feedback versus audio feedback (directional speech or audio signals).
• To assess user satisfaction, understandability, and comfort with different feedback interfaces.

Main Methods:

• Development of a haptic mouse providing tactile feedback via motor-driven wheels.
• Implementation of audio feedback systems, including synthesized directional speech and audio signals.
• Conducting experiments to measure task completion time, pointing accuracy (distance to target), and user subjective feedback.

Main Results:

• The study demonstrated that appropriate feedback modalities significantly improve user efficiency.
• Improvements were observed in reduced operational time and increased accuracy in target acquisition.
• User satisfaction and comfort levels varied, highlighting the importance of personalized feedback selection.

Conclusions:

• Multi-modal feedback in assistive devices can enhance user performance in mouse operations.
• The choice of feedback modality (haptic vs. auditory) impacts efficiency and user experience.
• Further research and user-centered design are essential for optimizing assistive device interfaces.