Enhancing Walk-Light Detector Usage for the Visually Impaired: A Comparison of VR Exploration and Verbal Instructions

Area of Science:

• Human-Computer Interaction
• Assistive Technology
• Accessibility Research

Background:

• People with visual impairments (PVI) increasingly use smartphone apps for daily tasks.
• Precise camera aiming in apps remains a significant challenge for PVI.
• Existing training methods may not adequately address camera-aiming difficulties.

Purpose of the Study:

• To compare the effectiveness of virtual reality (VR) exploration versus traditional text/audio (TA) instructions for learning a walk-light detector app.
• To investigate how PVI learn to use camera-enabled smartphone applications.
• To gather user feedback on VR-based training for assistive technology.

Main Methods:

• Developed a VR exploration tool based on PVI interviews.
• Conducted a user study with 13 PVI participants, divided into VR and TA groups.
• Participants trained indoors using their assigned method, then tested the app outdoors.

Main Results:

• A higher proportion of participants in the TA group found training easier, possibly due to VR protocol limitations or real-world/VR discrepancies.
• More participants in the VR group gained deeper insights into walk-light detection.
• VR-trained participants reported a greater perceived inability to use the detector without VR training compared to the TA group.

Conclusions:

• VR exploration shows potential for enhancing PVI's understanding of complex camera-dependent apps, despite initial usability challenges.
• Further refinement of VR protocols is needed to bridge the gap between virtual and real-world performance.
• Assistive technology training for PVI may benefit from immersive VR experiences for deeper learning outcomes.