Beyond the Cane: Describing Urban Scenes to Blind People for Mobility Tasks

Area of Science:

• Human-Computer Interaction
• Assistive Technology
• Computer Vision

Background:

• Independent mobility is a significant challenge for blind individuals, affecting various life aspects.
• Advancements in computer vision necessitate identifying essential information for blind travelers.
• Sensory information processing capacity is limited, requiring a focus on relevant environmental data.

Purpose of the Study:

• To investigate which objects in street scenes are most useful to describe for blind travelers.
• To determine the optimal way to describe these objects for enhanced understanding and utility.
• To differentiate information needs based on visual experience (early vs. late blindness).

Main Methods:

• Two urban walking experiments involving 13 cane-using participants (5 early blind).
• Experiment 1: Participants voiced information needs as questions.
• Experiment 2: Participants rated usefulness of provided scene descriptions and navigation instructions, and ranked object priorities.

Main Results:

• Significant differences observed between early and late blind participants' information requests.
• Late blind participants requested information more frequently and prioritized object locations.
• Description factors like detail level, relative position, and information type influenced usefulness.

Conclusions:

• Findings highlight the importance of tailored information delivery for blind travelers.
• Results underscore the need for multi-level abstraction in travel information.
• Further research is needed to fully elucidate travel information needs for improved assistive technology development.