A Spot Reminder System for the Visually Impaired Based on a Smartphone Camera

Area of Science:

• Human-Computer Interaction
• Assistive Technology
• Computer Vision

Background:

• Visually impaired individuals face challenges in recalling memories associated with specific locations.
• Existing location-based memory recall systems often rely on GPS, limiting use in inaccessible environments.
• There is a need for accessible, non-reliance on GPS systems for memory association with places.

Purpose of the Study:

• To propose and evaluate a smartphone-camera-based system for visually impaired users to associate voice memos with specific locations (spots).
• To enable memory recall of visited places without requiring users to remember recording locations or rely on GPS.
• To enhance the independence and memory recall capabilities of visually impaired individuals.

Main Methods:

• Development of a smartphone-camera system utilizing Scale Invariant Feature Transform (SIFT) for image matching to establish spot-to-spot correspondence.
• Implementation of a voice memo recording and playback feature linked to identified locations.
• Evaluation through image matching tests and a user study involving visually impaired participants.

Main Results:

• The image matching tests demonstrated the robustness of the SIFT algorithm in identifying locations.
• The user study indicated that the system effectively assists visually impaired users in recalling information about regularly visited spots.
• Participants could successfully associate and retrieve voice memos linked to specific locations.

Conclusions:

• The proposed smartphone system offers an effective and accessible solution for visually impaired individuals to associate voice memos with locations.
• The system overcomes limitations of GPS-dependent technologies, functioning in GPS-inaccessible environments.
• This technology has the potential to significantly improve memory recall and daily navigation for the visually impaired community.