Related Experiment Video
Updated: Jun 18, 2026

09:01
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
FUNCTIONAL ASSESSMENT OF A CAMERA PHONE-BASED WAYFINDING SYSTEM OPERATED BY BLIND AND VISUALLY IMPAIRED USERS
James Coughlan1, Roberto Manduchi
1The Smith-Kettlewell Eye Research Institute San Francisco, California 94115, USA coughlan@ski.org.
Summary
This study introduces a camera phone wayfinding system for visually impaired individuals using color markers. The system reliably guides users to locations, enhancing independent navigation.
Area of Science:
- Computer Vision
- Assistive Technology
- Human-Computer Interaction
Background:
- Visually impaired individuals face significant challenges with independent navigation.
- Existing wayfinding systems often lack real-time environmental adaptability.
Purpose of the Study:
- To develop and evaluate a novel camera phone-based wayfinding system for the blind and visually impaired.
- To enable users to locate points of interest using automatically detected color markers.
Main Methods:
- Utilized computer vision software on a camera phone for real-time detection of specially designed color markers.
- Developed a novel segmentation algorithm to accurately locate marker borders in cluttered environments.
- Modeled the impact of user scanning strategies on marker detection, considering motion blur limitations.
Main Results:
- The system demonstrated reliable detection of color markers in diverse indoor and outdoor settings.
- Blind and visually impaired volunteers successfully used the system for wayfinding.
- Identified effective user search strategies for optimal system performance.
Conclusions:
- The camera phone wayfinding system offers a practical and effective solution for enhancing mobility for visually impaired persons.
- The system's real-time detection and user-adaptive strategies contribute to improved navigation.
- Further research into user scanning behaviors can optimize assistive navigation technologies.

