Related Experiment Video
Updated: May 11, 2026

09:01
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments
Yingli Tian1, Xiaodong Yang, Chucai Yi
1Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York, NY 10031.
Summary
This study introduces a computer vision system to help blind individuals navigate indoor spaces. The system uses object detection and text recognition to identify rooms and amenities, providing audio feedback for independent travel.
Area of Science:
- Computer Vision
- Assistive Technology
- Human-Computer Interaction
Background:
- Independent travel presents significant challenges for blind and visually impaired individuals, particularly in unfamiliar indoor environments.
- Existing wayfinding solutions often lack the sophistication to handle the complexities of diverse indoor settings.
Purpose of the Study:
- To develop and demonstrate a proof-of-concept computer vision-based wayfinding aid for enhancing independent navigation for blind persons.
- To integrate object detection and text recognition for identifying indoor spaces and amenities.
Main Methods:
- A robust algorithm was developed for detecting doors, elevators, and cabinets using geometric features (edges and corners).
- Text recognition was employed to differentiate between similar objects (e.g., office vs. bathroom doors) by analyzing associated signage.
- Optical character recognition (OCR) software was utilized after text region extraction and background interference filtering.
Main Results:
- The system successfully detects key indoor features like doors and elevators.
- Text recognition accurately distinguishes between objects with similar appearances but different functions.
- Integrated information (object type, location, text) is presented to the user via speech output.
Conclusions:
- The proposed computer vision system offers a promising approach to improve independent indoor navigation for the visually impaired.
- Combining geometric object detection with OCR-based text recognition provides a comprehensive wayfinding solution.
- This technology has the potential to significantly enhance accessibility in public and private indoor environments.
Related Concept Videos
Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
Visual Agnosia
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round end"...
