Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind

Area of Science:

• Assistive technology
• Human-computer interaction
• Robotics

Background:

• Visually impaired individuals often rely on traditional mobility aids like white canes.
• Existing virtual cane systems may lack intuitive control or clear sensory feedback.
• There is a need for advanced assistive devices that enhance navigation and environmental awareness for the blind.

Purpose of the Study:

• To develop and evaluate a haptic-assisted virtual cane system.
• To enable navigation guidance through a simple finger-pointing gesture.
• To provide identifiable tactile feedback for distance and guidance to visually impaired users.

Main Methods:

• The system integrates a stereo camera for visual information delivery (VIDA).
• A tactile feedback interface with dual actuators was developed for sensory output.
• Finger detection, 3D trajectory estimation, and object distance calculation were performed using stereo vision.
• Identifiable tactile signals were designed and validated through user experiments.

Main Results:

• The system successfully detects a user's pointing finger and estimates its 3D trajectory.
• Objects within the pointing trajectory are identified, and their distances are estimated in real time.
• Designed tactile signals were found to be identifiable for guidance and distance feedback.
• The virtual cane system provides intuitive navigation through finger gestures.

Conclusions:

• The proposed haptic-assisted virtual cane system offers a novel approach to assistive navigation for the blind.
• Integration of finger-pointing gestures and identifiable tactile feedback enhances user interaction and environmental perception.
• This system has the potential to improve mobility and independence for visually impaired individuals.