Accessible Point-and-Tap Interaction for Acquiring Detailed Information about Tactile Graphics and 3D Models.

Area of Science:

• Human-Computer Interaction
• Assistive Technology
• Haptics and Tactile Graphics

Background:

• Traditional tactile graphics and 3D models present information passively, limiting user interaction and data acquisition.
• Existing assistive technologies for visually impaired individuals often lack dynamic, multi-layered information access for complex spatial representations.

Purpose of the Study:

• To develop and evaluate a novel "Point-and-Tap" interface for enhanced information retrieval from tactile graphics and 3D models for people who are blind or visually impaired (BVI).
• To enable intuitive, multi-level auditory feedback based on user interaction with physical models.

Main Methods:

• The "Point-and-Tap" interface utilizes an iPhone's depth and color cameras to track hand movements and finger gestures.
• Users point to features on tactile graphics or 3D models to initiate basic auditory information; subsequent taps access progressively deeper layers of data.
• The system allows free-hand exploration, with audio feedback only triggered by a pointing gesture, and supports rapid skipping through information levels.

Main Results:

• Six BVI participants successfully used the interface, demonstrating its practicality and ease of learning.
• The system effectively provided multiple levels of information about tactile graphics and 3D models.
• Users could access desired information more quickly by interrupting current audio feedback with subsequent taps.

Conclusions:

• The "Point-and-Tap" interface is a practical, learnable, and effective solution for BVI individuals to interact with and gain detailed information from tactile models.
• This technology significantly enhances the accessibility and utility of tactile graphics and 3D models for BVI users.
• The system offers a promising avenue for improving spatial understanding and information access in assistive technology.