Related Experiment Video
Updated: Aug 13, 2026

06:54
Photorealistic Learned Landscapes for Augmented Reality
Published on: June 27, 2025
An End-to-End Pipeline to Generate Augmented Tactile Maps from Floor Plans
Michelle Quach1, James M Coughlan2, Dragan Ahmetovic3
1Dept. of Computer Science and Engineering, UC Santa Cruz, CA 95064, USA.
Summary
This study introduces a pipeline creating tactile maps with audio for visually impaired individuals. The system enables successful navigation and spatial understanding, demonstrating good usability and low workload.
Area of Science:
- Human-Computer Interaction
- Assistive Technology
- Accessibility Research
Background:
- Visually impaired individuals face challenges navigating indoor environments.
- Existing tactile maps often lack dynamic or interactive features.
- Audio feedback can enhance spatial understanding and navigation for blind users.
Purpose of the Study:
- To develop and evaluate an end-to-end pipeline for generating accessible tactile maps with audio annotations.
- To assess the usability and effectiveness of the system for navigation tasks.
- To identify areas for improvement in the tactile map system.
Main Methods:
- Integration of Semantic Interior Mapology (SIM) for floor plan annotation.
- Utilizing CamIO, a camera-based web application for audio feedback delivery.
- Conducting pilot and follow-up studies with blind participants performing navigation tasks.
Main Results:
- Participants successfully completed room-finding and route-tracing tasks.
- The system demonstrated good usability (mean SUS score of 77).
- Low perceived workload (NASA-TLX) indicated system effectiveness.
- Identified needs for reduced latency and improved interaction with small hotspots.
Conclusions:
- The developed pipeline effectively transforms floor plans into accessible, audio-enriched tactile maps.
- The system supports spatial understanding and navigation for visually impaired users.
- Further refinements are needed to enhance user experience, particularly concerning interaction latency and hotspot clarity.