Related Experiment Video
Updated: Oct 29, 2026

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
Poros: Perception-Enabled Interactive Assistance for Appliance Use by Blind and Low Vision Users
Abstract:
Modern home appliances pose significant accessibility barriers for individuals with visual impairments, driven by increasing functional complexity and minimalist design trends. Drawing on formative interviews with blind and low vision (BLV) participants, we propose Poros, a novel system providing perception-enabled interactive assistance to facilitate seamless appliance interaction. Our approach features an automated instruction generator that models appliance operation logic directly from user manuals to synthesize executable guidance for arbitrary tasks. Integrated into an Augmented Reality (AR) wearable, Poros provides real-time auditory feedback synchronized with the user's hand gestures and the appliance's display state. A user study with quantitative analysis and qualitative insights shows that our approach enhances user independence, enabling the successful execution of complex, multi-step operations that were previously considered inaccessible.
Related Concept Videos
Perceptual Development During Infancy
Perception
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Tactile and Chemical Senses
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Visual Agnosia
Introducing Social Perception
