Related Experiment Video
Updated: Sep 30, 2025

09:01
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
14.5K
Towards Enhancing Blind Users' Interaction Experience with Online Videos via Motion Gestures
1Stony Brook University Stony Brook, NY, USA.
Summary
Blind smartphone users can now interact with online videos more easily using motion gestures. The YouTilt app significantly improves usability for screen reader users, enhancing their video experience.
Area of Science:
- Human-Computer Interaction
- Assistive Technology
- Mobile Computing
Background:
- Blind users rely on screen readers, which can conflict with audio from online videos.
- Current solutions for video control interference are desktop-focused and not suitable for smartphones.
Purpose of the Study:
- To explore motion gestures as an alternative interaction method for blind smartphone users with online videos.
- To design and evaluate an Android application, YouTilt, for gesture-based video control.
Main Methods:
- Developed YouTilt, an Android application utilizing motion gestures for video control.
- Conducted a user study with 10 blind participants to assess YouTilt's effectiveness.
- Collected data on gesture execution and user attitudes towards the system.
Main Results:
- Blind users showed a significant average usability improvement of 43.3% with YouTilt compared to the default screen reader.
- Participants demonstrated the ability to execute motion gestures for video interaction tasks.
- Overall positive user attitudes and acceptance of motion gesture-based video interaction were observed.
Conclusions:
- Motion gestures offer a viable and effective solution for blind screen reader users to interact with online videos on smartphones.
- YouTilt demonstrates the potential of leveraging smartphone motion capabilities to enhance accessibility in mobile video consumption.
- Further development in gesture-based interaction can significantly improve the digital experience for visually impaired users.

