Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Learning Disabilities

Learning Disabilities

Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Association of glycemic control with arterial stiffness and hemodynamic function in type 2 diabetes mellitus.

Diabetes research and clinical practice·2026

Same author

Development and application of an artificial intelligence agent-based case teaching model for health assessment: A quasi-experimental study.

Nurse education today·2026

Same author

Nutrient intake and renal cancer: molecular pathways and mechanistic insights into the protective role of dietary components.

Frontiers in nutrition·2026

Same author

LLM Powered Text Entry Decoding and Flexible Typing on Smartphones.

Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference·2025

Same author

Enabling Auto-Correction on Soft Braille Keyboard.

Proceedings of the ACM Symposium on User Interface Software and Technology. ACM Symposium on User Interface Software and Technology·2025

Same author

Tap&Say: Touch Location-Informed Large Language Model for Multimodal Text Correction on Smartphones.

Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference·2025

Same journal

Beyond Beautiful: Embroidering Legible and Expressive Tactile Graphics.

ASSETS. Annual ACM Conference on Assistive Technologies·2026

Same journal

"Better Than Nothing" or Not Enough? User-Centered Reflections on AI-Generated Audio Descriptions Across Media Formats.

ASSETS. Annual ACM Conference on Assistive Technologies·2026

Same journal

DescribePro: Collaborative Audio Description with Human-AI Interaction.

ASSETS. Annual ACM Conference on Assistive Technologies·2026

Same journal

Minor Resistance: The Everyday Politics and Power Dynamics of Assistive Technology Adoption.

ASSETS. Annual ACM Conference on Assistive Technologies·2026

Same journal

Co-Designing Culturally Grounded Mobile Health Games for Hypertension Management in Indigenous Communities.

ASSETS. Annual ACM Conference on Assistive Technologies·2026

Same journal

Modeling Accessibility: Characterizing What We Mean by "Accessible".

ASSETS. Annual ACM Conference on Assistive Technologies·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Jun 26, 2026

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models.

Satwik Ram Kodandaram¹, Utku Uckun², Xiaojun Bi¹

¹Department of Computer Science, Stony Brook University, United States.

ASSETS. Annual ACM Conference on Assistive Technologies

|January 9, 2025

Summary

This summary is machine-generated.

Blind users can now navigate any application uniformly using natural language commands with Savant, a new assistive technology. This large language model (LLM) powered tool reduces the burden of learning complex interfaces, improving efficiency.

Keywords:

Accessibility Assistive technology Blind users Computer Interaction Large language models (LLMs)Uniform interaction

More Related Videos

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Related Experiment Videos

Last Updated: Jun 26, 2026

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Area of Science:

Human-Computer Interaction
Assistive Technology
Artificial Intelligence

Background:

Blind individuals rely on screen readers for computer interaction.
Heterogeneous application interfaces pose significant navigation challenges for screen reader users.
Existing methods require memorizing numerous keyboard shortcuts and navigation patterns.

Purpose of the Study:

To introduce Savant, a novel assistive technology designed to unify application interface interaction for blind screen reader users.
To reduce the cognitive load and interaction burden associated with diverse graphical user interfaces.
To enable uniform interaction across applications using natural language.

Main Methods:

Development of Savant, an assistive technology leveraging large language models (LLMs).
Implementation of natural language processing to interpret user commands.
Automation of screen reader actions based on flexible, natural language prompts.
User study involving 11 blind participants to evaluate Savant's effectiveness.

Main Results:

Savant enables blind users to interact with any application interface through natural language.
The system automates complex screen reader actions based on user commands.
User commands do not require precise naming of interface elements.
Significant improvements in interaction efficiency and usability were observed.

Conclusions:

Savant offers a unified and efficient interaction method for blind screen reader users.
LLM-powered assistive technology can effectively address challenges in navigating heterogeneous interfaces.
The findings suggest a promising future for natural language-based assistive tools.