Related Experiment Video
Updated: Jun 21, 2025
03:14
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
543
Co-designing the integration of voice-based conversational AI and web augmentation to amplify web inclusivity
Emanuele Pucci1, Ludovica Piro2, Isabella Possaghi3
1Politecnico di Milano, Milan, Italy. emanuele.pucci@polimi.it.
Scientific Reports
|July 13, 2024
Summary
This study used a human-centered approach to improve web accessibility for individuals with speech impairments. Findings show customized conversational AI and visual web page augmentation can reduce barriers, emphasizing personalized technology over large models.
Area of Science:
- Human-Computer Interaction
- Assistive Technology
- Web Accessibility
Background:
- The internet is crucial but not universally accessible.
- Assistive technologies and AI frameworks help, but barriers remain for some users.
- Speech impairments, such as dysarthria, present unique challenges to web navigation.
Purpose of the Study:
- To investigate web browsing challenges faced by individuals with speech impairments.
- To identify technological limitations and gaps in current web accessibility solutions.
- To develop and validate new human-centered solutions for inclusive web browsing.
Main Methods:
- A three-step process involving a focus group, co-design workshops, and preliminary validation.
- Investigating web browsing behaviors of individuals with speech impairments.
- Developing and combining voice-based conversational AI (customized for impaired speech) with visual web page augmentation techniques.
Main Results:
- Identified specific challenges and barriers encountered by users with speech impairments during web browsing.
- Created novel patterns for web browsing by integrating customized conversational AI with visual augmentation.
- Highlighted user feedback that current conversational AI systems often fail to meet specific needs, despite advancements in large AI models.
Conclusions:
- A human-centered approach is vital for uncovering and addressing technology limitations in web accessibility.
- Tailored assistive technologies, combining customized AI and visual aids, can significantly reduce web browsing barriers for people with speech impairments.
- Inclusive technology design requires a focus on individual specificity rather than solely on the power of large AI models.
More Related Videos
Related Concept Videos
01:16Non-equilibrium in the Cell
4.4K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.4K
01:27Language and Cognition
340
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
340
01:24Components of Language
263
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
263
01:21Barriers to Effective Communication II
3.6K
The barriers to effective communication also include cultural barriers, semantic barriers, gender barriers, and time constraints.
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
3.6K
02:34Empathy
9.6K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
9.6K
01:22Language Development
339
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
339