视觉变压器驱动的实时对话代理印度手语电子治理可访问性
Prema Nedungadi1, Gautham Dileep2, M Geetha3
1Amrita School of Computing, Amrita Vishwa Vidyapeetham, Amritapuri, India. prema@amrita.edu.
Scientific reports
|September 26, 2025
概括
本研究介绍了电子治理的实时印度手语 (ISL) 代理,以改善聋人和听力障碍者社区的数字访问. 该系统实现了高精度和快速响应,使包容性数字交互成为可能.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 聋人和听力障碍者社区面临着重要的数字可访问性障碍,特别是在访问电子治理服务方面.
- 印度手语 (ISL) 是一种低资源语言,对开发有效的数字工具提出了挑战.
- 现有的系统往往缺乏用于自然对话交互所需的上下文意识和实时处理.
研究的目的:
- 开发一个具有上下文意识的,实时的印度手语 (ISL) 对话代理.
- 在电子治理中增强聋人和听力障碍者社区的数字可访问性.
- 支持持续的ISL识别,从孤立的单词到完整的句子.
主要方法:
- 使用混合架构,将卷积神经网络 (CNN) 与视觉变压器 (ViT) 模型相结合.
- 开发了一个特定领域的ISL视频数据集,以应对低资源挑战.
- 实现了一个动态上下文响应映射引擎,以提高对模两可的输入的准确性.
主要成果:
- 在优化条件下实现了97.5%的准确性.
- 显示平均响应时间为6.53秒.
- 获得了系统可用性量表 (SUS) 的平均得分71.83.
结论:
- 开发的ISL对话代理显著提高了聋人和听力障碍者社区的数字包容性.
- 该系统的模块化设计和上下文感知引擎确保了现实世界部署的可扩展性和可靠性.
- 这一进步促进了电子治理服务中的实时,包容性数字交互.
相关概念视频
01:26Signal and System
1.6K
A signal x(t) is a set of data or a time function representing a variable of interest. Signals typically convey information about a phenomenon, such as atmospheric temperature, humidity, human voice, television images, a dog's bark, or birdsongs. More generally, a signal can be a function of more than one independent variable. For instance, images depend on horizontal and vertical positions and can be regarded as two-dimensional signals. However, this text will focus on one-dimensional...
1.6K
01:28Channels of Non-Verbal Communication
344
Non-verbal communication plays a critical role in human interaction, influencing how individuals perceive emotions and psychological states. It operates through four primary channels: facial expressions, eye contact, body language, and touch. These non-verbal cues help convey meaning beyond spoken language and are often culturally influenced.Facial Expressions and Emotional RecognitionFacial expressions are among the most powerful and universal forms of non-verbal communication. Research has...
344
01:30Therapeutic Communication
7.1K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
7.1K
01:20Integrated Healthcare System
2.3K
An integrated healthcare system (IHS) is a set of organizations that provides for or arranges to provide coordinated and continuous service to a defined population. The IHS takes responsibility for that particular population's health status and outcome, both clinically and fiscally. An integrated healthcare system is a well-organized, well-coordinated, and collaborative network. The integrated delivery system is a network that connects different healthcare providers to deliver organized,...
2.3K
01:19Contact-dependent Signaling
46.8K
Contact-dependent signaling, as the name suggests, requires that communicating cells be in direct contact with each other. This is achieved either through receptor-ligand interactions or by specialized cytoplasmic channels that allow the flow of small molecules between cells. In animal cells, channels called gap junctions facilitate contact-dependent signaling in certain tissues, whereas, plasmodesmata perform a similar function in plants.
Gap Junctions
In animal cells, gap junctions are formed...
Gap Junctions
In animal cells, gap junctions are formed...
46.8K
01:19Masking and Demasking Agents
3.4K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
3.4K