相关实验视频
Updated: Sep 11, 2025

07:51
Video Movement Analysis Using Smartphones ViMAS: A Pilot Study
Published on: March 14, 2017
16.9K
超越视觉感知:视觉障碍用户与大型多式模式智能手机互动的见解
Jingyi Xie1, Rui Yu2, H E Zhang1
1Pennsylvania State University, USA.
概括
大型多式模式 (LMM) 为视力障碍者 (PVI) 提供人工智能驱动的视觉辅助. 然而,当前的LMM工具与上下文和用户意图扎,限制了它们在日常任务中的有效性.
科学领域:
- 人工智能的人工智能
- 人与计算机的交互
- 辅助技术 辅助技术 辅助技术
背景情况:
- 大型多式联运模型 (LMM) 正在成为强大的AI工具.
- 这些模型为视力障碍者 (PVI) 提供自然语言环境描述.
- 了解LMMs对PVI的现实应用和局限性至关重要.
研究的目的:
- 调查基于LMM的视觉辅助如何影响PVI的日常任务执行.
- 评估LMM工具在个人和社会环境中的能力和局限性.
- 探索未来基于LMM的辅助技术的设计影响.
主要方法:
- 对14名视力受损用户进行了采访.
- 分析了参与者使用Be My AI (LMM应用程序) 生成的图像描述.
- 检查了社交媒体数据,以更广泛的背景下理解LMM应用.
主要成果:
- 识别了LMM上下文意识的局限性,包括幻觉和对社会线索,风格和身份的误解.
- 发现LMM面向意图的功能往往无法准确地掌握并根据用户的意图采取行动.
- 在辅助环境中,强调了人类-AI和AI-AI互动中的挑战.
结论:
- 基于LMM的视觉辅助工具需要在上下文意识和意图识别方面大幅度改进.
- 设计策略应侧重于增强人 - 人工智能和人工智能 - 人工智能交互,以实现更有效的辅助技术.
- 未来的发展应该旨在为PVI提供更个性化和交互式的AI解决方案.
相关概念视频
Sensory Modalities
1.5K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
1.5K
Visual Agnosia
301
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
301

