VIIDA和InViDe:用于生成和评估视觉障碍者包容性图像段落的计算方法
Daniel L Fernandes1, Marcos H F Ribeiro1, Michel M Silva1
1Department of Informatics, Universidade Federal de Viçosa - UFV, Viçosa, Brazil.
Disability and rehabilitation. Assistive technology
|December 11, 2024
概括
新的辅助技术,VIIDA和InViDe,为视障人士生成和评估图像描述. 这些由人工智能驱动的工具提供了可访问的内容,改进了对盲人和视力低下者 (BLV) 社区的现有方法.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 现有的图像描述技术往往无法满足盲人或视力低下 (BLV) 个体的需求.
- 目前的方法可能会提供过于简短,不连接或过长的描述.
- 需要改进图像描述的辅助技术.
研究的目的:
- 介绍VIIDA (视觉障碍者图像描述方法),用于生成描述,专注于网络研讨会场景.
- 为BLV用户提出InViDe (包括视觉描述) 作为评估图像描述的新型指标.
- 解决目前用于辅助技术应用的图像描述方法的局限性.
主要方法:
- 通过将多式视觉问答模型与自然语言处理 (NLP) 过器集成,开发了VIIDA.
- 使用基于场景图的算法来构建生成的描述.
- 在InViDe中使用NLP工具创建基于可访问性标准的多标准分析.
主要成果:
- VIIDA生成与图像内容和人类语言特征一致的描述,满足BLV的需求.
- InViDe提供了对各种描述方法,包括大型语言模型的性能的见解.
- 统计实验证实了VIIDA和InViDe.De的有效性.
结论:
- VIIDA 和 InViDe 是有效的辅助技术,用于为视障人士生成和评估图像描述.
- 这些人工智能和计算技术提供了较低的计算成本.
- 该研究旨在激发辅助技术的进一步研究和开发.
相关概念视频
Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
Visual Agnosia
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round end"...
Imaging Studies VII: Vascular Imaging
DefinitionRenal angiography, also known as renal arteriography, is an imaging technique used to obtain a comprehensive view of blood flow and the vascular structure of blood vessels in the kidneys and surrounding areas.PurposeRenal angiography detects blood vessel abnormalities in the kidneys, such as aneurysms, stenosis, thrombosis, vascular tumors, and renal artery stenosis. It evaluates kidney function and guides interventional treatments like angioplasty or stent placement.Pre-Procedure...
Information Processing Approach
The information-processing theory of cognitive development centers on fundamental mental processes, including attention, memory, and problem-solving skills. Researchers in this field examine how cognitive abilities, such as working memory, evolve and influence children's overall development. Studies indicate that children with stronger working memory tend to excel in reading comprehension, math, and problem-solving compared to peers with less efficient memory skills. Low working memory is also...
Learning Disabilities
Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
Dyslexia
Dyslexia is a...


