图片标题在孟加拉语使用视觉注意力的语言
Adiba Masud1,2, Md Biplob Hosen1, Md Habibullah1
1Institute of Information Technology, Jahangirnagar University, Dhaka, Bangladesh.
PloS one
|February 13, 2025
概括
研究人员开发了一种用于孟加拉语图像标题的AI模型,创建了一个新的数据集并获得最先进的结果. 这推动了人工智能 (AI) 在自然语言处理和计算机视觉方面取得进展,用于资源不足的语言.
科学领域:
- 人工智能的人工智能
- 计算机视觉 计算机视觉
- 自然语言处理自然语言处理.
背景情况:
- 自动图像标题是一个复杂的AI任务,特别是在孟加拉语等复杂的语言.
- 孟加拉语标题图像数据集显著缺乏,阻碍了研究和开发.
研究的目的:
- 为了策划一个由人类注释的孟加拉语图片标题数据集.
- 为孟加拉语图像标题开发一个创新的端到端深度学习架构.
主要方法:
- 创建了一个新的,细致的人类注释的孟加拉语图片标题数据集.
- 采用了以注意力驱动的解码器架构,整合了视觉特征的门式循环单元 (GRU).
- 一个注意力机制促进了视觉和语言表示之间的相互关系.
主要成果:
- 该模型获得了43%的BLEU-4得分,39%的METEOR得分和47%的ROUGE得分.
- 这些分数代表了迄今为止孟加拉语图片标题任务的最高表现.
结论:
- 开发的模型和数据集显著推进了孟加拉语图像标题的领域.
- 基于注意力的架构有效地产生了连贯的孟加拉语图像描述.
更多相关视频
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
15.6K
06:15Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
Published on: October 3, 2018
7.6K
相关概念视频
Vision
52.9K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
52.9K
Focusing of Light in the Eye
2.2K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
2.2K
Visual System
483
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
483
