强大的视觉问题答案通过极性增强和对比度增强
1Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin 541004, China; Guangxi Key Lab of Multi-source Information Mining and Security, Guangxi Normal University, Guilin 541004, China.
概括
本研究介绍了一种无偏见的视觉问题答案 (VQA) 方法,以克服语言偏见. 这种新的方法通过专注于答案-图像相关性来提高VQA数据集的模型性能.
科学领域:
- 人工智能的人工智能
- 计算机视觉 计算机视觉
- 自然语言处理自然语言处理.
背景情况:
- 视觉问题答案 (VQA) 模型通常依赖于问题答案相关性,忽视视觉内容.
- 这种对语言先验的依赖削弱了模型真正理解图像-文本关系的能力.
研究的目的:
- 提出一个公正的VQA方法,减轻语言先验.
- 在VQA模型中增强视觉内容和文本信息之间的相关性.
主要方法:
- 设计了一个新的两模块模型架构.
- 答案视觉注意模块产生积极的预测,而双通道联合模块产生负面的预测.
- 开发了一个新的损失函数来训练模型,在正确答案旁边使用正负预测.
主要成果:
- 拟议的方法在VQA-CP v2数据集上实现了61.24%的性能.
- 这种方法与现有的退化方法不同,在VQA v2数据集和VQA-CP v2数据集上都提高了性能,而在VQA v2数据集上则没有降低性能.
结论:
- 开发的公正的VQA方法有效地解决了语言先验问题.
- 该模型在多个VQA基准中展示了改进的性能,突出了其稳定性和通用性.
相关概念视频
Group Polarization
34.3K
Group polarization is the strengthening of an original group attitude following the discussion of views within a group (Teger & Pruitt, 1967). That is, if a group initially favors a viewpoint, after discussion the group consensus is likely a stronger endorsement of the viewpoint. Conversely, if the group was initially opposed to a viewpoint, group discussion would likely lead to stronger opposition.
34.3K
Potential Due to a Polarized Object
379
A neutral atom consists of a positively charged nucleus surrounded by a negatively charged electron cloud. When placed in an external electric field, the external electric force pulls the electrons and nucleus apart, opposite to the intrinsic attraction between the nucleus and the electrons. The opposing forces balance each other with a slight shift between the center of masses of the nucleus and the electron cloud, resulting in a polarized atom. On the other hand, a few molecules, like water,...
379
¹³C NMR: Distortionless Enhancement by Polarization Transfer (DEPT)
1.0K
When proton-coupled carbon-13 spectra are simplified by a broadband proton decoupling technique, structural information about the coupled protons is lost. Distortionless enhancement by polarization transfer (DEPT) is a technique that provides information on the number of hydrogens attached to each carbon in a molecule. While the DEPT experiment utilizes complex pulse sequences, the pulse delay and flip angle are specifically manipulated. The resulting signals have different phases depending on...
1.0K
Perceptual Constancy
376
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
376
Difference from Background: Limit of Detection
6.0K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.0K
Polarity of the Cytoskeleton
16.8K
The intrinsic polarity of cells can be primarily attributed to two factors- i) the asymmetric accumulation of mobile components such are regulatory molecules and subcellular components across the cell and ii) the orientation of polar cytoskeletal filaments that make up the cytoskeletal networks, specifically microfilaments, and microtubules arranged along the axis of polarity. Interactions between the cytoskeletal filaments are crucial for the establishment and maintenance of the polar nature...
16.8K


