适应细粒度预测场景图形生成的学习
IEEE transactions on pattern analysis and machine intelligence
|October 3, 2023
概括
本研究引入了自适应细粒度预测学习 (FGPL-A),通过更好地区分类似的预测来改进场景图生成 (SGG). 该方法显著提高了对基准数据集的SGG模型性能.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 当前场景图形生成 (SGG) 模型与难以区分的命题进行斗争,例如"女人在/站在/在海上行走".
- 一般的SGG模型经常预测共同的预言,而再平衡策略则偏好不太频繁的类别,未能充分解决微妙的预言区别.
研究的目的:
- 开发一种新的方法,即灵活细粒度预测学习 (FGPL-A),灵感来自细粒度图像分类,以增强SGG中难以区分的预测的差异化.
- 通过解决当前处理预言模两可的方法的局限性,提高SGG模型的准确性和效率.
主要方法:
- 引入自适应预言格 (PL-A) 以动态识别和根据模型的学习进度相关联困难的预言.
- 在模型培训期间开发适应类别区分损失 (CDL-A) 和适应实体区分损失 (EDL-A) 进行细粒度,适应性监督.
- 实施一种模型不可知的策略,通过使用小批预测来完善预言歧视.
主要成果:
- 在VG-SGG和GQA-SGG数据集上显著提高了性能,平均回忆@100分别增加了175%和76%.
- 建立新的最先进的性能基准,用于场景图生成.
- 通过 Sentence-to-Graph 检索和图像标题任务的成功应用来证明该方法的可行性.
结论:
- 拟议的FGPL-A战略有效地解决了难以区分SGG中的预言的挑战.
- PL-A,CDL-A和EDL-A的适应性确保了平衡和高效的学习,从而大大提高了绩效.
- 模型无意识的方法提供了适用于各种下游任务的多功能解决方案,增强了SGG模型的整体实用性.
相关概念视频
Observational Learning
202
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
202
End Point Prediction: Gran Plot
369
A Gran plot is used to predict the equivalence volume or endpoint of a potentiometric or acid-base titration without reaching the endpoint. Typically, titration data is collected as a function of the titrant's volume up to a point less than the equivalence volume and then transformed into a linear format. The straight line is extended to the x-axis, indicating the necessary titrant volume to achieve the equivalence point.
For potentiometric titration, the Gran plot is created by plotting...
For potentiometric titration, the Gran plot is created by plotting...
369
Schemas
11.7K
A schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
11.7K
Fixed Action Patterns
16.0K
A fixed action pattern (FAP) is a specific, hard-wired sequence of behaviors that occurs in response to an external stimulus, called a sign stimulus. The behavior is “fixed” because it is essentially unchangeable—proceeding similarly across individuals of a species every time it occurs.
16.0K
Survival Tree
105
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
105
Design Example: Aggregate Gradation
111
The right type and quality of aggregates are crucial for concrete as they significantly influence its properties, mix proportions, and cost-effectiveness. If different sources are available for sand, the commonly used fine aggregate in concrete, the selection of sand is primarily based on its gradation.
The grading, or particle-size distribution, of sand is determined using sieve analysis, with standard sizes ranging from 150 μm to 10 mm (ASTM No. 100 sieve to 3⁄8 in. sieve). Sand is...
The grading, or particle-size distribution, of sand is determined using sieve analysis, with standard sizes ranging from 150 μm to 10 mm (ASTM No. 100 sieve to 3⁄8 in. sieve). Sand is...
111


