进化了对自我监督学习的层次化
IEEE transactions on pattern analysis and machine intelligence
|November 4, 2024
概括
本研究介绍了自主监督学习的进化层次化掩盖方法,改善视觉模型的能力. 动态掩盖策略提高了各种下游任务的性能,而不需要额外的数据或模型.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 现有的蒙面图像建模 (MIM) 方法利用固定的面具模式,限制它们模拟各种视觉线索的能力.
- 静态掩盖方法限制了自主监督学习模型捕获全面图像信息的能力.
研究的目的:
- 在自我监督学习中为一般视觉暗示建模引入一种进化的层次化掩盖方法.
- 通过在培训期间动态调整面具模式来提高视觉模型在各种下游任务中的性能.
主要方法:
- 利用被训练的视觉模型将视觉线索解析成一个层次结构.
- 基于学习的层次结构生成动态的面具模式,从低级特征演变为高级特征.
- 实施高效的培训过程,通过不断变化的面具来调整难度,而不需要预先训练的模型或注释.
主要成果:
- 在七个不同的下游任务中大幅提高了性能,包括图像检索,分类和语义细分.
- 在ImageNet-1K分类中以1.1%优于最近的蒙面自动编码器 (MAE),在具有相同训练时代的ADE20K细分中以1.4%优于最近的蒙面自动编码器.
- 证明对复杂细节的增强感知,用于低级别的特征识别,并弥合对语义要求高的任务的差距.
结论:
- 进化的层次化掩盖方法为自我监督学习中的视觉暗示建模提供了更普遍和更有效的方法.
- 动态掩盖策略适应模型的学习进度,从而提高性能和训练效率.
- 这种方法与大型语言模型 (LLM) 研究一致,改善了视觉任务中的详细感知和语义理解.
相关概念视频
02:05Self-Presentation: Self-Monitoring and Self-Handicapping
38.9K
People can go to great lengths to protect their self-image and present themselves in ways that they want others to see them. Sociologist Erving Goffman presented the idea that a person is like an actor on a stage. Calling his theory dramaturgy, Goffman believed that we use “impression management” to present ourselves to others as we hope to be perceived. Each situation is a new scene, and individuals perform different roles depending on who is present (Goffman, 1959). Think about...
38.9K
01:27Associative Learning
300
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
300
01:24Generalization, Discrimination, and Extinction
451
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
451
01:22Multi-input and Multi-variable systems
98
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
98
02:09Stereotype Threat and Self-fulfilling Prophecies
37.5K
When we hold a stereotype about a person, we have expectations that he or she will fulfill that stereotype. A self-fulfilling prophecy is an expectation held by a person that alters his or her behavior in a way that tends to make it true. When we hold stereotypes about a person, we tend to treat the person according to our expectations. This treatment can influence the person to act according to our stereotypic expectations, thus confirming our stereotypic beliefs. Research by Rosenthal and...
37.5K
01:22Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K