下游任务引导的掩盖学习在掩盖的自动编码器中使用多级优化
Han Guo1, Ramtin Hosseini1, Ruiyi Zhang1
1UC San Diego.
概括
本研究介绍了多级优化面具自编码器 (MLO-MAE),用于自我监督的视觉表示学习. 通过下游任务反,MLO-MAE优化了补丁掩盖,比标准的掩盖自动编码方法提高了性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 蒙面自动编码器 (MAE) 是一种突出的自我监督的方法,用于视觉表示学习.
- MAE随机掩盖图像补丁用于重建,但没有考虑补丁信息性和下游任务需求.
- 现有的基于信息的掩盖方法可能与特定的下游任务要求不一致,导致表现不理想.
研究的目的:
- 开发一个新的框架,多级优化面具自编码器 (MLO-MAE),在预训练期间学习最佳的掩护策略.
- 利用下游任务的端到端反来指导掩盖过程.
- 提高自我监督视觉表现学习的效率和适应性.
主要方法:
- 引入了多级优化口罩自编码器 (MLO-MAE) 框架.
- 从下游任务实施了一个端到端的反机制,以优化补丁掩盖.
- 在各种数据集上使用MLO-MAE策略的预训练模型.
主要成果:
- MLO-MAE在视觉表现学习方面取得了重大进展.
- 与现有方法相比,在各种数据集和下游任务中取得了显著的改进.
- 展示了学习视觉表示的适应性和效率.
结论:
- 在自我监督学习中,MLO-MAE有效地解决了统一和任务不可知的掩盖策略的局限性.
- 该框架通过结合下游任务反,为学习视觉表示提供了更优的方法.
- MLO-MAE代表了自我监督视觉预训的实质性进步.
相关概念视频
Masking and Demasking Agents
2.7K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.7K
Observational Learning
311
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
311
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Avoidance Learning and Learned Helplessness
1.9K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.9K
Associative Learning
572
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
572
Reducing Line Loss
193
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
193

