梅特尔:用于记忆效率高的视听适应的meta-token学习
相关实验视频
Updated: Jan 8, 2026

04:43
Visualizing Visual Adaptation
Published on: April 24, 2017
9.5K
IEEE transactions on pattern analysis and machine intelligence
|December 11, 2025
概括
超标学习 (Mettle) 提供了一种记忆效率高的方法来适应大型视听模型. 这种方法减少了有限的计算资源的研究人员的训练记忆和时间,使得更广泛的可访问性.
科学领域:
- 人工智能的人工智能
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 目前的视听学习研究优先考虑使用复杂的多式联络融合的特定任务模型.
- 最近的进展侧重于通用视听嵌入网络,用于各种下游任务.
- 大型预训练变压器的参数高效微调是常见的,但由于深层的骨干,需要大量的内存.
研究的目的:
- 引入Meta-Token Learning (Mettle),一种新的,具有记忆效率的方法,用于将大型预训练过的变压器模型适应视听任务.
- 解决现有的参数效率微调技术的高训练内存消耗问题.
- 为了提高研究人员的可访问性,有限的计算资源.
主要方法:
- 梅特尔采用轻量级层中心蒸 (LCD) 模块,将每个变压器层的完整音频/视觉特征蒸成紧的元令牌.
- 蒸过程平衡了预先训练的知识保存与特定任务的调整.
- 一个Meta-Token注入 (MTI) 模块被引入用于细粒度细分任务,指导使用顶层蒸的meta-tokens的早期层适应.
主要成果:
- 与现有方法相比,Mettle显著减少了内存使用和训练时间.
- 这种方法保持了参数效率.
- 通过各种视听基准,包括事件本地化,视频解析和细分任务,实现了具有竞争力的准确性.
结论:
- 梅特尔提供了一个简单而有效的内存解决方案,用于适应大规模预训练的变压器模型用于视听任务.
- 该方法通过降低计算障碍,使先进的视听学习获得民主化.
- 梅特尔在各种视听基准中表现出强的表现,突出其多功能性和有效性.
相关概念视频
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Chunking and Rehearsal in Sensory Memory
541
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
541
Observational Learning
791
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
791
Long-Term Memory
591
Long-term memory is a relatively permanent type of memory, capable of storing vast amounts of information over extended periods. Its storage capacity is generally considered unlimited.
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
591