VPT-NSP++:在零空间中对视觉提示符进行重要调整,以实现持续学习
IEEE transactions on pattern analysis and machine intelligence
|December 11, 2025
概括
本研究介绍了视觉转换器 (ViT) 持续学习 (CL) 的重要意识直角规范化. 它增强了模型稳定性和可塑性,以便在不断变化的AI环境中长期适应.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 持续学习 (CL) 对于人工智能模型来说至关重要,以适应动态环境并防止灾难性遗忘.
- 视觉变压器 (ViT) 模型和视觉提示调 (VPT) 在CL中越来越受欢迎.
- 由于非线性,当现有的直角投影方法应用于ViT时会面临挑战.
研究的目的:
- 为使用VPT的ViT模型开发一个理论上有保证的CL方法.
- 为ViT适应直角投影技术,解决自我注意力和LayerNorm复杂性.
- 为了提高长期的CL性能,并改善稳定性-可塑性权衡.
主要方法:
- 在ViTs中提出了两个直角性条件,用于快速梯度直角投影.
- 引入了一个重要意识的直角规范化框架,以平衡模型容量和可塑性.
- 采用基于零空间的近似来实现高效的直角投影.
主要成果:
- 提出的方法在课堂增量学习基准上实现了最先进的性能.
- 在长序CL场景中证明了增强的稳定性和可塑性.
- 有效地解决了应用直角投影到ViTs的挑战.
结论:
- 意识到重要性的直角规范化框架为基于ViT的CL提供了一个强大的解决方案.
- 该方法提供了理论上的稳定性保证,同时提高了适应性.
- 这项工作推进了复杂的深度学习模型的持续学习领域.
相关概念视频
Depth Perception and Spatial Vision
1.7K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
1.7K
Purposive Learning
420
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
420
Observational Learning
791
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
791
Perceptual Constancy
1.2K
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
1.2K
Perceiving Loudness, Pitch, and Location
892
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
892
Cognitive Learning
970
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
970


