DTL:参数和记忆效率高的解视觉学习
IEEE transactions on pattern analysis and machine intelligence
|October 1, 2025
概括
分解转移学习 (DTL) 减少了大型模型的GPU内存和可训练参数. 这种参数效率转移学习方法可以提高下游任务的准确性,例如对象检测和语义细分.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 精细调整大型预训练模型会产生相当大的计算成本.
- 现有的参数效率转移学习 (PETL) 方法在训练期间由于参数纠而难以减少GPU内存占用量.
- 对于大规模的人工智能模型来说,需要有效的记忆和准确的转移学习技术至关重要.
研究的目的:
- 引入解转移学习 (DTL) 以减少GPU内存使用量和可训练参数的大型模型微调.
- 为有效的知识传输提出一个新的紧侧网 (CSN) 架构.
- 为了证明DTL在效率和准确性方面优于现有的PETL方法.
主要方法:
- DTL使用轻量级的紧侧网 (CSN) 从骨干模型中解开可训练的参数.
- CSN使用低级线性映射来提取和重新注入特定任务的信息.
- 对于像对象检测和语义细分等复杂任务,DTL被扩展为稀疏的架构设计.
主要成果:
- 与现有的PETL方法相比,DTL显著降低了GPU内存的使用量和可训练参数的数量.
- 拟议的CSN有效地促进了跨各种下游识别任务的知识转移.
- 在基准数据集上,DTL实现了比目前的PETL方法更高的准确率.
结论:
- 对于大型模型,DTL提供了一种更高效,更有效的学习转移方法.
- 对于内存受限制的训练场景,CSN架构提供了一个可行的解决方案.
- DTL代表了参数效率转移学习的重大进步,特别是在计算机视觉任务中.
更多相关视频
相关概念视频
Depth Perception and Spatial Vision
1.8K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
1.8K
Vision
59.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.4K
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Visual System
1.7K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.7K


