加速自主监督多次照明颜色恒定与混合知识蒸.
概括
这项研究引入了一种新的自我监督学习和知识蒸方法,用于颜色恒定,在不同的照明下改善色彩感知. 该方法增强了功能学习和模型效率,用于实际部署相机.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 人类视觉系统 视觉系统
背景情况:
- 在不断变化的照明下,颜色恒定对于准确的颜色感知至关重要.
- 深度学习方法有前途,但受到数据集规模和模型大小的限制.
- 现有的方法在有效的区分特征学习和实际摄像机部署方面扎.
研究的目的:
- 提出一种多照明颜色恒定方法,克服当前的局限性.
- 增强功能学习和模型效率,用于实际应用.
- 在多光照和单光照基准测试中改善色彩恒定性表现.
主要方法:
- 一个三阶段的方法:自我监督的预培训,监督的微调和知识蒸.
- 预训练使用变压器和U-Net编码器进行光正常化和灰度色化借口任务.
- 知识蒸将CNN功能与变压器和U-Net功能结合起来,使用混合技术.
主要成果:
- 拟议的方法在多照明和单照明数据集上胜过了最先进的技术.
- 一个轻量级的解码器可以用更少的参数实现更好的照明分布.
- 废除研究和可视化验证了模型的有效性.
结论:
- 自主监督学习和知识蒸方法显著提升了颜色恒定性.
- 该方法为现实世界部署提供了改进的功能学习和模型效率.
- 这项研究提供了一个强大的解决方案,用于在各种照明条件下准确地感知颜色.
相关概念视频
01:12Perceptual Constancy
583
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
583
01:24Color Vision
736
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
736
02:16Light Acquisition
8.6K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.6K
01:20Deconvolution
263
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
263