KBStyle:使用200KB网络进行快速样式传输,并进行对称知识蒸
概括
本研究介绍了KBStyle,这是一个具有200 KB模型大小的新型艺术风格转移算法. 它实现了高质量的结果和快速推断,使风格转移在移动设备上可行.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 最先进的 (SOTA) 艺术风格转移模型面临着巨大的尺寸,导致高计算成本和内存需求.
- 这些局限性阻碍了实时性能,资源有限的GPU上的高分辨率处理和移动设备应用.
研究的目的:
- 提出了一个名为KBStyle的新,轻量级任意艺术风格转移算法.
- 为了显著减少模型大小,同时保持高质量的风格化图像生成和高效的推理.
主要方法:
- 设计了一个定制的风格传输网络,使用优化的编码器和解码器来实现低计算成本和形状保留.
- 引入加权的样式丢失函数,以提高样式迁移性能.
- 开发了一种新的对称知识蒸 (SKD) 方法来压缩编码器-解码器风格传输模型.
主要成果:
- 拟议的KBStyle算法实现的模型大小只有200KB,通过SKD实现了14倍的压缩.
- KBStyle表现出与SOTA知识蒸方法相比较的性能.
- 实现了高质量的风格图像,推断时间快 (Nvidia TITAN RTX上的2k分辨率为20毫秒).
结论:
- 与SOTA方法相比,KBStyle在模型大小上提供了显著的减少.
- 该算法的效率和小足迹使得在移动设备上实现了实用的艺术风格转移.
- 对称知识蒸是一种有效的技术,用于压缩编码器-解码器风格传输模型.
相关概念视频
02:07Improving Translational Accuracy
11.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.1K
01:27Associative Learning
404
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
404
01:25Distribution Reliability and Automation
108
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
108
01:25Secondary Distribution
87
Secondary distribution systems provide electrical energy at the utilization voltage levels from distribution transformers to customer meters. Typical secondary voltages in the United States include 120/240 V for residential use, 208Y/120 V for residential and commercial use, and 480Y/277 V for industrial and high-rise commercial use.
In residential areas, 120/240 V single-phase, three-wire service is commonly used for lighting, outlets, and large appliances. Urban areas with high-density loads...
In residential areas, 120/240 V single-phase, three-wire service is commonly used for lighting, outlets, and large appliances. Urban areas with high-density loads...
87
01:15Distance Corrections
30
To achieve precise distance measurements, especially in surveying and construction, certain corrections must be applied to account for potential sources of error like the standardization errors, temperature variations, and slope adjustments.Standardization error emerges when measurement equipment undergoes changes, such as wear, repairs, or weather impacts. To address this, surveyors compare the equipment’s readings to a standard. This process identifies any deviation that might lead to...
30
01:18Reducing Line Loss
155
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
155