弱监督的夸张转移用于漫画生成与跨模式知识蒸
IEEE computer graphics and applications
|April 17, 2024
概括
一个新的网络ETCari通过向艺术家学习来产生多样化的漫画风格. 这种弱监督的方法使用TPS变形来转移夸张,保持身份并提高定制性.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 数字艺术 数字艺术 数字艺术
背景情况:
- 漫画生成旨在从照片中创建夸张的艺术肖像.
- 现有的方法与多样化,可控的夸张和身份保护作斗争.
- 不满意和无法控制的结果限制了先前技术的应用.
研究的目的:
- 提出ETCari,一个监督较弱的网络,用于漫画制作中的各种夸张转移.
- 为了使个性化漫画能够从不同艺术家那里学习各种艺术风格.
- 为了实现多样化的夸张,同时有效地保留面部身份特征.
主要方法:
- 开发了一个名为ETCari的新型弱监督的夸张传输网络.
- 使用TPS (薄板支线) 控制点变形场作为损失计算的地面真相.
- 采用了从教师模型到学生模型的交叉模式知识蒸,以简化推理.
主要成果:
- ETCari成功地从多位艺术家那里学习了各种各样的夸张风格.
- 该方法实现了多样化的夸张效应,同时保留了身份特征.
- 在WebCaricature数据集上的实验证实了ETCari在生成吸引人的漫画中的有效性.
结论:
- ETCari为可控制和多样化的漫画生成提供了一个强大的解决方案.
- 弱监管的方法解决了有限的标签数据的挑战.
- 拟议的方法提高了漫画创作中的定制性和艺术品质.
相关概念视频
Generalization, Discrimination, and Extinction
545
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
545
Stereotype Content Model
14.7K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.7K
Improving Translational Accuracy
10.3K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.3K
Modeling and Similitude
266
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
266
Nonconscious Mimicry
4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K
Attribution Theory
13.0K
Behavior is a product of both the situation (e.g., cultural influences, social roles, and the presence of bystanders) and of the person (e.g., personality characteristics). Subfields of psychology tend to focus on one influence or behavior over others. Situationism is the view that our behavior and actions are determined by our immediate environment and surroundings. In contrast, dispositionism holds that our behavior is determined by internal factors (Heider, 1958).
13.0K


