一个面部结构采样对比学习方法,用于草图面部合成
Kangning Du1,2, Jiyu Zhang1,2, Lin Cao3,4
1Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, 100101, China.
Scientific reports
|May 9, 2025
概括
这项研究引入了一种新的对比学习方法,用于草图面部合成,通过使用面部结构采样来改进生成图像中的局部细节. 这种方法提高了合成草图的质量,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 对比式学习对于图像翻译任务,如素描面部合成,是有效的.
- 传统的对比学习方法与随机抽样和样本不平衡作斗争,导致合成草图中的局部细节差.
研究的目的:
- 提出一种新的面部结构采样对比学习方法,以改进草图面部合成.
- 为应对因随机抽样和现有方法中的样本不平衡造成的局部细节生成不佳的挑战.
主要方法:
- 开发了一个区域受限的采样模块,使用双分支注意力机制来根据面部结构分布对照片进行细分.
- 实施了动态采样策略,根据特征密度调整采样频率,以减轻样本失衡.
- 嵌入式输入照片面罩可减少背景影响并增强轮划分.
- 引入了像素智能和感知损失,以进一步提高合成素描质量.
主要成果:
- 拟议的方法产生高质量的素描面部图像.
- 对CUFS数据集的实验结果显示,在主观和客观评估中,与最先进的方法相比,性能优越.
- 面部结构采样和动态调整策略有效地改善了局部细节的表示.
结论:
- 面部结构采样对比学习方法显著提高了面部素描合成质量.
- 提出的技术有效地解决了这一领域传统对比学习的局限性.
- 这项工作为从照片中生成更准确,更详细的面部素描提供了有希望的方向.
更多相关视频
07:12Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
Published on: August 26, 2016
9.3K
05:48Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
Published on: August 9, 2024
1.3K
相关概念视频
Muscles for Facial Expressions
1.7K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
1.7K
Facial Feedback Hypothesis
82
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
82
