基于LLM的姿势规范化和多模式融合,用于在极端姿势中识别面部表情
Bohan Chen1, Bowen Qu1, Yu Zhou1
1School of Information Engineering, Zhongnan University of Economics and Law, Wuhan 430073, China.
Journal of imaging
|January 27, 2026
概括
本研究引入了一种新的面部表情识别 (FER) 方法,该方法将个人资料图像转换为正面视图,并使用多式学习. 这种方法显著提高了非正面面部图像的准确性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
背景情况:
- 面部表情识别 (FER) 系统在非正面或旋转面部时难以准确.
- 目前的FER方法受到姿势变化的限制,阻碍了现实世界的应用.
研究的目的:
- 通过应对巨大的姿势变化所带来的挑战,提高FER的准确性.
- 开发一种强大的FER方法,能够识别来自个人资料和大角度旋转面部图像的表情.
主要方法:
- 提出了一种新的FER方法,结合了形状到正面图像的转换和多式模式学习.
- 使用Qwen-Image-Edit将个人资料图片转换为正面视图,保留表情特征.
- 采用了视觉语言联合学习的CLIP模型,以改善表达特征的语义表示.
主要成果:
- 在基准数据集上实现了高精度:RAF (89.39%),EXPW (67.17%) 和AffectNet-7 (62.66%).
- 与现有的FER方法相比,表现出优越的性能,特别是在具有挑战性的位置上.
结论:
- 拟议的专业到前线转型和多模式学习方法有效地减轻了FER中存在的变化问题.
- 这种方法为实际和准确的面部表情识别系统提供了显著的进步.
更多相关视频
05:51Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
9.4K
05:38Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
2.8K
相关概念视频
Muscles for Facial Expressions
4.8K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
4.8K
Nuclear Fusion
33.8K
The process of converting very light nuclei into heavier nuclei is also accompanied by the conversion of mass into large amounts of energy, a process called fusion. The principal source of energy in the sun is a net fusion reaction in which four hydrogen nuclei fuse and ultimately produce one helium nucleus and two positrons.
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
33.8K
Facial Feedback Hypothesis
651
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
651
Normal Stress
1.4K
Normal stress is a type of stress that occurs when forces act perpendicular, or normal, to a material's cross-sectional area. This stress often arises in structures when subjected to axial loading, which is the application of force along the axis of an object. A practical example of this can be found in bridge truss members.
When a rod is under axial loading, the internal forces and corresponding stress are normal to the plane of the section, so it is termed normal stress. It's important to...
When a rod is under axial loading, the internal forces and corresponding stress are normal to the plane of the section, so it is termed normal stress. It's important to...
1.4K
Absolute and Local Extreme Values
60
The highest and lowest values of a function, relative to a reference axis, are known as extreme values. These include absolute maximum and absolute minimum values, which represent the highest and lowest points the function reaches across its entire domain. Within a restricted portion of the function, the highest and lowest values are referred to as local maximum and local minimum values, respectively.Periodic functions, such as sine and cosine, show extreme values at infinitely many points due...
60
Normal Distribution
17.1K
The normal, a continuous distribution, is the most important of all the distributions. Its graph is a bell-shaped symmetrical curve, which is observed in almost all disciplines. Some of these include psychology, business, economics, the sciences, nursing, and, of course, mathematics. Some instructors may use the normal distribution to help determine students’ grades. Most IQ scores are normally distributed. Often real-estate prices fit a normal distribution. The normal distribution is...
17.1K
