对于面部动作单元检测个人独立表示的对比学习
概括
这项研究引入了面部动作单元 (AU) 检测的新型自我监督方法,通过从未标记的视频中学习来解决数据稀缺问题. 该方法提高了AU检测的准确性,大大缩小了监督方法的差距.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 情感计算是一种情感计算.
背景情况:
- 面部动作单元 (AU) 检测对于理解人类情绪和表情至关重要.
- 目前的AU检测方法因缺乏足够的注释面部数据而受到阻碍.
- 自主监督学习为利用大型未标记数据集提供了一个有希望的途径.
研究的目的:
- 从未标记的面部视频中开发一种自我监督的方法来学习强大的面部行动单元 (AU) 表示.
- 为了减轻AU检测中的数据稀缺问题.
- 为了提高AU检测系统的性能.
主要方法:
- 使用对比学习范式,从未标记的面部视频中学习AU表示.
- 基于边缘的时间对比学习方法捕捉了视频剪辑中的时间AU连贯性.
- 交叉身份重建机制通过在不同身份之间对准相似的AU来学习人独立的AU表示.
主要成果:
- 学习的AU表示对面部动作单元检测具有歧视性.
- 拟议的自我监督方法优于现有的对比学习方法.
- 自主监督和监督的AU检测之间的性能差距显著减少.
结论:
- 自主监督学习,特别是使用对比方法,可以有效地从未标记的数据中学习面部AU表示.
- 时间对比学习和交叉身份重建的拟议双重方法增强了AU检测.
- 这项工作为AU检测研究中的数据注释瓶提供了可行的解决方案.
更多相关视频
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
15.8K
06:37Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
Published on: December 15, 2023
3.9K
相关概念视频
Facial Feedback Hypothesis
196
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
196
Muscles for Facial Expressions
2.3K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
2.3K
Association Areas of the Cortex
5.6K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.6K
Observational Learning
246
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
246
Nonconscious Mimicry
4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K
Masking and Demasking Agents
2.5K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.5K
