多损失,特征融合和改进的前两个投票组合,用于在野生环境中识别面部表情
Guangyao Zhou1, Yuanlun Xie2, Yiqin Fu3
1School of Computing and Artificial Intelligence, Southwest Jiaotong University, China.
概括
这项研究引入了在野生环境中面部表情识别 (FER) 的新型模型,实现了最先进的准确性. 拟议的R18+FAML和R18+FAML-FGA-T2V模型增强了特征提取和融合,以提高性能.
科学领域:
- 计算机视觉 计算机视觉
- 模式识别 模式识别
- 机器学习 机器学习
背景情况:
- 面部表情识别 (FER) 在自然环境中是一个具有挑战性的计算机视觉任务,因为图像质量低.
- 现有的FER方法在实际应用中缺乏足够的准确性,特别是在低容错的场景中.
- 提高FER的适应性和准确性仍然是一个重要的研究目标.
研究的目的:
- 开发新的单个和组合模型,以增强野生面部表情识别.
- 研究先进的特征聚变技术,以提高FER准确度.
- 在具有挑战性的野生FER数据集上实现最先进的性能.
主要方法:
- 提出了一个单一的模型,R18+FAML,集成基于ResNet18 (R18) 的特征内融合,注意力阻断和多重损失函数 (FAML).
- 开发了一个集合模型,R18+FAML-FGA-T2V,利用通过遗传算法 (FGA) 和改进的前两个投票 (T2V) 策略的网络之间的特征融合.
- 采用战略,通过整合多个网络的兴趣领域,专注于表达意识的领域.
主要成果:
- 单一模型R18+FAML实现了90.32% (RAF-DB),62.17% (AffectNet-8) 和65.83% (AffectNet-7) 的准确率.
- 整体模型R18+FAML-FGA-T2V的准确度达到91.59% (RAF-DB),63.27% (AffectNet-8) 和66.63% (AffectNet-7). 这两种方法的准确度都比较高.
- 两种模型都在测试的挑战性野生FER数据集上展示了最先进的结果.
结论:
- 拟议的R18+FAML和R18+FAML-FGA-T2V模型显著提高了面部表情识别在不受约束的环境中的准确性.
- 内部功能融合,网络功能融合 (FGA) 和整体策略 (T2V) 对于提高FER性能是有效的.
- 开发的模型显示了实际应用的巨大潜力,需要强大的面部表情分析.
更多相关视频
07:12Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
Published on: August 26, 2016
9.4K
03:31Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
Published on: December 15, 2023
470
相关概念视频
Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K
Extraction: Advanced Methods
420
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
420
Association Areas of the Cortex
5.1K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.1K
Improving Translational Accuracy
9.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
9.1K
Reducing Line Loss
144
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
144
Aggregates Classification
305
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
305
