对于实时面部表情识别的光谱空间特征融合
Jinjing Ma1, Yongcheng Lin2, Lanmei Qian2
1Nantong Institute of Technology, Nantong, 226001, Jiangsu, China. 843731114@qq.com.
Scientific reports
|December 17, 2025
概括
本研究介绍了SPAYOLO,这是一个用于面部表情识别 (FER) 的新型网络,该网络使用空间和频率信息来增强特征提取. 该模型在基准数据集上实现了高精度,同时保持了实时应用的计算效率.
科学领域:
- 计算机视觉 计算机视觉
- 情感计算是一种情感计算.
- 机器学习 机器学习
背景情况:
- 面部表情识别 (FER) 是至关重要的,但目前的方法面临着计算挑战和有限的特征提取.
- 现有的FER模型很难有效地捕捉微妙的空间和基于频率的歧视性特征.
研究的目的:
- 提出SPAYOLO (光谱感知和聚合YOLOv8),一个新的FER网络,解决计算成本和特征提取限制.
- 通过使用新模块系统地建模空间和频率特征来提高FER性能.
主要方法:
- 开发了光谱感知和聚合模块 (SPAM),集成空间特征的层次感知建模 (HRM) 和使用频率特征的快速里埃转换 (FFT) 的频率增强路径 (FEP).
- 实施了门式注意力机制 (GAM),用于空间和频率特征的自适应融合,以提高稳定性.
- 利用YOLOv8架构作为SPAYOLO网络的基础.
主要成果:
- 在FER2013数据集上达到70.74%的准确性,在AffectNet数据集上达到67.88%的准确性.
- 证明了高计算效率,使其适合实时面部表情识别.
- 在FER中验证了层次特征融合和频域增强的有效性.
结论:
- SPAYOLO为面部表情识别提供了一个计算效率高,准确的解决方案.
- 拟议的SPAM模块有效地整合了空间和频域信息,以提高FER性能.
- 研究结果为计算机视觉和情感计算的未来研究提供了宝贵的见解.
相关概念视频
Association Areas of the Cortex
8.7K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
8.7K
Facial Feedback Hypothesis
532
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
532
Muscles for Facial Expressions
4.6K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
4.6K
IR Frequency Region: Fingerprint Region
1.8K
IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the...
1.8K


