通过LoRA增强的DinoV2和交互式时空建模进行微表达式识别
Meng Wang1, Xueping Tang1, Bing Wang1
1Faculty of Information Engineering and Automation, Kunming University of Science and Technology, 727 South Jingming Road, Kunming 650500, China.
Sensors (Basel, Switzerland)
|January 28, 2026
概括
本研究介绍了一种使用频率分析和图形网络的微表达式识别 (MER) 架构. 该方法增强了微妙的面部运动检测,在基准数据集上取得了最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 生物识别信息 生物识别信息
背景情况:
- 微表达式识别 (MER) 面临挑战,因为时间短,强度低,空间频率模式复杂.
- 现有的MER方法通常需要大量的预处理和大量的计算资源.
- 微妙的面部纹理变化很难被有效地捕捉和分析.
研究的目的:
- 引入一种新的MER架构,可以提高准确性,同时降低计算成本.
- 集成频域转换和基于图形的时间建模,以实现高效的MER.
- 通过适应空间频率分解来增强对微妙面部运动的敏感性.
主要方法:
- 用LoRA (低级调整) 微调一个大型特征提取模型,以提高计算效率.
- 实施一个空间频率适应 (SFA) 模块来分解和动态权重空间频率.
- 使用动态图表注意时间 (DGAT) 网络,将图表注意网络和LSTM结合起来进行时间建模.
主要成果:
- 拟议的MER架构在SAMM,CASME II和SMIC数据集上实现了卓越的性能.
- 在SAMM 5类设置中,该方法产生了81.16%的未加权F1得分 (UF1) 和85.37%的未加权平均回忆 (UAR).
- 该方法在UF1和UAR方面表现优于现有方法,在UF1和UAR方面表现显著.
结论:
- 新的MER架构有效地解决了短时间,低强度和空间频率变化的挑战.
- 集成频域分析和基于图形的时间建模,为MER提供了高效和准确的方法.
- 拟议的方法显示了对现实世界微表达式分析应用的巨大潜力.
相关概念视频
Self-Evaluation: Self-Enhancement and Self-Verification
5.8K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.8K
Predator-Prey Interactions
21.4K
Predators consume prey for energy. Predators that acquire prey and prey that avoid predation both increase their chances of survival and reproduction (i.e., fitness). Routine predator-prey interactions elicit mutual adaptations that improve predator offenses, such as claws, teeth, and speed, as well as prey defenses, including crypsis, aposematism, and mimicry. Thus, predator-prey interactions resemble an evolutionary arms race.
21.4K
Bioavailability Enhancement: Drug Solubility Enhancement
255
Body:Bioavailability is a critical factor in determining a drug's effectiveness. It refers to the proportion of a drug that enters the circulation when introduced into the body and is, as a result, able to have an active effect. Enhancing bioavailability is essential for drugs with poor solubility, as it can significantly impact their therapeutic efficacy. Various methods are employed to increase the solubility of drugs, thereby enhancing their bioavailability.Micronization and nanonization are...
255
Bioavailability Enhancement: Drug Permeability Enhancement
197
Body:After oral administration, poor permeability often limits the rate at which drugs are absorbed through the intestinal epithelium. Enhancing drug permeability is crucial for effective therapy, and several strategies have been developed to overcome this challenge.One effective strategy involves the use of lipid-based formulations. These formulations enhance dissolution and solubility, targeting physiological mechanisms to increase drug absorption. This includes stimulating bile salt...
197
¹H NMR of Labile Protons: Temporal Resolution
1.7K
Protons bonded to heteroatoms such as nitrogen and oxygen exhibit a range of chemical shift values. This is due to the varying degree of hydrogen bonding between the proton and the heteroatom in other molecules. The extent of hydrogen bonding affects the electron density around the proton, thereby giving different chemical shift values for the protons in the proton NMR spectrum.
The –OH proton in alcohols typically appears in the range of δ 2 to 5 ppm but can vary depending on the specific...
The –OH proton in alcohols typically appears in the range of δ 2 to 5 ppm but can vary depending on the specific...
1.7K
Bioavailability Enhancement: Drug Stability Enhancement and GI Retention
207
Body:Improving a drug's stability in the gastrointestinal (GI) tract is paramount for enhancing its bioavailability and therapeutic effectiveness. Various strategies are employed to protect the drug from the harsh gastric milieu and to ensure its release and absorption at the desired site within the GI tract.Polymer coatings are one such method used to shield drugs from the stomach's acidic environment. By preventing premature drug release, these coatings improve the bioavailability of unstable...
207


