在物联网环境中实现实时多模态情绪识别的多尺度时间融合网络
1Gyeongbuk Development Institute, 201 Docheong-daero, Homyeong-eup, Yecheon 36849, Gyeongsangbuk-do, Republic of Korea.
Sensors (Basel, Switzerland)
|August 28, 2025
概括
EmotionTFN是一种新的架构,通过在各种时间尺度上融合多传感器数据来增强物联网 (IoT) 情感识别. 在边缘设备上实现高精度和效率,确保隐私.
科学领域:
- 人工智能
- 人与计算机的交互
- 信号处理
背景情况:
- 物联网中的情感识别面临着各种传感器数据和时间尺度的挑战.
- 现有的方法难以在资源有限的物联网设备上平衡精度,延迟和能源效率.
- 处理多模式传感器数据 (生理,视觉,音频) 需要复杂的融合技术.
研究的目的:
- 介绍一下EmotionTFN, 这是一个新的层次时间融合网络,
- 在边缘设备上有效部署情绪识别系统.
- 验证拟议架构的性能和实际应用.
主要方法:
- 开发了具有层次时间注意力的情感多尺度时间融合网络 (EmotionTFN).
- 在短期,中期和长期时间窗口中整合生理 (EEG,PPG,GSR),视觉和音频数据.
- 应用边缘计算优化:模型压缩,量子化和自适应采样.
主要成果:
- 在MELD,DEAP和G-REx数据集上实现了94.2%的分离情感分类准确度和0.087的平均绝对误差.
- 在物联网硬件上证明了200毫秒以下的延迟,能源效率提高了40%.
- 经过验证的现实部署时间为97.2%,用户满意度高 (4.1/5.0).
结论:
- 情感TFN有效地处理多模式传感器数据,以在多个时间尺度上识别物联网情感.
- 边缘计算优化能够在资源有限的设备上高效准确地识别情绪.
- 该系统通过本地数据处理确保用户隐私,同时保持高性能和可靠性.
更多相关视频
05:51Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
9.1K
07:12Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
Published on: August 26, 2016
9.5K
相关概念视频
01:20Labeling Emotion
237
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
237
01:20Physiology of Emotion
1.4K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.4K
01:22Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149