通过个性化皮肤集成的无线面部接口编码多模式情感信息
Jin Pyo Lee1,2, Hanhyeok Jang1, Yeonwoo Jang1
1School of Material Science and Engineering, Ulsan National Institute of Science and Technology, Ulsan, 44919, South Korea.
Nature communications
|January 15, 2024
概括
这项研究引入了一种使用皮肤集成面部接口 (PSiFI) 的新型多模式人体情绪识别系统. 该系统准确地实时识别情绪,即使戴着面具,也能增强人机交互.
科学领域:
- 人与计算机的互动.
- 情感计算是一种情感计算.
- 可穿戴式传感器技术的技术.
背景情况:
- 人类情绪对于有效的人机交互至关重要,但很难解释.
- 现有的方法与情感表达的抽象和模两可的性质作斗争.
- 准确的情绪识别需要整合口头和非口头的线索.
研究的目的:
- 开发一种用于增强人类情绪识别的多模式系统.
- 整合语言和非语言表达数据进行全面的情感分析.
- 为了实现实时情绪识别,以改善人机交互.
主要方法:
- 开发一种自动供电,可拉伸,透明的个性化皮肤集成面部接口 (PSiFI).
- 整合了一种新的双向 triboelectric 应变和振动传感器,用于捕获口头和非口头数据.
- 使用机器学习算法与数据处理电路用于无线,实时情绪识别.
主要成果:
- 通过PSiFI系统,首次成功地结合了口头和非口头表达的数据.
- 实时,准确的人类情绪识别得到了实现,即使参与者戴着口罩.
- 在虚拟现实 (VR) 环境中演示了一个数字礼宾应用程序.
结论:
- 开发的多模式系统为实时情绪识别提供了强大的解决方案.
- PSiFI技术推动了情感计算和人机交互领域的发展.
- 该系统在各种领域都有潜在的应用,包括VR和数字辅助.
相关概念视频
Facial Feedback Hypothesis
154
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
154
Emotional Expression
225
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
225
Sensory Functions of the Skin
5.0K
The skin is the largest organ of the human body and plays a crucial role in our sensory perception. It contains a vast network of sensory receptors that contribute to the skin's protective function by perceiving physical, biological, and environmental cues and generating relevant responses.
There are two main categories of receptors on the skin: capsulated and non-capsulated. The non-capsulated ones are mainly the pain receptors. The capsulated ones can be further categorized based on the...
There are two main categories of receptors on the skin: capsulated and non-capsulated. The non-capsulated ones are mainly the pain receptors. The capsulated ones can be further categorized based on the...
5.0K
Therapeutic Communication
4.5K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
4.5K


