基于机器学习的耳朵热成像用于感知情绪
Budu Tang1,2, Wataru Sato1,2
1Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8507, Japan.
Sensors (Basel, Switzerland)
|February 27, 2026
概括
热成像可以通过测量耳朵温度来检测情绪. 先进的机器学习模型,特别是深度学习,显示耳朵温度变化和情绪激发之间的非线性关系,优于情绪感知线性方法.
科学领域:
- 心理生理学 心理生理学
- 机器学习 机器学习
- 生物医学工程 生物医学工程
背景情况:
- 热成像提供非接触,光独立的皮肤温度测量,反映自主神经系统活动.
- 以前的研究表明,耳朵温度和情绪兴奋之间存在线性联系,但非线性关系仍未被探索.
- 精确的情绪感知对于各种应用至关重要,包括心理健康监测和人机交互.
研究的目的:
- 调查耳朵热变化和主观情绪兴奋之间的非线性关系.
- 用热成像来比较机器学习模型对情感感知线性回归的性能.
- 通过模型解释,识别与情绪激发相关的特定耳部区域.
主要方法:
- 重新分析了热耳图像和来自观看情感激发电影的参与者的自我报告的兴奋评分.
- 使用线性回归,随机森林和ResNet-50卷积神经网络模型.
- 使用平均平方误差和相关系数评估模型;用梯度加权类激活映射和沙普利增量解释解释最佳模型.
主要成果:
- 这两种机器学习模型在预测兴奋评级方面都显著优于线性回归.
- 与随机森林模型相比,ResNet-50深度学习模型显示出更高的性能.
- 模型解释显示,特定耳部区域的温度变化与主观兴奋水平之间存在非线性关联.
结论:
- 耳部热成像,当与先进的机器学习技术 (如深度学习) 相结合时,显示出对准确的情绪感知有重大前景.
- 非线性建模方法对于捕捉生理信号和主观情绪状态之间的复杂关系至关重要.
- 这项研究强调了热成像作为理解和量化人类情绪的非侵入性工具的潜力.
相关概念视频
01:14Assessing Body Temperature - Tympanic membrane
1.3K
Assessing tympanic membrane temperature involves using a tympanic membrane thermometer (TMT). Here is a step-by-step guide:
Step 1: Begin by practicing good hand hygiene to prevent the transmission of microorganisms.
Step 2: Turn on the thermometer and wait until the ready sign appears on the screen to ensure accurate measurement.
Step 3: Slide the probe cover in place to prevent cross-contamination.
Step 4: Instruct the patient to tilt their head to the side for comfort and check for cerumen...
Step 1: Begin by practicing good hand hygiene to prevent the transmission of microorganisms.
Step 2: Turn on the thermometer and wait until the ready sign appears on the screen to ensure accurate measurement.
Step 3: Slide the probe cover in place to prevent cross-contamination.
Step 4: Instruct the patient to tilt their head to the side for comfort and check for cerumen...
1.3K
01:13Equipments Used to Measure Body Temperature
1.9K
Body temperature can be assessed using various devices and measured in Celsius or Fahrenheit.
Glass-bulb Thermometer:
Glass-bulb thermometers are hollow glass tubes with a bulb tip containing liquid such as ethanol or mercury. Historically, glass bulb mercury thermometers were the standard device to measure body temperature. Today, mercury thermometers are prohibited in many countries due to the hazardous effects of mercury and the risk of exposure if the glass bulb breaks. In general,...
Glass-bulb Thermometer:
Glass-bulb thermometers are hollow glass tubes with a bulb tip containing liquid such as ethanol or mercury. Historically, glass bulb mercury thermometers were the standard device to measure body temperature. Today, mercury thermometers are prohibited in many countries due to the hazardous effects of mercury and the risk of exposure if the glass bulb breaks. In general,...
1.9K
01:19Assessing Body Temperature - Temporal Artery
1.4K
Here is a stepwise guide to assessing the body temperature at the temporal artery using a temporal artery thermometer
Step 1: Perform hand hygiene and don a fresh pair of gloves to prevent cross-infection and ensure patient safety.
Step 2: Explain the procedure to the patient to establish trust. Clear communication establishes trust with the patient, ensures they understand what to expect, promotes cooperation, and enhances comfort during the procedure.
Step 3: Assess the patient's...
Step 1: Perform hand hygiene and don a fresh pair of gloves to prevent cross-infection and ensure patient safety.
Step 2: Explain the procedure to the patient to establish trust. Clear communication establishes trust with the patient, ensures they understand what to expect, promotes cooperation, and enhances comfort during the procedure.
Step 3: Assess the patient's...
1.4K
01:14Temperature Measurement Sites
3.7K
A thermometer measures body temperature. The common sites for measuring body temperature are the oral cavity, axillary region, temporal artery, and skin surface, such as the forehead, abdomen, and axilla. True core body temperature is assessed in the rectum, tympanic membrane, pulmonary artery, esophagus, and urinary bladder.
Oral: When assessing oral temperature, the thermometer tip should be placed under the tongue in the posterior sublingual pocket. It offers accurate readings and can be...
Oral: When assessing oral temperature, the thermometer tip should be placed under the tongue in the posterior sublingual pocket. It offers accurate readings and can be...
3.7K
01:43Thermosensation
34.1K
Peripheral thermosensation is the perception of external temperature. A change in temperature (on the surface of the skin and other tissues) is detected by a family of temperature-sensitive ion channels called Transient Receptor Potential, or TRP, receptors. These receptors are located on free nerve endings. Those detecting cold temperatures are closer to the surface of the skin than the nerve endings detecting warmth. These thermoTRP channels, while temperature selective, have relatively...
34.1K
01:20Labeling Emotion
779
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
779