相关实验视频
Updated: Jul 1, 2025

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.0K
基于多层语义融合的交叉模式情感识别的研究
1College of Information Engineering, Shanghai Maritime University, Shanghai 201306, China.
Mathematical biosciences and engineering : MBE
|March 8, 2024
概括
这项研究引入了一种新的跨模态情绪识别模型 (CM-MSF) 用于先进的多模态情绪分析. CM-MSF模型有效地整合了各种数据源,在情绪分类中实现了高准确度.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 情感计算是一种情感计算.
背景情况:
- 多模式情绪分析整合了各种数据,以提高理解.
- 现有的方法面临信号异质性和噪音数据的挑战.
- 先进的特征提取和融合对于准确的情感识别至关重要.
研究的目的:
- 提出基于多层语义融合 (CM-MSF) 模型的交叉模式情绪识别.
- 为了利用适应性特征提取的模式间互补性.
- 为了提高准确性和减少错误判断的情绪分类.
主要方法:
- 一个并行的深度学习模块,用于从单个模式中成本效益高,深入地提取功能.
- 使用双向长短期存储器 (BILSTM) 和卷积1D (ConV1d) 进行跨模式融合的级联交叉模式编码器.
- 面罩式聚变网络 (MGF模块) 用于适应性信息选择和流量控制.
主要成果:
- 在CMU-MOSI和CMU-MOSEI数据集上,CM-MSF模型实现了高性能.
- 二进制分类准确率达到89.1% (CMU-MOSI) 和88.6% (CMU-MOSEI). 通过使用二进制分类,分类的准确率达到89.1% (CMU-MOSI).
- F1得分分别为87.9% (CMU-MOSI) 和88.1% (CMU-MOSEI),证明了它的有效性.
结论:
- CM-MSF模型有效地整合了多式联络信息,以实现更高水平的情感识别.
- 拟议的融合战略解决了信号异质性和冗余信息的挑战.
- 实验结果验证了模型在分类情绪方面的准确性和稳定性.
更多相关视频
相关概念视频
Cognitive Theories: Schachter-Singer Theory of Emotion
393
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
393
Multi-input and Multi-variable systems
106
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
106
Association Areas of the Cortex
5.3K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.3K
Introduction to Special Senses
5.8K
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive...
5.8K
Labeling Emotion
139
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
139
Parallel Processing
151
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
151

