一个混合变压器和基于注意力的循环神经网络,用于对推特的强大和可解释的情绪分析
Md Abrar Jahin1,2, Md Sakib Hossain Shovon3,2, M F Mridha4,5
1Department of Industrial Engineering and Management, Khulna University of Engineering & Technology (KUET), Khulna, 9203, Bangladesh.
Scientific reports
|October 22, 2024
概括
新的变压器和基于注意力的双向LSTM用于情感分析 (TRABSA) 模型在情感分析中达到94%的准确性. 这种先进的模型增强了公众论分析和流行病应对系统.
科学领域:
- 自然语言处理自然语言处理.
- 机器学习 机器学习
- 计算社会科学 计算社会科学
背景情况:
- 情绪分析对于了解论和社会趋势至关重要.
- 现有的模型面临着语言多样性,概括性和数据限制的挑战.
研究的目的:
- 引入基于变压器和注意力的双向LSTM用于情感分析 (TRABSA) 模型.
- 为了解决当前情绪分析框架的局限性.
- 为了提高情绪分析的准确性,概括性和解释性.
主要方法:
- 开发了一个混合框架,整合了RoBERTa,注意力机制和BiLSTM.
- 增强数据集,包含来自不同地理位置的40多万条推特.
- 对比了六种词嵌入技术和三种基于词典的标签方法.
- 使用SHAP和LIME进行模型解释.
主要成果:
- TRABSA模型实现了94%的准确性,94%的精度,93%的回忆和94%的F1分数.
- 超过了七个传统的ML,四个堆叠和四个混合深度学习模型.
- 在扩展和外部数据集中表现出一致的优越性和稳定性.
结论:
- 在情绪分析中,TRABSA模型提供了最先进的性能.
- 模型的可解释性提高了对预测的信任和理解.
- 集成到决策支持系统中,它有助于流行病管理和公共响应分析.
相关概念视频
Source Transformation for AC Circuits
538
The process of source transformation in the frequency domain entails the conversion of a voltage source, positioned in series with an impedance, into a current source that is parallel to an impedance, or the other way around. It is essential to maintain the following relationships while transitioning from one source type to another.
538
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
Empathy
9.6K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
9.6K
Classification of Neurotransmitters
2.7K
Neurotransmitters play a crucial role in the communication between neurons in the autonomic nervous system. Neurons in the autonomic nervous system can be cholinergic or adrenergic depending on the neurotransmitters synthesized. Cholinergic neurons use acetylcholine as their primary neurotransmitter. This includes all the preganglionic fibers of the sympathetic and pre- and postganglionic fibers of the parasympathetic nervous systems. In addition, neurons of the somatic nervous system also use...
2.7K
RL Circuit with Source
726
When an RL (Resistor-Inductor) circuit is connected to a DC source, the complete response of the circuit can be divided into two parts: the transient response and the steady-state response.
The transient response of the circuit is its temporary reaction to the sudden application of the DC source. This response is characterized by a current that exponentially decays to zero as time approaches infinity. During this transitional period, the inductor behaves like a short circuit, causing the source...
The transient response of the circuit is its temporary reaction to the sudden application of the DC source. This response is characterized by a current that exponentially decays to zero as time approaches infinity. During this transitional period, the inductor behaves like a short circuit, causing the source...
726
Hybridization of Atomic Orbitals II
31.8K
sp3d and sp3d 2 Hybridization
31.8K


