多任务学习用于方面级语义分类,结合复杂的方面目标语义增强和自适应的本地焦点
Quan Zhu1,2, Xiaoyin Wang2, Xuan Liu1,2
1China Aerospace Academy of Systems Science and Engineering, Beijing 100048, China.
Mathematical biosciences and engineering : MBE
|December 5, 2023
概括
本研究引入了一种增强的BERT模型,通过丰富培训数据和完善方面目标识别来改进基于方面的情绪分析 (ABSA). 新方法在多个数据集上实现了卓越的性能.
科学领域:
- 自然语言处理自然语言处理.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 基于方面的情绪分析 (ABSA) 需要细粒度的情绪检测.
- 目前的深度学习模型在有限的训练数据上扎,对于颗粒式的ABSA.
研究的目的:
- 开发一个基于BERT的增强模型,用于多维的目标语义学习.
- 为解决ABSA缺乏精细的培训机构的问题.
主要方法:
- 利用BERT预训练和微调来获得丰富的语义特征.
- 实现面向目标的复杂语义增强,以优化企业.
- 将视角识别增强与有条件随机场 (CRF) 模型相结合,用于可靠的实体识别.
- 利用适应性局部注意力机制,针对侧面目标进行专注的情绪分析.
- 优化多任务学习的联合培训机制.
主要成果:
- 拟议的模型显著提高了ABSA在多个中文和英语数据集的性能.
- 与最先进的模型相比,这些方法在多任务和单任务场景中都显示出优异的结果.
- 增强的语义学习和注意力机制有助于更准确的面向目标识别和情绪分析.
结论:
- 基于BERT的增强模型有效地解决了细粒度ABSA的挑战.
- 语义增强和适应性注意力机制对于提高ABSA模型准确性至关重要.
- 拟议的方法为基于方面的情绪分析提供了一个强大的解决方案,特别是在有限的细粒度数据下.
相关概念视频
Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
Purposive Learning
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a bonus...


