通过多层融合和潜在的dirichlet分配来改善最佳的快速学习
Qinghua Chen1,2,3, Jessica Korneder4, Osamah A Rawashdeh2
1Intelligent Robotics Laboratory, Oakland University, Rochester, MI, United States.
Frontiers in robotics and AI
|June 23, 2025
概括
这项研究引入了一种新的框架,用于使用全球注意力机制 (GAM) 和潜在的迪里克莱特分配 (LDA) 来优化提示,显著提高专业领域的性能.
科学领域:
- 自然语言处理自然语言处理.
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 快速学习 (FSL) 利用预先训练的模型和基于提示的技术来减少微调需求.
- 在FSL中的挑战包括快速优化和专业领域的数据稀缺.
研究的目的:
- 开发一种新的框架,以加强短暂的学习.
- 解决专业领域的快速优化和数据稀缺挑战.
主要方法:
- 一个新的框架,将全球注意力机制 (GAM) 与预先训练的语言模型特征集成.
- 使用隐性狄里克莱特分配 (LDA) 生成的主题特征提升快速优化.
- 将GAM与层特定特征和LDA主题集成为潜在信息提取.
主要成果:
- 拟议的框架在四个数据集中始终优于最先进的基线.
- 在专业领域,特别是在治疗对话分类方面,观察到显著的改善.
- GAM有效地整合了多层功能,并通过LDA主题来增强,以获得卓越的几次射击学习性能.
结论:
- 新的框架有效地解决了少数人学习的关键挑战.
- 集成GAM和LDA提供了一个强大的方法,用于快速优化和特征提取.
- 这种方法显示出强大的应用潜力在专业领域,包括临床环境.
相关概念视频
Associative Learning
605
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
605
Long-term Potentiation
55.9K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
55.9K
Purposive Learning
210
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
210
Introduction to Learning
551
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
551
Observational Learning
321
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
321
Cognitive Learning
668
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
668

