对于文本生成的噪音语境学习的双重偏差
Siqi Liang1, Sumyeong Ahn2, Paramveer S Dhillon1
1University of Michigan, Ann Arbor, MI, USA.
概括
这项研究引入了一种新的方法,用于识别环境学习 (ICL) 的噪音数据. 我们的方法准确地检测出有缺陷的演示,即使是高噪音,提高ICL的性能.
科学领域:
- 人工智能的人工智能
- 自然语言处理自然语言处理.
背景情况:
- 在语境学习 (ICL) 取决于高质量的数据.
- 当前用于使用困难度检测噪音数据的方法在噪音水平高时失败.
研究的目的:
- 解决ICL中现有的基于困难的噪声检测方法的局限性.
- 开发一个可靠的指标来识别样品的清洁度,无论体内的噪声水平如何.
主要方法:
- 从注释和LLM领域知识中重新检查了困惑性偏见.
- 引入了一种使用合成邻居来纠正困惑的双重偏移框架.
- 开发了一个强大的样本清洁度得分.
主要成果:
- 拟议的样本清洁度评分准确地识别了不同噪音比率的噪音样本.
- 与现有方法相比,该方法展示了优越的噪音检测能力.
- 使用拟议方法的ICL性能与使用完全干净的数据集相当.
结论:
- 双偏移框架有效地克服了在杂的ICL环境中的困惑偏差.
- 样本清洁度得分提供了可靠的数据质量衡量标准.
- 这种方法提供了强大的性能,即使在演示数据中噪音比率非常高.
相关概念视频
Self Within Cultural Contexts
243
Cultural frameworks for understanding the self are often categorized into two broad orientations: individualism and collectivism. These paradigms influence how people define themselves, relate to others, and interpret their social worlds. Each orientation offers distinct perspectives on autonomy, responsibility, and the role of the individual within a community.Individualistic CulturesIn individualistic cultures like North America and Western Europe, identity is understood as autonomous and...
243
Impact of Social Context on Individuals
347
Social psychology examines how the real or imagined presence of others influences individuals' thoughts, feelings, and behaviors. A key concept in this field is the role of social context in shaping behavior. The same individual may act differently depending on the social setting, due to the varying expectations and norms associated with each environment. This context-dependent behavior illustrates the influence of social roles, which prescribe appropriate conduct in specific situations.Social...
347
Avoidance Learning and Learned Helplessness
2.6K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.6K
Vygotsky's Cognitive Development in Cultural Context
1.1K
Lev Vygotsky, a pioneering Russian psychologist, developed a theory of cognitive development that centers on the influence of social and cultural factors. Unlike Jean Piaget, who emphasized the child's direct interaction with the physical world as key to development, Vygotsky argued that cognitive growth is an interpersonal process that unfolds within a cultural context. For Vygotsky, a child's learning cannot be separated from their social environment, which includes the values,...
1.1K
Associative Learning
1.5K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.5K
Purposive Learning
518
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
518


