Related Experiment Video
Updated: Feb 12, 2026

13:24
A Procedure to Observe Context-induced Renewal of Pavlovian-conditioned Alcohol-seeking Behavior in Rats
Published on: September 19, 2014
13.3K
Dual Debiasing for Noisy In-Context Learning for Text Generation
Siqi Liang1, Sumyeong Ahn2, Paramveer S Dhillon1
1University of Michigan, Ann Arbor, MI, USA.
Summary
This study introduces a new method to identify noisy data for in-context learning (ICL). Our approach accurately detects flawed demonstrations, even with high noise, improving ICL performance.
Area of Science:
- Artificial Intelligence
- Natural Language Processing
Background:
- In-context learning (ICL) depends on high-quality data.
- Current methods for detecting noisy data using perplexity fail when noise levels are high.
Purpose of the Study:
- To address the limitations of existing perplexity-based noise detection methods in ICL.
- To develop a robust metric for identifying sample cleanliness irrespective of corpus noise levels.
Main Methods:
- Re-examined perplexity biases from annotations and LLM domain knowledge.
- Introduced a dual-debiasing framework using synthesized neighbors to correct perplexity.
- Developed a robust Sample Cleanliness Score.
Main Results:
- The proposed Sample Cleanliness Score accurately identifies noisy samples across varying noise ratios.
- The method demonstrates superior noise-detection capabilities compared to existing approaches.
- ICL performance using the proposed method is comparable to using a fully clean dataset.
Conclusions:
- The dual-debiasing framework effectively overcomes perplexity biases in noisy ICL settings.
- The Sample Cleanliness Score provides a reliable measure of data quality.
- This approach offers robust performance even with extremely high noise ratios in demonstration data.
Related Concept Videos
Self Within Cultural Contexts
243
Cultural frameworks for understanding the self are often categorized into two broad orientations: individualism and collectivism. These paradigms influence how people define themselves, relate to others, and interpret their social worlds. Each orientation offers distinct perspectives on autonomy, responsibility, and the role of the individual within a community.Individualistic CulturesIn individualistic cultures like North America and Western Europe, identity is understood as autonomous and...
243
Impact of Social Context on Individuals
347
Social psychology examines how the real or imagined presence of others influences individuals' thoughts, feelings, and behaviors. A key concept in this field is the role of social context in shaping behavior. The same individual may act differently depending on the social setting, due to the varying expectations and norms associated with each environment. This context-dependent behavior illustrates the influence of social roles, which prescribe appropriate conduct in specific situations.Social...
347
Avoidance Learning and Learned Helplessness
2.6K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.6K
Vygotsky's Cognitive Development in Cultural Context
1.1K
Lev Vygotsky, a pioneering Russian psychologist, developed a theory of cognitive development that centers on the influence of social and cultural factors. Unlike Jean Piaget, who emphasized the child's direct interaction with the physical world as key to development, Vygotsky argued that cognitive growth is an interpersonal process that unfolds within a cultural context. For Vygotsky, a child's learning cannot be separated from their social environment, which includes the values,...
1.1K
Associative Learning
1.5K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.5K
Purposive Learning
518
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
518

