相关实验视频

Updated: Jan 16, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

迷失在禾中:较小的针头对于LLM来说更难找到

Owen Bianchi^1,2, Mathew J Koretsky^1,2, Maya Willey^1,2

¹Center for Alzheimer's Disease and Related Dementias, NIA, NIH.

|October 1, 2025

概括

较小的黄金语境降低了大型语言模型 (LLM) 在草堆中的针头任务中的性能. 这增强了位置敏感性,挑战了整合各种信息的代理系统.

科学领域:

人工智能的人工智能
自然语言处理自然语言处理.
机器学习机器学习

背景情况:

大型语言模型 (LLM) 难以处理"禾中的针"任务,需要从广泛的环境中检索信息.
之前的研究确定了位置偏差和分散注意力的数量作为关键性能因素.
黄金背景大小对LLM绩效的影响仍未得到充分探索.

研究的目的:

系统地研究金色背景长度变化如何影响长背景问题答案中的LLM表现.
量化黄金背景大小与模型准确性之间的关系.

主要方法:

在长文本问题答案任务中进行了不同金色背景长度的实验.
绩效被评估在三个领域:一般知识,生物医学推理和数学推理.
使用了各种架构和尺寸的七个最先进的LLM.

主要成果:

随着黄金背景大小的减少,LLM业绩显著下降.
较小的黄金背景始终会降低性能,增加位置灵敏度.
这种效应在所有测试的领域和LLMs中观察到.

结论:

黄金上下文大小是一个关键的,但被忽视的因素,在长时间上下文QA的LLM绩效.
减少黄金背景大小对需要合成分散信息的代理系统构成重大挑战.
调查结果为开发更强大,更具背景意识的LLM驱动系统提供了关键的见解.

更多相关视频

Personalized Needles for Microinjections in the Rodent Brain

Personalized Needles for Microinjections in the Rodent Brain

Published on: January 24, 2018

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Published on: April 14, 2023

相关概念视频

Improving Translational Accuracy

Improving Translational Accuracy

Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...

Improving Translational Accuracy

Improving Translational Accuracy

Language Development

Language Development

Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...