封闭式多文档查询,测试生成和评估的大型语言模型
Claire Randolph1, Adam Michaleas2, Darrell O Ricke2
1Department of the Air Force, Artificial Intelligence Accelerator, Cambridge, MA, United States.
Frontiers in artificial intelligence
|August 22, 2025
概括
本研究介绍了AIKIT,该解决方案使用大型语言模型 (LLM) 和提取增强生成 (RAG) 来管理复杂的知识. 通过大量不断变化的文档, AIKIT 增强了知识获取和测试生成.
科学领域:
- 人工智能
- 知识管理
- 信息科学
背景情况:
- 技术专业面临的挑战是学习复杂的,不断演变的知识来自大量的,经常更新的文件.
- 创建和修改知识测试需要在广泛的知识库中进行跟踪更新.
- 大型语言模型 (LLM) 为人工智能辅助的知识获取和持续学习提供了框架.
- 获取增强生成 (RAG) 将预先训练的LLM与特定领域的知识库集成.
研究的目的:
- 在大型文件上引入有效的LLM-RAG问答方法 (DaaDy,SQAD).
- 提供知识密集型任务人工智能 (AIKIT) 解决方案,用于管理大量培训和继续教育的文件.
- 提供可在各种系统上部署的开源,容器化解决方案.
主要方法:
- 开发了DaaDy (作为字典的文档) 和SQAD (结构化问题答案字典) 来实现LLM-RAG.
- 创建了一个容器化的开源解决方案AIKIT,集成了LLMs,RAG,矢量存储和Web接口.
- 使用文档细分来改善长源文档的问题覆盖范围.
主要成果:
- 文件细分增强了LLM-RAG产生的问题的覆盖范围,特别是在较长的文件中.
- AIKIT 便于使用多种LLM模型与多种模式的RAG源文件.
- 对于单个或多个LLM模型的查询,AIKIT保留了LLM-RAG的答案.
结论:
- AIKIT提供了一个用户友好的工具包,用于利用LLM-RAG的复杂信息.
- 该解决方案简化了多个LLM模型的集成和使用.
- 通过保留查询答案,AIKIT支持技术领域的持续学习和知识管理.
相关概念视频
Language and Cognition
440
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
440
Improving Translational Accuracy
2.7K
2.7K
Higher Mental Functions of the Brain: Language
1.0K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
1.0K
Multiple Comparison Tests
4.0K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.0K
Language Development
447
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
447
Detection of Gross Error: The Q Test
6.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.4K


