代理记忆增强检索和医学问答任务的证据依据
Shuyue Jia1, Subhrangshu Bit2, Varuna H Jasodanand3
1Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA.
International journal of medical informatics
|February 19, 2026
概括
基于大型语言模型 (LLM) 构建的新工具使用代理系统在医疗问答任务上表现得更好. 这种人工智能系统通过整合工具和证据来增强医学推理,在关键考试中表现优于独立的LLM.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 在医学问答方面表现有前途.
- 独立的LLM经常与复杂的,多步骤的医学推理作斗争.
- 整合外部工具和证据接地对于提高医学AI可靠性至关重要.
研究的目的:
- 评估基于LLM构建的基于工具的基于代理的系统在医学问答方面是否优于独立的LLM.
- 开发和评估一个基于LLM的开源代理系统,用于动态的,多步骤的医学推理.
主要方法:
- 开发了一个统一的,基于LLM的开源代理系统,包括文档检索,重新排名,证据接地和诊断生成.
- 实现了检索增强生成管道和缓存和修剪内存库,以实现高效的长文本推理.
- 该系统自主调用专用工具,绕过手动提示工程.
主要成果:
- 代理系统在医疗问答基准上取得了很高的准确性:USMLE第一步82.98%和第二步86.24%.
- 在USMLE第1步和第2步的表现超过了GPT-4,而在第3步的表现则与之紧密相匹配.
- 该系统在多选项和开放式格式中表现出优于或与最先进的模型相匹配的性能.
结论:
- 结合工具增强和基于证据的推理策略,对于开发可靠和可扩展的医疗人工智能系统是有价值的.
- 基于代理的LLM系统提供了一种有前途的方法,可以在复杂的医学推理任务中增强AI能力.
- 开发的系统提供了一个开源框架,用于在医疗问题答案中推进人工智能.
相关概念视频
The Availability Heuristic
7.1K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
7.1K
Retrieval
473
Retrieval is the process of getting information out of memory storage and back into conscious awareness. This ability is essential for daily tasks like brushing hair and teeth, driving to work, and performing job duties. Retrieval occurs in three ways: recall, recognition, and relearning.
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
473
Higher Mental Functions of Brain: Learning and Memory
2.2K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
2.2K
Eyewitness Memory
520
Eyewitness memory refers to the recollection of events by someone who has directly witnessed them, often serving as critical evidence in legal settings. This type of memory is commonly used in criminal cases where a witness describes details like a suspect's appearance, clothing, or behavior during a crime. However, despite its perceived reliability, eyewitness memory is prone to significant errors.
One such error is memory distortion, which occurs because human memory does not function...
One such error is memory distortion, which occurs because human memory does not function...
520
Explicit Memories
489
Explicit memories, also known as declarative memories, are consciously remembered, recalled, and reported. Studying for a chemistry exam involves material that will become part of explicit memory. There are two types of explicit memory: episodic and semantic.
Episodic memory contains information about personally experienced events and is reported as a story. An example of episodic memory is recalling a birthday celebration. This type of memory includes the what, where, and when of an event, as...
Episodic memory contains information about personally experienced events and is reported as a story. An example of episodic memory is recalling a birthday celebration. This type of memory includes the what, where, and when of an event, as...
489
Role of Amygdala in Memory
1.3K
The amygdala is a small, almond-shaped structure responsible for processing and storing memories, particularly those linked to emotions like fear and stress. It plays an essential role in the brain's response to emotionally significant events and often enhances memory formation by triggering stress hormone release. The amygdala is vital for encoding and retrieving memories associated with fear or stress, a process that is adaptive by helping organisms avoid dangerous situations.
One of the...
One of the...
1.3K


