通过大型语言模型加速临床证据合成
Zifeng Wang1,2, Lang Cao1, Benjamin Danek1,2
1Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign, Urbana, IL, USA.
NPJ digital medicine
|August 7, 2025
概括
TrialMind是一个人工智能 (AI) 管道,通过改善系统审查 (SR) 中的研究搜索,选和数据提取来加速临床证据合成. 人类-人工智能与TrialMind的合作显著提高了效率和准确性.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 临床研究方法论 临床研究方法论
背景情况:
- 系统性审查 (SR) 对于临床证据综合至关重要,但耗时.
- 目前用于SR研究的研究识别,选和数据提取的方法面临效率挑战.
研究的目的:
- 介绍TrialMind,一个生成AI管道,旨在自动化和增强SR的关键任务.
- 与人类基线和现有的AI模型相比,评估TrialMind在研究搜索,选和数据提取方面的表现.
主要方法:
- 使用已发表的SR和临床研究开发TrialMind AI管道.
- 创建了TrialReviewBench数据集,包括100个SR和2,220个临床研究.
- 对TrialMind与人类性能和GPT-4在搜索,选和数据提取任务中的性能进行比较分析.
主要成果:
- 在研究搜索中,TrialMind实现了高回忆率 (0.711-0.834),显著超过了人类基线 (0.138-0.232).
- 在研究查方面,TrialMind显示了1.5-2.6倍的改进,在数据提取准确度方面,GPT-4的表现超过了16-32%.
- 使用TrialMind的人类-AI协作导致回忆率增加71.4%,选时间减少44.2%,数据提取精度提高了23.5%,时间减少了63.4%.
结论:
- 在加速临床证据合成方面,TrialMind显示出显著的前景.
- 人类-人工智能与TrialMind的合作提高了系统审查的效率和准确性.
- 医学专家赞成TrialMind合成的证据,表明它有可能提供可靠的临床决策支持.
相关概念视频
Improving Translational Accuracy
2.7K
2.7K
Language Development
450
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
450
Language and Cognition
442
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
442
Clinical Trials: Overview
3.4K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
3.4K
Clinical Trials
8.4K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
8.4K
Statistical Software for Data Analysis and Clinical Trials
789
Statistical software is pivotal in data analysis and clinical trials by providing tools to analyze data, draw conclusions, and make predictions. These software packages range from simple data management applications to complex analytical platforms, supporting various statistical tests, models, and simulation techniques. Their significance lies in their ability to handle vast amounts of data with precision and efficiency, enabling researchers to validate hypotheses, identify trends, and make...
789


