系统审查中的新型人工智能应用:GPT-4辅助数据提取,分析,偏差审查
Jin Kyu Kim1,2,3, Michael Erlano Chua4,2, Tian Ge Li2
1Department of Surgery, The Hospital for Sick Children, Toronto, Ontario, Canada kimjink@iu.edu.
BMJ evidence-based medicine
|April 8, 2025
概括
定制GPT-4模型在提取系统性审查 (SRs) 的医疗数据方面表现出强的表现,显示出高一致性和可比效果大小. 这些人工智能工具显示出有助于SRs内部偏差评估的潜力.
科学领域:
- 医疗研究中的人工智能
- 自然语言处理用于证据合成.
背景情况:
- 系统性审查 (SRs) 对基于证据的医学至关重要,但是劳动密集型的.
- 自动化数据提取和偏差风险评估可以加快SR过程.
研究的目的:
- 评估定制GPT-4模型在提取和评估SRs医疗文献中的数据方面的性能.
- 将人工智能驱动的提取和评估与人类执行的系统审查进行比较.
主要方法:
- 针对研究特征,结果,偏见评估领域和偏见评估风险,开发了四种专门的GPT-4模型.
- 模型输出与四个人类进行的SRs的数据进行了比较,包括43个提取研究和17个偏差评估的RCT.
主要成果:
- 在数据提取方面,GPT-4实现了88.6%的一致性,差异低于5%,在2.5%的案例中超过了人类的准确性.
- 对于提取的研究结果,发现了可比的效果大小. 在偏见风险评估方面,GPT-4显示了公平到中等的协议,在某些情况下超过了人类审稿人之间的协议.
结论:
- 定制的 GPT-4 模型显示了精确数据提取和协助系统审查中偏差评估风险的巨大潜力.
- 虽然在更简单的任务上进行了测试,但这些发现代表了在医学文献合成中对AI能力的有价值的初步评估.
相关概念视频
Bias
3.7K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
3.7K
Blind Procedures
10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
Bias in Epidemiological Studies
101
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
101
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
106
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
106
Genome-wide Association Studies-GWAS
12.2K
Genome-wide association studies or GWAS are used to identify whether common SNPs are associated with certain diseases. Suppose specific SNPs are more frequently observed in individuals with a particular disease than those without the disease. In that case, those SNPs are said to be associated with the disease. Chi-square analysis is performed to check the probability of the allele likely to be associated with the disease.
GWAS does not require the identification of the target gene involved in...
GWAS does not require the identification of the target gene involved in...
12.2K
Randomized Experiments
6.6K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.6K


