证据三角测量器:使用大型语言模型在研究设计中提取和合成因果证据
Xuanyu Shi1,2, Wenjing Zhao1,2, Ting Chen3
1Institute of Medical Technology, Peking University, Beijing, China.
Nature communications
|August 9, 2025
概括
大型语言模型可以通过从研究中提取关键数据来自动化健康研究的证据三角化. 这种方法有助于解决复杂的健康指导,更有效地确定因果关系.
科学领域:
- 卫生研究 卫生研究
- 生物医学干预措施
- 行为干预措施 行为干预
背景情况:
- 与饮食和行为相冲突的健康指导使基于证据的决策变得复杂.
- 需要在各种研究设计中进行证据三角化自动化方法,以平衡偏见并确定因果关系.
- 目前的方法缺乏用于合成复杂科学文献的可扩展性.
研究的目的:
- 评估大型语言模型 (LLM) 在从科学文献中提取本体学和方法学信息方面的表现.
- 为了使健康研究的证据三角化过程自动化.
- 评估LLM在识别暴露-结果关系及其统计意义方面的实用性.
主要方法:
- 使用LLM开发了一种两步的信息提取方法.
- 第一步集中在提取暴露结果概念上.
- 第二步涉及到关系提取,包括效应方向和统计意义.
主要成果:
- 两步LLM提取方法的表现优于一步方法.
- 在识别效应方向 (F1=0.86) 和统计学意义 (F1=0.96) 方面实现了高性能.
- 对盐摄入量和血压的分析显示,盐对血压具有强烈的刺激作用 (942项研究).
结论:
- 通过从科学文献中提取关键数据,LLM可以有效地自动化证据三角化.
- 这种自动化方法通过整合多样化的研究设计来补充传统的元分析.
- 该方法能够快速,动态地评估科学争议,并支持基于证据的健康策略.
相关概念视频
Causality in Epidemiology
834
Causality or causation is a fundamental concept in epidemiology, vital for understanding the relationships between various factors and health outcomes. Despite its importance, there's no single, universally accepted definition of causality within the discipline. Drawing from a systematic review, causality in epidemiology encompasses several definitions, including production, necessary and sufficient, sufficient-component, counterfactual, and probabilistic models. Each has its strengths and...
834
Behavioral Genetics and Its Designs
510
Behavior genetics explores how genetic inheritance influences human behavior. It focuses on how genes, passed from parents to offspring, contribute to the development of behavioral traits and tendencies. This branch of genetics seeks to understand the complex interplay between inherited genetic factors and environmental influences in shaping our behaviors.
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
510
Study Design in Statistics
8.5K
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
8.5K
Criteria for Causality: Bradford Hill Criteria - II
641
The Bradford Hill criteria serve as guidelines for establishing causative links in epidemiological research. Beyond Strength, Consistency, Specificity, and Temporality, key criteria also include Biological Gradient, Plausibility, Coherence, Experiment, and Analogy. These principles assist scientists in assessing the likelihood of causation in complex biological contexts. Below is a summary of these concepts:
641
Crossover Experiments
3.0K
Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in different periods. Crossover experiments are generally used in psychology, the pharmaceutical industry, agriculture, and medicine.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
3.0K
Strategies for Assessing and Addressing Confounding
155
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
155


