检索增强科学索赔验证检索
Hao Liu1, Ali Soroush2, Jordan G Nestor2
1School of Computing, Montclair State University, Montclair, NJ 07043, United States.
JAMIA open
|March 8, 2024
概括
这项研究介绍了CliVER,CliVER是使用PubMed摘要验证科学主张的自动化系统. CliVER有效地检索和分析临床试验数据,证明了有效和准确的科学索赔评估的潜力.
科学领域:
- 生物医学信息学 生物医学信息学
- 医疗保健中的人工智能
- 临床试验数据分析
背景情况:
- 自动化验证科学主张对于基于证据的医学至关重要.
- 现有的方法在处理大量生物医学文献时往往缺乏效率.
- PICO框架为评估临床证据提供了一个结构化的方法.
研究的目的:
- 开发和评估一个自动化系统,CliVER,用于使用PubMed摘要验证科学主张.
- 利用检索增强技术来有效地提取信息和评估索赔.
- 为培训和验证系统创建一个专门的数据集 (CoVERt).
主要方法:
- 开发了CliVER,一个集检索增强技术,句子提取和PICO框架分析的系统.
- 使用了一组深度学习模型来分类索赔支持,反驳或中立性.
- 构建了COVERt数据集,其中包含15个COVID-19药物声明和96个标记的临床试验摘要.
- 评估了CliVER在CoVERt和SciFact数据集上的标签预测准确性.
主要成果:
- 在标签预测的COVER数据集上,CliVER获得了0.92的F1得分.
- 整体模型在F1评分中超过了单个最先进的模型3-11% .
- 与临床医生相比,CliVER在抽象检索中显示了79.0%的精度,在句子选择中显示了67.4%,在标签预测中显示了63.2%.
结论:
- 通过利用PubMed摘要和提取增强策略,CliVER在自动化科学主张验证方面表现有前途.
- 该系统的性能表明,利用临床试验数据进行索赔评估是一种可行的方法.
- 需要进一步的研究来探索CliVER的全部临床效用.
相关概念视频
Retrieval
112
Retrieval is the process of getting information out of memory storage and back into conscious awareness. This ability is essential for daily tasks like brushing hair and teeth, driving to work, and performing job duties. Retrieval occurs in three ways: recall, recognition, and relearning.
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
112
The Scientific Method
226.7K
The scientific method is a detailed, empirical problem-solving process used by biologists and other scientists. This iterative approach involves formulating a question based on observation, developing a testable potential explanation for the observation (called a hypothesis), making and testing predictions based on the hypothesis, and using the findings to create new hypotheses and predictions.
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
226.7K
Inductive Reasoning
60.4K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
60.4K
Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
Synaptic Signaling
5.5K
Neurons communicate at synapses, or junctions, to excite or inhibit the activity of other neurons or target cells, such as muscles. Synapses may be chemical or electrical.
Most synapses are chemical, meaning an electrical impulse or action potential spurs the release of chemical messengers called neurotransmitters. The neuron sending the signal is called the presynaptic neuron, and the neuron receiving the signal is the postsynaptic neuron.
The presynaptic neuron fires an action potential that...
Most synapses are chemical, meaning an electrical impulse or action potential spurs the release of chemical messengers called neurotransmitters. The neuron sending the signal is called the presynaptic neuron, and the neuron receiving the signal is the postsynaptic neuron.
The presynaptic neuron fires an action potential that...
5.5K
The Availability Heuristic
6.0K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.0K


