实现包容性的系统审查:将预版文章与大型语言模型驱动的评估结合起来
Rui Yang1, Jiayi Tong2, Haoyuan Wang3
1Centre for Quantitative Medicine, Duke-NUS Medical School, Singapore, 169857, Singapore.
Journal of the American Medical Informatics Association : JAMIA
|August 31, 2025
概括
我们开发了AutoConfidenceScore来预测预印出版, 这种自动化框架通过评估预打印质量和减少手工工作来增强证据综合.
科学领域:
- 医学研究
- 证据综合
- 科学交流
背景情况:
- 系统审查需要及时的证据,但预印质量不同.
- 预版文章可以加速知识的传播,但缺乏同行评审.
- 评估系统审查的预印质量是一项挑战.
研究的目的:
- 开发一个预测预印出版的自动化框架.
- 提高系统审查中的证据综合的效率和准确性.
- 减少预印质量评估的手工负担.
主要方法:
- 开发了自动信心评分 (自动信心评分) 框架.
- 通过自然语言处理利用自动数据提取.
- 包含语义嵌入和大语言模型 (LLM) 驱动的评估分数.
- 使用随机森林和生存治疗模型进行预测.
主要成果:
- 随机森林分类器获得了0.747的AUROC.
- 生存治疗模型实现了0.731的AUROC二元结果.
- 对于发布时间的风险,生存治疗模型的一致性指数为0. 667.
结论:
- 通过自动提取和功能集成, 提升预印预测.
- 结合语义嵌入和LLM评估可以提高预测性能.
- 这种框架可以促进预印入系统审查,提高资源利用率.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
570
09:35A Protocol for Using Gene Set Enrichment Analysis to Identify the Appropriate Animal Model for Translational Research
Published on: August 16, 2017
17.9K
相关概念视频
Improving Translational Accuracy
2.7K
2.7K
Proofreading
54.8K
Overview
54.8K
Review and Preview
7.7K
In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...
Percentiles are a type of fractile that partition data into...
7.7K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
174
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
174
pre-mRNA Processing
53.4K
In eukaryotic cells, transcripts made by RNA polymerase are modified and processed before exiting the nucleus. Unprocessed RNA is called precursor mRNA or pre-mRNA to distinguish it from mature mRNA.
Once about 20-40 ribonucleotides have been joined together by RNA polymerase, a group of enzymes adds a “cap” to the 5’ end of the growing transcript. In this process, a 5’ phosphate is replaced by modified guanosine that has a methyl group attached to it (7-Methyl...
Once about 20-40 ribonucleotides have been joined together by RNA polymerase, a group of enzymes adds a “cap” to the 5’ end of the growing transcript. In this process, a 5’ phosphate is replaced by modified guanosine that has a methyl group attached to it (7-Methyl...
53.4K
Genetic Screens
5.1K
Genetic screens are tools used to identify genes and mutations responsible for phenotypes of interest. Genetic screens help identify individuals or a group of people at risk of developing genetic diseases and help them with early intervention, targeted therapy, and reproductive options.
Forward genetic screens
Forward or “classical” genetic screens involve creating random mutations in an organism’s DNA using radiation, mutagens, or insertion of additional bases, which...
Forward genetic screens
Forward or “classical” genetic screens involve creating random mutations in an organism’s DNA using radiation, mutagens, or insertion of additional bases, which...
5.1K
