积极学习模型的表现,以选系统审查中的优先级:对发现相关记录的平均时间进行模拟研究
Gerbrich Ferdinands1, Raoul Schram2, Jonathan de Bruin2
1Department of Methodology and Statistics, Faculty of Social and Behavioral Sciences, Utrecht University, Utrecht, Netherlands. gerbrichferdinands@gmail.com.
Systematic reviews
|June 20, 2023
概括
积极学习模型通过更有效地选,大大减少了系统审查中的工作量. 使用TF-IDF模型的天真贝叶斯表现最好,平均发现时间提供了一种比较模型性能的新方法.
科学领域:
- 信息科学 信息科学 信息科学
- 医疗信息学 医疗信息学
- 计算生物学 计算生物学
背景情况:
- 系统性审查需要大量的努力来进行标题和摘要选.
- 已开发出积极学习工具来加快这一过程,通过使审核员与机器学习软件进行交互来加速这一过程.
- 这些工具旨在在选工作流程的早期确定相关出版物.
研究的目的:
- 综合了解积极学习模型,以减少系统审查工作量.
- 通过模拟研究来评估不同主动学习模型的有效性.
主要方法:
- 一项模拟研究模仿了与主动学习模型互动的人类审查员选.
- 通过TF-IDF和doc2vec特征提取,比较了天真的贝叶斯,后勤回归,支向量机器和随机森林分类器.
- 通过采样节省工作 (WSS),回忆,并引入发现时间 (TD) 和发现平均时间 (ATD) 的指标来评估模型.
主要成果:
- 模型将查减少了63.9%至91.7%,同时实现了95%的召回 (WSS@95).
- 回想一下,在选后,10%的记录在53.6%至99.8%之间.
- 平均发现时间 (ATD) 从1.4%到11.7%不等,表明找到相关记录的决策比例.
结论:
- 积极学习模型显示了减少系统审查选工作负载的巨大潜力.
- 纯粹的贝叶斯+TF-IDF模型展示了最好的整体性能.
- 平均发现时间 (ATD) 是一个有希望的指标,用于评估跨数据集的积极学习模型性能,而无需任意切断.
相关概念视频
Pharmacokinetic Models: Comparison and Selection Criterion
109
Physiological and compartmental models are valuable tools used in studying biological systems. These models rely on differential equations to maintain mass balance within the system, ensuring an accurate representation of the dynamic processes at play.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
109
Study Designs in Epidemiology
288
Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
288
Sensitivity, Specificity, and Predicted Value
513
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
513


