人在循环中的人工智能系统用于系统文献审查:AutoLit审查软件的方法和验证
Kevin M Kallmes1, Jade Thurnham1, Marius Sauca1
1Nested Knowledge St. Paul Minnesota USA.
Cochrane evidence synthesis and methods
|October 27, 2025
概括
本研究介绍了一种人工智能工具AutoLit,它支持人类监督的系统文献审查 (SLR) 的所有阶段. 人工智能工具在搜索,选和提取中显示了显著的时间节约和高准确性,以实现强大的证据合成.
科学领域:
- 科学研究中的人工智能
- 系统性文献审查方法论 方法论
- 证据综合和元分析
背景情况:
- 系统性文献审查 (SLR) 对于证据综合至关重要,但耗时.
- 现有的AI工具只支持单个SLR阶段,而不是完整的工作流.
- 确保SLR发现的质量和准确性需要专家监督.
研究的目的:
- 提出一个全面的方法来进行SLR使用一个集成的人工智能工具与人-in-the-loop策划.
- 通过专家评价验证人工智能工具的性能,并量化节省时间.
- 概述在人工智能辅助的单反相机中保持最佳实践的方法.
主要方法:
- 使用了AutoLit软件,集成AI用于搜索策略生成,双选和证据提取.
- 集成的手动批判性评估和人工智能驱动的网络元分析.
- 进行了验证,将AI性能与人类专家进行比较,评估节省时间和"快速审查"替代方案.
主要成果:
- 人工智能驱动的搜索策略生成实现了76.8-79.6%的回忆.
- 对查的监督机器学习达到82-97%的回忆.
- 证据提取 (PICOs) 显示F1得分为0.74,研究类型,位置和大小准确率分别为74%,78%和91%.
- 在抽象选中节省了50%的时间,在定性提取中节省了70-80%.
结论:
- 人工智能系统,在人类监督下,可以有效地支持高质量的系统文献评论.
- 透明度,可复制性和专家参与是成功的人工智能辅助SLR的关键.
- 该AutoLit方法为高效可靠的证据综合提供了一个框架.
相关概念视频
Non-equilibrium in the Cell
5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K
Review and Preview
8.3K
In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...
Percentiles are a type of fractile that partition data into...
8.3K
Review and Preview
10.8K
Data are individual items of information obtained from a population or sample. Data may be classified as qualitative (categorical), quantitative continuous, or quantitative discrete. Because it is not practical to measure the entire population in a study, researchers use samples to represent the population. A random sample is a representative group from the population chosen by using a method that gives each individual in the population an equal chance of being included in the sample. Random...
10.8K

