评估克劳德3.7索内特在系统文献评论数据提取自动化中的表现
Ellen Kasireddy1, Cuthbert Chow1, Jun Collet1
1Evidinno Outcomes Research Inc, Vancouver, BC, Canada.
Value in health regional issues
|November 12, 2025
概括
使用Claude 3.7 Sonnet的AI模型有效地自动化了瘤学系统文献评论 (SLR) 的数据提取,实现了高精度和回忆,同时与人类方法相比显著减少了提取时间.
科学领域:
- 医疗研究中的人工智能
- 生物医学信息学 生物医学信息学
- 系统性文献审查自动化 自动化
背景情况:
- 系统性文献审查 (SLR) 对基于证据的医学至关重要,但耗时.
- 在SLR中自动提取数据可以加速研究结果的合成.
- 大型语言模型 (LLM) 显示出提高科学数据处理效率的前景.
研究的目的:
- 评估基于克劳德3.7索内特的AI模型的性能,用于瘤学SLR中的自动数据提取.
- 将人工智能驱动的提取效率和准确性与传统的人工提取方法进行比较.
- 评估SLR中不同数据类别的模型性能.
主要方法:
- 使用Claude 3.7 Sonnet开发了一个AI提取模型,使用主数据列表和瘤SLR进行训练.
- 通过代测试和对七篇全文文章的错误分析来完善模型.
- 用精度,回忆,F1分数和提取时间对20个未见的文章进行性能评估,与人类提取进行基准测试.
主要成果:
- 人工智能模型实现了高整体性能:98.2%的精度,96.6%的回忆率和97.4%的F1得分.
- 研究特征 (98.7%回忆) 和参与者特征 (98.7%回忆) 的提取精度特别强.
- 仅使用人工智能的提取平均每条4.5分钟,比混合 (64.5分钟) 和人类 (240分钟) 方法快得多.
结论:
- 基于Claude 3.7 Sonnet的AI模型在瘤学单反相机中的自动数据提取方面表现出强大的性能.
- 该模型提供了一种高效可靠的解决方案,大大减少了SLR数据提取所需的时间和精力.
- 这种人工智能驱动的方法有可能在各种科学领域的系统审查中得到更广泛的应用.
相关概念视频
Extraction: Advanced Methods
1.1K
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
1.1K
Systematic Sampling Method
12.4K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
Systematic sampling is one of the simplest methods...
Systematic sampling is one of the simplest methods...
12.4K
Statistical Analysis: Overview
14.1K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
14.1K
Regression Analysis
7.9K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
7.9K
Improving Translational Accuracy
3.5K
3.5K
Data Collection III
3.9K
The physical assessment examines the patient for objective data that defines the patient's condition, and aids in formulating the nursing care plan. The purpose of physical assessment is a health status appraisal, which includes identifying health problems, and establishing a database for nursing intervention.
The principles to begin the physical assessment include conducting a comprehensive or problem-related history in a quiet, well-lit room, emphasizing privacy and comfort for the...
The principles to begin the physical assessment include conducting a comprehensive or problem-related history in a quiet, well-lit room, emphasizing privacy and comfort for the...
3.9K


