评估一款机器学习工具原型,用于半自动提取系统文献审查的数据
Antonia Panayi1, Katherine Ward2, Amir Benhadji-Schaff3
1Takeda Pharmaceuticals International AG, Thurgauerstrasse 130, 8152, Glattpark-Opfikon, Zurich, Switzerland. antonia.panayi@takeda.com.
Systematic reviews
|October 6, 2023
概括
机器学习模型,特别是带有条件随机场 (CRF) 模型的BERT,在自动化用于系统文献审查 (SLR) 的数据提取方面表现出前途. 这些人工智能工具可以提高科学出版物中识别关键信息的效率和准确性.
科学领域:
- 生物医学信息学 生物医学信息学
- 人工智能在医学中的应用
- 科学文献分析 科学文献分析
背景情况:
- 系统性文献审查 (SLR) 对基于证据的医学至关重要,但由于手工数据提取,它们耗费大量资源.
- 使用机器学习 (ML) 自动识别和提取数据可以显著加快单反相机并减少错误.
研究的目的:
- 评估ML模型的有效性,特别是BERT和双向长期短期记忆,在瘤学和法布里病中提取SLR数据.
- 评估ML模型在识别生物医学实体及其在科学出版物中的关系方面的表现.
主要方法:
- 训练并测试了BERT和双向长期短期记忆模型,使用来自两个单反相机 (瘤学和法布里病) 的手动注释数据进行测试.
- 在大量临床出版物上使用预训练的BERT模型,并通过有条件随机场 (CRF) 模型进行实体分类来增强它.
- 使用F1分数测量模型性能,评估实体识别和关系提取精度.
主要成果:
- 预训练的BERT+CRF模型在实体识别方面取得了最高的表现,F1得分为73% (SLR 1) 和70% (SLR 2).
- 对于特定实体,如无进展生存指标 (F1得分88%) 和患者年龄 (F1得分82%),观察到高精度.
- 使用预训练的BERT进行关系提取,当有足够的训练示例时,F1得分超过90%.
结论:
- 在生物医学文献上培训BERT并将其与CRF模型集成,可显著提高其数据提取性能.
- 机器学习有潜力协助和改进手动数据提取过程,以进一步开发系统文献审查.
相关概念视频
Extraction: Advanced Methods
469
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
469
Systematic Sampling Method
10.4K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
Systematic sampling is one of the simplest methods...
Systematic sampling is one of the simplest methods...
10.4K
Genetic Screens
5.0K
Genetic screens are tools used to identify genes and mutations responsible for phenotypes of interest. Genetic screens help identify individuals or a group of people at risk of developing genetic diseases and help them with early intervention, targeted therapy, and reproductive options.
Forward genetic screens
Forward or “classical” genetic screens involve creating random mutations in an organism’s DNA using radiation, mutagens, or insertion of additional bases, which...
Forward genetic screens
Forward or “classical” genetic screens involve creating random mutations in an organism’s DNA using radiation, mutagens, or insertion of additional bases, which...
5.0K
Data Collection by Experiments
24.3K
Data collection is a systematic method of obtaining, observing, measuring, and analyzing accurate information. An experimental study is a standard method of data collection that involves the manipulation of the samples by applying some form of treatment prior to data collection. It refers to manipulating one variable to determine its changes on another variable. The sample subjected to treatment is known as “experimental units.”
An example of the experimental method is a public...
An example of the experimental method is a public...
24.3K


