証拠合成の科学のための人工知能: 文献の自動検定に AI によるツールがいかに優れているか
Minghao Ruan1, Junhao Fan2, Mingkai Liu3
1The Third Department of Hepatic Surgery, Eastern Hepatobiliary Surgery Hospital, the Naval Medical University, Shanghai, China.
BMC medical research methodology
|August 26, 2025
まとめ
AIツールは文献のスクリーニングに 有望ですが,まだ単独のソリューションではありません. 人工知能と人間の専門知識を組み合わせたハイブリッドアプローチは,エビデンス合成の効率と精度を高めます.
科学分野:
- 医療情報学
- 研究における人工知能
背景:
- 文献のスクリーニングは証拠の合成に不可欠ですが,時間がかかり,資源が密集しています.
- 人工知能 (AI) は文献のスクリーニングを自動化する可能性を秘めていますが,その正確性と有効性は評価が必要です.
研究 の 目的:
- 文献スクリーニングにおける5つのAIツール (ChatGPT 4.0,Claude 3.5,Gemini 1.5,DeepSeek-V3,RobotSearch) のパフォーマンスを評価する.
- 検診時間とともに,偽陰性分数 (FNF) と偽陽性分数 (FPF) を含む診断精度指標を比較する.
主な方法:
- 1,000本の出版物を用いた診断精度研究
- このコホートは500件のランダム化対照試験 (RCT) と500件の他の出版物から構成された.
- 5つのAIツールは,関連する文献を特定する際のパフォーマンスを評価した.
主要な成果:
- ロボットサーチはRCTで最も低いFNF (6. 4%) を示し,ジェミニは最も高いFNF (13. 0%) を示した.
- 他の出版物では,大型言語モデル (LLM) は,RobotSearch (22.2%) と比較して,かなり低いFPFでした.
- 記事毎のスクリーニング時間は,Gemini (1.2s) とChatGPT (1.3s) が最速であった.
結論:
- AI ツールは文献のスクリーニングにおいて大きな可能性を秘めているが,まだ独立した使用には適していない.
- これらのAIツールは 証拠合成のプロセスにおいて 価値ある補助的な支援として機能できます
- 人工知能と人間の専門知識を統合したハイブリッドアプローチは,文献のスクリーニングの効率と精度を最適化するために推奨されます.
関連する概念動画
Non-equilibrium in the Cell
4.8K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.8K
Significance Testing: Overview
3.8K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.8K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
174
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
174
Improving Translational Accuracy
2.7K
2.7K
Drug Discovery: Overview
8.7K
Drug discovery is a multifaceted process involving extensive screening, testing, and optimization of lead compounds to identify potential new drugs for therapeutic use. It combines several approaches, including screening large numbers of natural products, chemical modification of known active molecules, identification of new drug targets, and rational design based on biological mechanisms and drug-receptor structure. These approaches are carried out in both academic research laboratories and...
8.7K
Bioequivalence: Overview
1.2K
Pharmaceutical equivalents, by definition, are drug products with the same active ingredient in the same quantities, encapsulated in identical dosage forms, and intended for the same administration routes. These pharmaceutical equivalents are deemed bioequivalent if the bioavailability of the active entity in the drug preparations is similar. Moreover, pharmaceutical equivalents demonstrating bioequivalence are also regarded as therapeutically equivalent. This means that when used as directed,...
1.2K


