2つの大きな言語モデルを使用して臨床ガイドライン情報を抽出する:評価研究
Hsing-Yu Hsu1,2, Lu-Wen Chen3, Wan-Tseng Hsu1
1Graduate Institute of Clinical Pharmacy, College of Medicine, National Taiwan University, Taipei, Taiwan.
Journal of medical Internet research
|September 5, 2025
まとめ
2つの高度な大型言語モデル (LLM) は,意思決定支援システムの臨床ガイドライン (PGx) を効率的に更新し,手動レビューの必要性とコストを大幅に削減します.
科学分野:
- ファルマゲノミクス (PGx)
- 人工知能 (AI)
- 臨床的意思決定支援システム (CDSS)
背景:
- 効果的なパーソナライズド・ファーマコゲノミクス (PGx) は,臨床ガイドラインを意思決定支援システムに統合する必要があります.
- 大型言語モデル (LLM) は,PGx情報の抽出と更新を自動化する可能性を秘めています.
- 手動でPGxのガイドラインを検証することは,時間と資源を要するものです.
研究 の 目的:
- PGxの臨床ガイドラインを更新するために2つの高度なLLMを使用して,繰り返しクロス比較と合意値戦略の有効性を評価する.
- PGxガイドラインの抽出と分類におけるGPT-4oとGemini-1.5-Proのパフォーマンスを評価する.
- 臨床実務への PGx ガイドラインの統合を簡素化する LLM の可能性を決定する.
主な方法:
- 2つのLLM (GPT-4o,Gemini-1.5-Pro) は385のPGx臨床ガイドラインを分類し,それぞれモデルごとに20回テストした.
- 戦略は繰り返しクロス比較を行い,不一致を指摘するために一貫性の値 (予測<60%の合意) を設定した.
- 精度評価のため,LLMの出力を専門家による注釈データと比較した.
主要な成果:
- 2つのLLMで高い再現率を達成した (GPT-4o: 97.8%,Gemini-1.5-Pro: 98.9%).
- LLMは専門家ラベルと比較して高い精度を示した (GPT-4o: 93.5%,Gemini-1.5-Pro: 92.7%).
- 一貫した予測は,最小のエラー率 (0.3-0.5%) と非常に低いコスト (0.76米ドル) で,手動レビューの必要性を88.6%削減しました.
結論:
- 2つのLLMを使用することで,臨床的意思決定支援のためのPGxガイドラインを更新するための費用対効果の高いスケーラブルな方法が提供されます.
- LLMによる自動分類は,手動のレビューの負担を大幅に軽減し,臨床適用性を高めます.
- 精度を確保するために選択的な手動レビューは依然として重要ですが,このLLM主導のアプローチはPGxガイドラインの統合を最適化します.
さらに関連する動画
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
565
07:50A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
Published on: September 20, 2018
16.0K
関連する概念動画
01:11Clinical Trials: Overview
3.4K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
3.4K
01:16Clinical Trials
7.5K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
7.5K
02:07Improving Translational Accuracy
11.8K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.8K
01:26Pharmacokinetic Models: Comparison and Selection Criterion
147
Physiological and compartmental models are valuable tools used in studying biological systems. These models rely on differential equations to maintain mass balance within the system, ensuring an accurate representation of the dynamic processes at play.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
147
01:26Guidelines for Nursing Documentation II
1.1K
Effective documentation is an integral part of nursing practice. Here are some essential guidelines to follow when documenting patient care:
Timely documentation is crucial to ensure continuity of care for patients. Any delays in recording or reporting medical information can result in medical errors and even adverse patient outcomes. From medication administration to diagnostic test results, every detail must be accurately and promptly documented to provide the best possible care for patients.
Timely documentation is crucial to ensure continuity of care for patients. Any delays in recording or reporting medical information can result in medical errors and even adverse patient outcomes. From medication administration to diagnostic test results, every detail must be accurately and promptly documented to provide the best possible care for patients.
1.1K
01:11Guidelines for Writing Outcome
3.0K
When developing expected outcomes for a patient care plan, the nurse should adhere to the following recommendations:
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
3.0K