Related Experiment Video
Updated: Mar 29, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Evidence-Guided Diagnostic Reasoning for Pediatric Chest Radiology Based on Multimodal Large Language Models
Yuze Zhao1, Qing Wang2, Yingwen Wang2
1College of Biomedical Engineering, Fudan University, Shanghai 200433, China.
Insights
This study introduces a trustworthy AI diagnostic tool for pediatric chest X-rays, improving accuracy by integrating visual data with clinical information for reliable diagnosis of childhood respiratory diseases.
Area of Science:
- Medical Imaging
- Artificial Intelligence
- Pediatric Pulmonology
Background:
- Pediatric respiratory diseases are a major cause of hospitalization and mortality.
- Chest radiography is the primary imaging tool for pediatric lung assessment.
- Current AI diagnostic tools lack interpretability and clinical trustworthiness.
Purpose of the Study:
- To develop a trustworthy, two-stage AI diagnostic paradigm for pediatric chest X-rays.
- To enhance diagnostic accuracy and clinical workflow alignment.
- To improve the interpretability of AI in pediatric radiology.
Main Methods:
- A two-stage approach: 1) A vision-language model identifies radiological findings from X-rays.
- 2) A multimodal large language model integrates findings, patient data, and medical knowledge (RAG).
- Utilized the VinDr-PCXR dataset for model training and evaluation.
Main Results:
- Achieved 90.1% diagnostic accuracy, 70.9% F1-score, and 82.5% AUC.
- Demonstrated up to a 13.1% increase in diagnostic accuracy compared to existing methods.
- Validated the effectiveness of multimodal reasoning with explicit evidence and domain knowledge.
Conclusions:
- The proposed AI paradigm offers trustworthy and interpretable diagnosis for pediatric chest X-rays.
- This approach shows significant potential for clinical application in pediatric radiology.
- Combining multimodal reasoning with evidence-based knowledge enhances AI diagnostic capabilities.
Abstract:
Pediatric respiratory diseases are a leading cause of hospital admissions and childhood mortality worldwide, highlighting the critical need for accurate and timely diagnosis to support effective treatment and long-term care. Chest radiography remains the most widely used imaging modality for pediatric pulmonary assessment. Consequently, reliable AI-assisted diagnostic methods are essential for alleviating the workload of clinical radiologists. However, most existing deep learning-based approaches are data-driven and formulate diagnosis as a black-box image classification task, resulting in limited interpretability and reduced clinical trustworthiness. To address these challenges, we propose a trustworthy two-stage diagnostic paradigm for pediatric chest X-ray diagnosis that closely aligns with the radiological workflow in clinical practice, in which the diagnosis procedure is constrained by evidence. In the first stage, a vision-language model fine-tuned on pediatric data identifies radiological findings from chest radiographs, producing structured and interpretable diagnostic evidence. In the second stage, a multimodal large language model integrates the radiograph, extracted findings, patient demographic information, and external medical domain knowledge with RAG mechanism to generate the final diagnosis. Experiments conducted on the VinDr-PCXR dataset demonstrate that our method achieves 90.1% diagnostic accuracy, 70.9% F1-score, and 82.5% AUC, representing up to a 13.1% increase in diagnosis accuracy over the state-of-the-art baselines. These results validate the effectiveness of combining multimodal reasoning with explicit medical evidence and domain knowledge, and indicate the strong potential of the proposed approach for trustworthy pediatric radiology diagnosis.

