Open LLM-based actionable incidental finding extraction from [18F]fluorodeoxyglucose PET-CT radiology reports
View abstract on PubMed
Summary
This summary is machine-generated.A new pipeline using a large language model (LLM) effectively extracts actionable incidental findings (AIFs) from [18F]FDG PET-CT reports. This AI tool aids in clinical alerts and managing patient comorbidities.
Area Of Science
- Medical Imaging Analysis
- Artificial Intelligence in Healthcare
- Natural Language Processing
Background
- [18F]fluorodeoxyglucose positron emission tomography-computed tomography ([18F]FDG PET-CT) reports frequently contain actionable incidental findings (AIFs) that impact patient management.
- Automated extraction of AIFs from these reports is crucial for timely clinical intervention.
- Current methods for AIF identification are often manual and time-consuming.
Purpose Of The Study
- To develop and evaluate an open, large language model (LLM)-based pipeline for extracting AIFs from [18F]FDG PET-CT reports.
- To enable both short-term clinical applications (e.g., alerts) and long-term research using structured AIF data.
- To assess the performance of the LLM pipeline on both internal and external datasets.
Main Methods
- A pipeline was created using an LLM fine-tuned with QLoRA and chain-of-thought (CoT) prompting on annotated [18F]FDG PET-CT reports.
- The pipeline classifies reports for AIFs, extracts relevant sentences, and stores findings in JSON format.
- Performance was evaluated using F1 scores on internal and external test datasets, with both quantitative and qualitative analyses.
Main Results
- The pipeline achieved high document-level F1 scores (0.917 on internal, 0.79 on external test datasets).
- Sentence-level F1 scores were 0.754 (internal) and 0.522 (external), with qualitative analysis indicating practical utility exceeding quantitative scores.
- Llama-3.1-8B Instruct, adapted with QLoRA and CoT prompting, demonstrated optimal performance and efficiency.
Conclusions
- A QLoRA-adapted LLM with CoT prompting can reliably extract AIF information from PET-CT reports.
- The developed pipeline offers significant potential for clinical decision support, including alerts and reminders.
- The model's effectiveness in extracting AIFs can aid in managing patient comorbidities and improving healthcare outcomes.
Related Concept Videos
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Positron Emission Tomography (PET) is a medical imaging technique that provides crucial insights into the body's physiological functions at a molecular level. It is an indispensable resource for diagnosing, staging, and monitoring various illnesses, notably cancer, neurological disorders, and cardiovascular conditions.
Fundamental Principles of PET
Radioactive Tracer: PET involves using biologically active molecules labeled with radioactive isotopes, known as tracers or radiotracers. The...

