Comparison of artificial intelligence models and physicians in patient education for varicocele embolization: a double-blind randomized controlled trial
View abstract on PubMed
Summary
This summary is machine-generated.Artificial intelligence (AI) models, like Gemini, outperformed a physician in educating patients about varicocele embolization, showing superior academic accuracy and empathy. This suggests AI can enhance patient education in interventional radiology.
Area Of Science
- Medical Imaging and Interventional Radiology
- Artificial Intelligence in Healthcare
- Patient Education and Communication
Background
- Few studies compare large language models (LLMs) with clinicians in patient information delivery.
- Evaluating AI performance is crucial for developing hybrid informational systems.
- Varicocele embolization patient education needs rigorous assessment.
Purpose Of The Study
- To compare AI models and clinical specialists in informing patients about varicocele embolization.
- To establish an evidence base for AI-assisted patient education.
- To assess AI's academic accuracy and empathetic communication.
Main Methods
- Prospective, double-blind, randomized controlled trial.
- 25 frequently asked questions on varicocele embolization were answered by 3 AI models and 1 interventional radiologist.
- Responses were evaluated by 2 independent radiologists on academic accuracy and empathy using a 5-point Likert scale.
Main Results
- Gemini AI achieved the highest scores for academic accuracy (4.09) and empathy (3.54).
- AI models, including Copilot and ChatGPT, generally scored higher than the comparator physician in accuracy and empathy.
- Statistically significant differences were found across groups for both academic accuracy and empathy.
Conclusions
- AI models, particularly Gemini, demonstrate superior performance in academic accuracy and empathetic communication for varicocele embolization patient education compared to a physician.
- AI holds significant potential to augment patient education systems in interventional radiology.
- Findings support the development of hybrid AI-clinician patient education models.
Related Concept Videos
Varicose veins, or varicosities, develop when the valves in the veins, which control blood flow, weaken or damage. It causes blood to pool and the veins to enlarge. Understanding the clinical manifestations, diagnostic approaches, and management options for varicose veins is crucial for effective treatment and relief.Clinical manifestationsClinical manifestations of varicose veins include a heavy, achy feeling or pain after prolonged standing or sitting. This discomfort can often be relieved by...
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.

