Related Experiment Video
Updated: Jun 5, 2026
03:14
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
ChatGPT Versus Custom-Trained Chatbot for Urogynecology Surgery Counseling.
Leanne Brechtel1, Colin Johnson1, Sarah Rabice1
1Division of Urogynecology and Reconstructive Pelvic Surgery, Department of Obstetrics and Gynecology, University of Iowa Hospitals and Clinics, Iowa City, IA.
Urogynecology (Philadelphia, Pa.)
|June 4, 2026
Summary
AI chatbots can generate urogynecologic surgery patient education materials. A specialized FFHA Assistant chatbot showed better accuracy and readability than ChatGPT, aligning with health literacy standards.
Area of Science:
- Urogynecology
- Artificial Intelligence in Healthcare
- Medical Education
Background:
- Patient education materials are crucial for shared decision-making in urogynecologic surgery.
- Traditional materials face challenges in personalization, adaptability, and timely updates.
- Chatbots present a novel method for creating accessible and comprehensive patient information.
Purpose of the Study:
- To compare the performance of ChatGPT and the Foundation for Female Health Awareness (FFHA) Assistant chatbot in generating surgical counseling content.
- To evaluate chatbot-generated content against standardized International Urogynecological Association (IUGA) materials.
Main Methods:
- Seven IUGA handouts on urogynecologic procedures were used as reference.
- Identical prompts were given to ChatGPT-4.0 and the FFHA Assistant.
- Seven urogynecology experts blindedly assessed response accuracy, completeness, and understandability using Likert scales.
- Readability was measured using Flesch-Kincaid Grade Level and Flesch Reading Ease Score.
Main Results:
- ChatGPT-4.0 demonstrated superior completeness compared to IUGA leaflets.
- The FFHA Assistant achieved higher scores in accuracy and understandability.
- Both chatbots produced longer responses than existing IUGA materials.
- FFHA Assistant responses exhibited better readability, aligning with health literacy guidelines.
Conclusions:
- Chatbots can produce patient counseling content on par with or exceeding current materials.
- The FFHA Assistant, a domain-specific chatbot, better adheres to health literacy recommendations.
- Further investigation is required to assess chatbot response reproducibility and clinical impact in patient education.
Related Concept Videos
01:28Urologic Endoscopic Procedure: Cystoscopic Examination
Meaning of Cystoscopic Examination:Cystoscopy is an essential diagnostic tool in urology that is used to assess the structure and function of the genitourinary system. It provides a direct view of the urethra, bladder, and, in some cases, the ureteral openings. This procedure helps detect structural abnormalities, infections, cancers, and blockages in the urinary tract. There are two types of cystoscopy:Flexible cystoscopy is commonly performed in outpatient settings due to its less invasive...
01:25Urinary Tract Calculi VI: Surgical Management
Procedures for Kidney StonesMedical intervention is necessary when kidney stones or renal calculi are too large to pass spontaneously (typically greater than 5 millimeters) when stones are accompanied by symptomatic infection (such as fever or pyelonephritis), when they impair kidney function, or when they cause persistent symptoms like severe pain, nausea, or urinary retention. Additionally, patients with only one kidney or those who cannot be treated with medical management also require...