Related Experiment Video
Updated: Jun 18, 2025
Detection of Helicobacter pylori Infection and Antibiotic Resistance via Stool Quantitative Polymerase Chain Reaction Analysis
Published on: May 16, 2025
Artificial Intelligence-Generated Patient Education Materials for Helicobacter pylori Infection: A Comparative
Shuyan Zeng1,2, Qingzhou Kong1,2, Xiaoqi Wu1,2
1Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China.
Background:
Patient education contributes to improve public awareness of Helicobacter pylori. Large language models (LLMs) offer opportunities to revolutionize patient education transformatively. This study aimed to assess the quality of patient educational materials (PEMs) generated by LLMs and compared with physician sourced.
Materials And Methods:
Unified instruction about composing a PEM about H. pylori at a sixth-grade reading level in both English and Chinese were given to physician and five LLMs (Bing Copilot, Claude 3 Opus, Gemini Pro, ChatGPT-4, and ERNIE Bot 4.0). The assessments of the completeness and comprehensibility of the Chinese PEMs were conducted by five gastroenterologists and 50 patients according to three-point Likert scale. Gastroenterologists were asked to evaluate both English and Chinese PEMs and determine the accuracy and safety. The accuracy was assessed by six-point Likert scale. The minimum acceptable scores were 4, 2, and 2 for accuracy, completeness, and comprehensibility, respectively. The Flesch-Kincaid and Simple Measure of Gobbledygook scoring systems were employed as readability assessment tools.
Results:
Accuracy and comprehensibility were acceptable for English PEMs of all sources, while completence was not satisfactory. Physician-sourced PEM had the highest accuracy mean score of 5.60 and LLM-generated English PEMs ranged from 4.00 to 5.40. The completeness score was comparable between physician-sourced PEM and LLM-generated PEMs in English. Chinese PEMs from LLMs proned to have lower score in accuracy and completeness assessment than English PEMs. The mean score for completeness of five LLM-generated Chinese PEMs was 1.82-2.70 in patients' perspective, which was higher than gastroenterologists' assessment. Comprehensibility was satisfactory for all PEMs. No PEM met the recommended sixth-grade reading level.
Conclusion:
LLMs have potential in assisting patient education. The accuracy and comprehensibility of LLM-generated PEMs were acceptable, but further optimization on improving completeness and accounting for a variety of linguistic contexts are essential for enhancing the feasibility.
Related Concept Videos
01:16Treating Helicobacter pylori in Peptic Ulcers: Antimicrobial Therapy
01:28Peptic Ulcer Disease III: Clinical Manifestations and Diagnostic Studies
Few clinical manifestations differentiate gastric ulcers from duodenal ulcers. Distinctions in the location, timing, and pain relief are crucial for healthcare providers in differentiating between gastric and duodenal ulcers during clinical assessments.
01:26Peptic Ulcer Disease IV: Management
The therapeutic approach involves ensuring adequate rest, implementing drug therapy, promoting smoking cessation, making dietary modifications, and emphasizing long-term follow-up care.
Pharmacological management
The prevailing therapy for peptic ulcers involves a combination of managing the patient's current...
01:22Healthcare Associated Infections II: Preventive Measures
The best practices for preventing healthcare-associated infections include hand hygiene, patient risk...
01:26Healthcare Associated Infections I: Iatrogenic, Exogenic and Endogenic
HAIs significantly increase the cost of health care. Extended stays in healthcare institutions, increased disability, increased costs of medications, including specialized antibiotics, and prolonged recovery times add to the patient's expenses and the healthcare institution and funding bodies.
01:28Peptic Ulcer Disease II: Pathophysiology
Damaging agents such as Helicobacter pylori, gastric acid, pepsin, and nonsteroidal anti-inflammatory drugs (NSAIDs) can weaken the mucosal defense, allowing hydrogen ions to infiltrate back and harm epithelial cells.