Related Experiment Video
Updated: Jun 18, 2025
Gastric Mucosa Quantitative Polymerase Chain Reaction Analysis for Detecting Helicobacter pylori and Antibiotic Resistance
Published on: March 7, 2025
Assessing Accuracy of ChatGPT on Addressing Helicobacter pylori Infection-Related Questions: A National Survey and
Yi Hu1,2, Yongkang Lai1,3,4, Foqiang Liao1
1Department of Gastroenterology, Jiangxi Medical College, The First Affiliated Hospital, Digestive Disease Hospital, Nanchang University, Nanchang, Jiangxi, China.
Background:
ChatGPT is a novel and online large-scale language model used as a source providing up-to-date and useful health-related knowledges to patients and clinicians. However, its performance on Helicobacter pylori infection-related questions remain unknown. This study aimed to evaluate the accuracy of ChatGPT's responses on H. pylori-related questions compared with that of gastroenterologists during the same period.
Methods:
Twenty-five H. pylori-related questions from five domains: Indication, Diagnostics, Treatment, Gastric cancer and prevention, and Gut Microbiota were selected based on the Maastricht VI Consensus report. Each question was tested three times with ChatGPT3.5 and ChatGPT4. Two independent H. pylori experts assessed the responses from ChatGPT, with discrepancies resolved by a third reviewer. Simultaneously, a nationwide survey with the same questions was conducted among 1279 gastroenterologists and 154 medical students. The accuracy of responses from ChatGPT3.5 and ChatGPT4 was compared with that of gastroenterologists.
Results:
Overall, both ChatGPT3.5 and ChatGPT4 demonstrated high accuracy, with median accuracy rates of 92% for each of the three responses, surpassing the accuracy of nationwide gastroenterologists (median: 80%) and equivalent to that of senior gastroenterologists. Compared with ChatGPT3.5, ChatGPT4 provided more concise responses with the same accuracy. ChatGPT3.5 performed well in the Indication, Treatment, and Gut Microbiota domains, whereas ChatGPT4 excelled in Diagnostics, Gastric cancer and prevention, and Gut Microbiota domains.
Conclusion:
ChatGPT exhibited high accuracy and reproducibility in addressing H. pylori-related questions except the decision for H. pylori treatment, performing at the level of senior gastroenterologists and could serve as an auxiliary information tool for assisting patients and clinicians.
Related Concept Videos
01:16Treating Helicobacter pylori in Peptic Ulcers: Antimicrobial Therapy
01:28Peptic Ulcer Disease III: Clinical Manifestations and Diagnostic Studies
Few clinical manifestations differentiate gastric ulcers from duodenal ulcers. Distinctions in the location, timing, and pain relief are crucial for healthcare providers in differentiating between gastric and duodenal ulcers during clinical assessments.
01:17Assessment of the Gastrointestinal System I: Subjective Data
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
01:26Peptic Ulcer Disease IV: Management
The therapeutic approach involves ensuring adequate rest, implementing drug therapy, promoting smoking cessation, making dietary modifications, and emphasizing long-term follow-up care.
Pharmacological management
The prevailing therapy for peptic ulcers involves a combination of managing the patient's current...
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
01:30Peptic Ulcer Disease I: Introduction
An acute ulcer, marked by superficial erosion and minimal inflammation, swiftly resolves upon identifying and addressing the underlying cause. In contrast, a chronic ulcer persists, potentially eroding through the muscular wall and forming fibrous tissue.
Peptic ulcers can also be...