Related Experiment Video
Updated: May 30, 2025

Author Spotlight: Exploring ShiDuGao's Multi-Target Approach in Anus Eczema Treatment
Published on: January 12, 2024
Comparing answers of ChatGPT and Google Gemini to common questions on benign anal conditions
Introduction:
Chatbots have been increasingly used as a source of patient education. This study aimed to compare the answers of ChatGPT-4 and Google Gemini to common questions on benign anal conditions in terms of appropriateness, comprehensiveness, and language level.
Methods:
Each chatbot was asked a set of 30 questions on hemorrhoidal disease, anal fissures, and anal fistulas. The responses were assessed for appropriateness, comprehensiveness, and reference provision. The assessments were made by three subject experts who were unaware of the name of the chatbots. The language level of the chatbot answers was assessed using the Flesch-Kincaid Reading Ease score and grade level.
Results:
Overall, the answers provided by both models were appropriate and comprehensive. The answers of Google Gemini were more appropriate, comprehensive, and supported by references compared with the answers of ChatGPT. In addition, the agreement among the assessors on the appropriateness of Google Gemini answers was higher, attesting to a higher consistency. ChatGPT had a significantly higher Flesh-Kincaid grade level than Google Gemini (12.3 versus 10.6, p = 0.015), but a similar median Flesh-Kincaid Ease score.
Conclusions:
The answers of Google Gemini to questions on common benign anal conditions were more appropriate and comprehensive, and more often supported with references, than the answers of ChatGPT. The answers of both chatbots were at grade levels higher than the 6th grade level, which may be difficult for nonmedical individuals to comprehend.
Related Concept Videos
Assessment of the Rectum and Anus
Rectal Inspection
Begin by inspecting the perianal and anal areas for color, texture, rashes,...
Serum Laboratory Studies, Stool Test, Breath Test
Assessment of the Gastrointestinal System I: Subjective Data
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Assessing Body Temperature - Rectal
Follow these steps for rectal temperature assessment:
Step 1: Perform hand hygiene and don clean gloves to prevent cross-infection.
Step 2: Position the patient in a side-lying position to better visualize the rectal...
Assessment of the Gastrointestinal System II: Health Perception Pattern
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...

