Related Experiment Videos
Quality of AI-Generated Postoperative Patient Education After Minimally Invasive Gynecologic Surgery: A Comparative
Adrianna Gorniak1, Nisha Divan2, Deep Pandya3
1Department of Gynecology and Obstetrics, Johns Hopkins University School of Medicine (Dr Gorniak), Baltimore, Maryland.
Study Objective:
To compare the quality of AI-generated responses to gynecologic postoperative questions with educational materials published by professional societies.
Design:
Comparative analysis of published and AI-generated patient education relating to hysterectomy, hysteroscopy, laparoscopy, and management of conditions such as endometriosis and abnormal uterine bleeding.
Setting:
Questions were selected from gynecologic professional society materials and asked to AI platforms: ChatGPT and Google Gemini.
Participants:
None.
Intervention:
Two expert reviewers scored blinded responses for accuracy (evidence-based and clinically appropriate), comprehensiveness (adequacy of information to address patient questions), and understandability (clarity for a typical patient) using a Likert 1-5 scale. Inclusivity was scored as a binary outcome. Readability and word count were also measured.
Measurements And Main Results:
A total of 20 questions were chosen for comparison. ChatGPT generated the most comprehensive responses (4.675, p < .05), while Google Gemini generated the most accurate (4.975, p < .05) but least understandable responses (3.2, p < .05). Professional society materials received lower accuracy (4.475, p < .05) and comprehensiveness (2.725, p < .05) relative to AI-generated responses, but had the highest readability (median SMOG 11.275; Flesch-Kincaid score 9.005, p < .05). ChatGPT responses were the longest, while professional society materials were the shortest (245.2 vs. 101 words, p < .05). There were no significant differences in inclusivity across sources (p = .098).
Conclusion:
AI platforms provide accurate and comprehensive responses to commonly asked gynecologic postoperative questions. While professional society materials remained the most readable, all sources exceeded the recommended sixth to eighth grade reading level. These findings highlight that AI could be a powerful tool in enhancing postoperative education and setting clearer expectations for gynecologic postoperative patients.
