Comparative Analysis of Artificial Intelligence Platforms in Generating Post-Operative Instructions for Rhinologic Surgery

Ariana L Shaari ¹, Shreya Bhalla ², Annie Xu ¹

⁰Department of Otolaryngology- Head and Neck Surgery, Rutgers New Jersey Medical School, Newark, New Jersey USA.

Indian Journal of Otolaryngology and Head and Neck Surgery : Official Publication of the Association of Otolaryngologists of India +

|

March 11, 2025

View abstract on PubMed

Summary

Artificial intelligence (AI) tools like ChatGPT and Gemini can create understandable, but not actionable, post-operative instructions for surgeries like endoscopic sinus surgery (ESS). Patients should use AI-generated medical information cautiously due to potential drawbacks.

Area Of Science

Medical informatics
Artificial intelligence in healthcare
Patient education

Background

Rapid advancements in AI platforms like ChatGPT and Google Gemini.
Increasing patient reliance on AI for medical information.
The critical need for clear post-operative instructions for patient safety and optimal outcomes.

Purpose Of The Study

To evaluate the accuracy and understandability of post-operative instructions generated by ChatGPT and Gemini.
To compare the performance of ChatGPT and Gemini in creating patient-facing surgical information.

Main Methods

Generated post-operative instructions for endoscopic sinus surgery (ESS), balloon sinuplasty, Caldwell Luc surgery, and septoplasty using ChatGPT and Gemini.
Assessed readability using standard metrics.
Utilized the Patient Education Materials Assessment Tool (PEMAT) to evaluate understandability and actionability.

Main Results

Both ChatGPT and Gemini produced understandable post-operative instructions.
Instructions generated by both AI platforms were found to be poor in terms of actionability.
Readability scores indicated limitations in the clarity and ease of understanding for patient action.

Conclusions

AI platforms show potential for generating accessible medical information.
Current AI-generated post-operative instructions lack sufficient actionability and optimal readability.
Patients must exercise caution and be aware of the limitations of AI when seeking post-operative guidance.

Keywords:

Artificial intelligence Patient education Rhinology