Related Experiment Video
Updated: Jun 27, 2025
03:14
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
548
Quantitative Comparison of Chatbots on Common Rhinology Pathologies
Jeffrey R Bellinger1, Minhie W Kwak1, Gabriel A Ramos1
1Department of Otolaryngology-Head and Neck Surgery, University of Virginia School of Medicine, Charlottesville, Virginia, U.S.A.
The Laryngoscope
|April 26, 2024
Summary
ChatGPT Plus and Google Bard offer the most patient-friendly information for common rhinology conditions among tested chatbots. These artificial intelligence tools show promise for patient education in ear, nose, and throat care.
Area of Science:
- Medical Informatics
- Artificial Intelligence in Healthcare
- Otolaryngology
Background:
- Chatbots are increasingly used as patient information sources.
- Understanding their accuracy and usability for medical conditions is crucial.
- Rhinology patient information needs assessment is a growing area.
Purpose of the Study:
- To quantitatively compare four major chatbots (ChatGPT, ChatGPT Plus, Google Bard, Microsoft Bing) for patient information on common rhinology treatments.
- To evaluate chatbot responses based on readability, quality, understandability, actionability, accuracy, and comprehensiveness.
Main Methods:
- Treatments for epistaxis, chronic sinusitis, sinus infection, allergic rhinitis, allergies, and nasal polyps were queried.
- Responses from ChatGPT, ChatGPT Plus, Google Bard, and Microsoft Bing were analyzed in May 2023.
- Validated scoring metrics and expert rhinology evaluation were employed.
Main Results:
- Bard and Bing demonstrated higher readability scores compared to ChatGPT and ChatGPT Plus.
- ChatGPT, ChatGPT Plus, and Bard received higher quality scores than Microsoft Bing.
- ChatGPT Plus and Google Bard showed superior understandability and accuracy, with ChatGPT Plus having the highest accuracy score.
Conclusions:
- ChatGPT Plus and Google Bard are currently the most patient-friendly chatbots for rhinology condition treatments.
- These findings guide healthcare providers in utilizing AI tools for patient education.
- Further research into AI's role in otolaryngology patient information is warranted.
