Related Experiment Video
Updated: Jul 8, 2026
Digital Hybrid Model Preparation for Virtual Planning of Reconstructive Dentoalveolar Surgical Procedures
Published on: August 5, 2021
Comparing the performance of conversational artificial intelligence models in answering patient questions about
Esra Mavi1, Tuğçe Çevik Sönmez2
1Faculty of Dentistry, Department of Oral and Maxillofacial Surgery, Sivas Cumhuriyet University, Sivas, Turkey.
Objective:
In this study, the aim was to compare three widely used AI-based chatbots, ChatGPT-4.5, DeepSeek, and Claude Sonnet 3.7. This study investigated how well they answered frequently asked questions by patients about dental implants. The answers were checked for reliability and usefulness for patients and were compared with the opinions of oral and maxillofacial surgeons.
Materials And Methods:
27 patient-oriented questions about dental implants were selected. These questions were about who is suitable for implants, possible risks, symptoms of peri‑implant diseases, what to do after tooth loss, preventive measures, and prognosis. Two independent and blinded oral and maxillofacial surgeons evaluated the answers with a modified three-point Likert scale.
Results:
The three chatbots gave answers that were similar in reliability and usefulness. There was no statistically significant difference in reliability or usefulness (p > 0.05). A significant difference was only found in the "Avoiding Medical Jargon" category (p < 0.001). Overall, Claude 3.7 Sonnet gave longer and more detailed answers. ChatGPT-4.5 gave shorter answers and used fewer medical terms, but it was not the easiest-to-read model by readability indices. DeepSeek showed higher Flesch Reading Ease scores than ChatGPT-4.5. Agreement between the two raters was high (Cronbach's α = 0.89-0.93).
Conclusions:
The results of the study show that the three models are similar in reliability and usefulness when answering common dental implant-related questions. These findings suggest that such chatbots can be used as supportive tools to inform patients about medical procedures.
