Can ChatGPT answer patient questions regarding reverse shoulder arthroplasty?

Area of Science:

• Artificial Intelligence in Medicine
• Orthopedic Surgery Patient Education

Background:

• Artificial intelligence (AI) and language models like ChatGPT are advancing.
• Assessing AI's role in medical information dissemination is crucial.

Purpose of the Study:

• To evaluate the accuracy and reliability of ChatGPT responses to common reverse shoulder arthroplasty (RSA) FAQs.
• To determine the suitability of ChatGPT for patient education in orthopedic surgery.

Main Methods:

• Ten common RSA FAQs were sourced from patient education websites.
• ChatGPT responses were analyzed by orthopedic surgeons using JAMA Benchmark and DISCERN criteria.
• Readability was assessed using the Flesch-Kincaid Grade Level.

Main Results:

• ChatGPT responses averaged a DISCERN score of 44 (fair).
• No responses met JAMA Benchmark criteria (score 0).
• Average readability was at a college graduate level (Flesch-Kincaid 14.35).

Conclusions:

• ChatGPT offers fair, but not ideal, answers for RSA patient questions.
• High readability and lack of citations limit its utility for patient education.
• Orthopedic surgeons remain essential for providing reliable and accessible patient education.