Quality and Dependability of ChatGPT and DingXiangYuan Forums for Remote Orthopedic Consultations: Comparative Analysis
View abstract on PubMed
Summary
This summary is machine-generated.Artificial intelligence, specifically ChatGPT-4, shows comparable performance to professional healthcare providers in remote consultations, particularly excelling in medical knowledge dissemination. It offers a valuable tool for both patients and healthcare professionals in telemedicine.
Area Of Science
- Medical Informatics
- Artificial Intelligence in Healthcare
- Telemedicine
Background
- The integration of artificial intelligence (AI) like ChatGPT and remote medical platforms such as China's DingXiangYuan is transforming healthcare delivery.
- AI's growing influence necessitates an evaluation of its capabilities in supporting the increasing demand for remote medical consultations.
Purpose Of The Study
- To assess the performance of ChatGPT-4 against human healthcare providers in telemedicine consultations.
- To determine AI's potential to augment remote healthcare services and impact overall healthcare delivery.
Main Methods
- A comparative study using orthopedic consultations from "Doctor DingXiang" as the control (physicians) and ChatGPT-4 as the experimental group.
- Three blinded orthopedic surgeons evaluated responses based on seven criteria, including logical reasoning, information quality, guiding function, therapeutic effect, patient education, and overall satisfaction.
- Fleiss κ statistic was employed to measure inter-rater agreement.
Main Results
- ChatGPT-4 demonstrated statistically significant superiority in "medical knowledge popularization education" compared to physicians (P<.001).
- While not statistically significant, ChatGPT-4 showed higher scores in "logical reasoning" (P=.38) and "external information" (P=.25).
- No significant differences were found in "internal information" (P=.43), "therapeutic effect" (P=.32), or "overall satisfaction" (P=.92).
Conclusions
- ChatGPT-4 demonstrates comparable expertise to physicians in paid telemedicine consultations, particularly in patient education.
- AI tools like ChatGPT-4 present a promising avenue for remote health advice, potentially serving as an aid for healthcare professionals and a convenient resource for patients.
- The study highlights AI's potential to enhance patient education and streamline health inquiries in the evolving landscape of digital health.

