Artificial intelligence versus orthopedic surgeons as an orthopedic consultant in the emergency department
View abstract on PubMed
Summary
This summary is machine-generated.Artificial intelligence (AI) shows non-inferior and often superior performance in orthopedic emergency department consultations compared to experienced surgeons. AI excels in completeness and helpfulness for common orthopedic scenarios.
Area Of Science
- Orthopedic Surgery
- Artificial Intelligence
- Medical Informatics
Background
- Artificial intelligence (AI) programs like ChatGPT show promise in healthcare, including emergency department (ED) applications.
- However, AI's utility in assisting ED providers with orthopedic consultations remains unevaluated.
Purpose Of The Study
- To compare the performance of ChatGPT-4 against board-certified orthopedic surgeons in responding to common ED orthopedic clinical scenarios.
- To assess AI's effectiveness in diagnosis, management, surgical indication, and patient counseling for orthopedic conditions.
Main Methods
- Five common orthopedic ED scenarios (ankle fractures, distal radius fractures, septic arthritis, shoulder dislocations, Achilles tendon ruptures) were developed.
- ChatGPT-4 and four orthopedic surgeons responded to scenario-based questions.
- Responses were evaluated by independent emergency medicine physicians on accuracy, completeness, helpfulness, specificity, and overall quality using a Likert scale.
Main Results
- AI responses were superior in completeness, helpfulness, specificity, and overall quality compared to human responders (p < 0.05).
- AI demonstrated superior helpfulness and specificity in diagnostic questions and excelled in patient counseling categories.
- AI outperformed human responses in specific scenarios like distal radius fractures (completeness) and shoulder dislocations (completeness, helpfulness, overall quality).
Conclusions
- AI demonstrated non-inferior and often superior performance in orthopedic ED consultations.
- While current AI has limitations with image integration, it provides high-quality recommendations for generic orthopedic consultations.
- AI is poised to play an increasingly significant role in orthopedic consultations with future development.