Related Experiment Video
Updated: Jun 10, 2025
Treatment of Ankle Osteoarthritis with Total Ankle Replacement Through a Lateral Transfibular Approach
Published on: January 24, 2018
AI discernment in foot and ankle surgery research: A survey investigation
Steven R Cooperman1, Abisola Olaniyan2, Roberto A Brandão3
1Orthopedic Foot and Ankle Center Advanced Foot and Ankle Reconstruction Fellowship, 350 W. Wilson Bridge Rd, Ste. 200, Worthington, OH 43085, USA.
Background:
This study evaluated the ability to differentiate between AI-generated and human-authored abstracts in foot and ankle surgery.
Methods:
An AI system (ChatGPT 3.0) was trained on 21 published abstracts to create six novel case abstracts. Nine foot and ankle surgeons participated in a blinded survey, tasked with distinguishing AI-generated from human-written abstracts, rating their confidence in their responses. Surveys were completed twice at two different time points to evaluate intra-/inter-observer reliability.
Results:
The overall accuracy rate for distinguishing AI-generated from human-written abstracts was 50.5 % (n = 109/216), indicating no better performance than random chance. Reviewer experience and AI familiarity did not significantly affect accuracy. Inter-rater reliability was moderate initially but decreased over time, and intra-rater reliability was poor.
Conclusions:
In their current form, AI-generated abstracts are nearly indistinguishable from human-written ones, posing challenges for consistent identification in foot and ankle surgery.
Level Of Evidence:
IV.
More Related Videos
02:15Predictive Measurement for Windlass Change in Length and Selected Treatment Outcomes in Chronic Plantar Fasciitis
Published on: March 1, 2024
07:24Autologous Microfractured and Purified Adipose Tissue for Arthroscopic Management of Osteochondral Lesions of the Talus
Published on: January 23, 2018
