Related Experiment Video
Updated: Jun 23, 2025
Autologous Microfractured and Purified Adipose Tissue for Arthroscopic Management of Osteochondral Lesions of the Talus
Published on: January 23, 2018
ChatGPT Is Moderately Accurate in Providing a General Overview of Orthopaedic Conditions
Chandler A Sparks1, Sydney M Fasulo2, Jordan T Windsor1
1Hackensack Meridian School of Medicine, Nutley, New Jersey.
Background:
ChatGPT is an artificial intelligence chatbot capable of providing human-like responses for virtually every possible inquiry. This advancement has provoked public interest regarding the use of ChatGPT, including in health care. The purpose of the present study was to investigate the quantity and accuracy of ChatGPT outputs for general patient-focused inquiries regarding 40 orthopaedic conditions.
Methods:
For each of the 40 conditions, ChatGPT (GPT-3.5) was prompted with the text "I have been diagnosed with [condition]. Can you tell me more about it?" The numbers of treatment options, risk factors, and symptoms given for each condition were compared with the number in the corresponding American Academy of Orthopaedic Surgeons (AAOS) OrthoInfo website article for information quantity assessment. For accuracy assessment, an attending orthopaedic surgeon ranked the outputs in the categories of <50%, 50% to 74%, 75% to 99%, and 100% accurate. An orthopaedics sports medicine fellow also independently ranked output accuracy.
Results:
Compared with the AAOS OrthoInfo website, ChatGPT provided significantly fewer treatment options (mean difference, -2.5; p < 0.001) and risk factors (mean difference, -1.1; p = 0.02) but did not differ in the number of symptoms given (mean difference, -0.5; p = 0.31). The surgical treatment options given by ChatGPT were often nondescript (n = 20 outputs), such as "surgery" as the only operative treatment option. Regarding accuracy, most conditions (26 of 40; 65%) were ranked as mostly (75% to 99%) accurate, with the others (14 of 40; 35%) ranked as moderately (50% to 74%) accurate, by an attending surgeon. Neither surgeon ranked any condition as mostly inaccurate (<50% accurate). Interobserver agreement between accuracy ratings was poor (κ = 0.03; p = 0.30).
Conclusions:
ChatGPT provides at least moderately accurate outputs for general inquiries of orthopaedic conditions but is lacking in the quantity of information it provides for risk factors and treatment options. Professional organizations, such as the AAOS, are the preferred source of musculoskeletal information when compared with ChatGPT.
Clinical Relevance:
ChatGPT is an emerging technology with potential roles and limitations in patient education that are still being explored.
Related Concept Videos
01:28Disorders of the Skeletal Muscle
Musculoskeletal disorders
Musculoskeletal disorders involve injuries and conditions affecting the skeletal muscles and associated connective tissues. These disorders can arise from acute biomechanical stresses or chronic overuse and can occur across different age groups. Common injuries include sprains, fractures, and muscular strains, often resulting from...
01:29Bone Disorders
Bone deposition is also affected by the levels of sex hormones like estrogen and testosterone that promote osteoblast activity and bone matrix synthesis. When the level of these hormones decreases due to aging, it causes a reduction in bone deposition. As a result, bone resorption by osteoclasts...
01:22The Functions of the Skeletal System
01:27Fractures: Bone Repair
Minor fractures with no bone displacement are treated by immobilizing the fractured bone using a cast or splint. However, in the case of fractures with displaced bones, the broken bones are repositioned before immobilization to ensure successful healing without deformation and loss of function. The realignment of fractured bone ends is performed through a process called reduction. If the...
01:09Overview of the Axial Skeleton
The axial skeleton of the...
01:16Bones of the Lower Limb: Femur and Patella