Related Experiment Video
Updated: Jun 4, 2025
A Mouse Model of Ankle-Subtalar Complex Joint Instability
Published on: October 28, 2022
Diagnosis, treatment, and prevention of ankle sprains: Comparing free chatbot recommendations with clinical
Friederike Eva Roch1, Franziska Melanie Hahn1, Katharina Jäckle1
1Department of Trauma Surgery, Orthopaedics and Plastic Surgery, University of Göttingen, Robert-Koch-Str. 40, Göttingen 37075, Germany.
Background:
Free chatbots powered by large language models offer lateral ankle sprains (LAS) treatment recommendations but lack scientific validation.
Methods:
The chatbots-Claude, Perplexity, and ChatGPT-were evaluated by comparing their responses to a questionnaire and their treatment algorithms against current clinical guidelines. Responses were graded on accuracy, conclusiveness, supplementary information, and incompleteness, and evaluated individually and collectively, with a 60 % pass threshold.
Results:
The collective analysis of the questionnaire showed Perplexity scored significantly higher than Claude and ChatGPT (p < 0.001). In the individual analysis, Perplexity provided significantly more supplementary information than the other chatbots (p < 0.001). All chatbots met the pass threshold. In the algorithm evaluation, ChatGPT scored significantly higher than the others (p = 0.023), with Perplexity below the pass threshold.
Conclusions:
Chatbots' recommendations generally aligned with current guidelines but sometimes missed crucial details. While they offer useful supplementary information, they cannot yet replace professional medical consultation or established guidelines.
More Related Videos
02:15Predictive Measurement for Windlass Change in Length and Selected Treatment Outcomes in Chronic Plantar Fasciitis
Published on: March 1, 2024
07:52Evaluating Postural Control and Lower-extremity Muscle Activation in Individuals with Chronic Ankle Instability
Published on: September 18, 2020
