Related Experiment Video
Updated: Jun 25, 2025
An Anatomical Study of Nerves at Risk During Minimally Invasive Hallux Valgus Surgery
Published on: February 17, 2018
A quality and readability comparison of artificial intelligence and popular health website education materials for
Nicholas B Pohl1, Evan Derector1, Michael Rivlin1
1Department of Orthopaedic Surgery, Rothman Orthopaedic Institute, Philadelphia, PA, USA.
Introduction:
ChatGPT and its application in producing patient education materials for orthopedic hand disorders has not been extensively studied. This study evaluated the quality and readability of educational information pertaining to common hand surgeries from patient education websites and information produced by ChatGPT.
Methods:
Patient education information for four hand surgeries (carpal tunnel release, trigger finger release, Dupuytren's contracture, and ganglion cyst surgery) was extracted from ChatGPT (at a scientific and fourth-grade reading level), WebMD, and Mayo Clinic. In a blinded and randomized fashion, five fellowship-trained orthopaedic hand surgeons evaluated the quality of information using a modified DISCERN criteria. Readability and reading grade level were assessed using Flesch Reading Ease (FRE) and Flesch-Kincaid Grade Level (FKGL) equations.
Results:
The Mayo Clinic website scored higher in terms of quality for carpal tunnel release information (p = 0.004). WebMD scored higher for Dupuytren's contracture release (p < 0.001), ganglion cyst surgery (p = 0.003), and overall quality (p < 0.001). ChatGPT - 4th Grade Reading Level, ChatGPT - Scientific Reading Level, WebMD, and Mayo Clinic written materials on average exceeded recommended reading grade levels (4th-6th grade) by at least four grade levels (10th, 14th, 13th, and 11th grade, respectively).
Conclusions:
ChatGPT provides inferior education materials compared to patient-friendly websites. When prompted to provide more easily read materials, ChatGPT generates less robust information compared to patient-friendly websites and does not adequately simplify the educational information. ChatGPT has potential to improve the quality and readability of patient education materials but currently, patient-friendly websites provide superior quality at similar reading comprehension levels.
Related Concept Videos
01:23Hand hygiene
Hand washing...
01:19Handwashing II: Pre-procedure and Initial Procedure Steps
The hand washing procedure itself includes the following steps. First, cover cuts, if any, on hands with a waterproof dressing. Cuts and abrasions can become contaminated with bacteria hindering the ability to clean the area thoroughly. In addition, repeated hand washing can worsen an injury. The nails must be short and clean, without nail...
01:10Pre-Procedural Guidelines for Assessing Blood Pressure
01:11Assessment of radial pulse
The radial pulse, located at the wrist, is often the preferred site for assessing peripheral pulse because of its accessibility and dependability. The process of determining the radial pulse involves several steps:
01:15Handwashing III: During the Procedure and Post-Procedure Steps