Related Experiment Video
Updated: Sep 5, 2026
Community-based Adapted Tango Dancing for Individuals with Parkinson's Disease and Older Adults
Published on: December 9, 2014
Quality, readability, and patient safety of ChatGPT-generated responses to fall-related questions in older adults: a
Merve Arı1,2, Nursen İlçin3, Hatice Yağcıoğlu4
1KTO Karatay University, Vocational School of Health Services, Department of Medical Services and Techniques, Medical Imaging Techniques Program - Konya, Türkiye.
Objective:
Older adults increasingly use artificial intelligence-based tools to obtain health information. Although artificial intelligence chatbots such as ChatGPT may enhance access, the quality, readability, and patient safety of fall-prevention information remain uncertain. This study aimed to evaluate the quality, readability, and patient safety implications of ChatGPT-generated responses to common questions about fall risk and home safety in older adults.
Methods:
Ten frequently asked fall-related questions were submitted to ChatGPT (version 5.2). Responses were independently assessed by a multidisciplinary panel including physiotherapists, a geriatrician, a physical medicine and rehabilitation physician, an occupational therapist, and an orthopedic specialist. Quality was evaluated using the Mika classification. Readability was measured with the Flesch-Kincaid Grade Level. Interrater reliability was analyzed using a two-way random-effects intraclass correlation coefficient model with absolute agreement (intraclass correlation coefficient [2,k]).
Results:
Three responses were rated as "excellent," while seven responses were rated as "satisfactory requiring minimal clarification." No response received a rating corresponding to "moderately satisfactory" or "unsatisfactory." The mean Flesch-Kincaid Grade Level was 8.4 (range 4.3-11.9). Five responses exceeded the readability levels commonly recommended for patient education materials. Interrater reliability demonstrated fair agreement (intraclass correlation coefficient [2,k]=0.72; 95%CI 0.64-0.80).
Conclusion:
While ChatGPT provided generally acceptable clinical information, variability in readability and expert ratings raises patient safety concerns. AI-generated health content should be reviewed and tailored to older adults' health literacy needs before clinical use.
