Related Experiment Video
Updated: Jan 17, 2026

Digital Home-Monitoring of Patients after Kidney Transplantation: The MACCS Platform
Published on: April 12, 2021
Reliability of AI-generated responses on frequently-posed questions by patients with chronic kidney disease
Emi Furukawa1, Tsuyoshi Okuhara1,2, Hiroko Okada1,2
1University Hospital Medical Information Network Center, The University of Tokyo Hospital, Tokyo, Japan.
Abstract:
BackgroundAI tools are becoming primary information sources for patients with chronic kidney disease (CKD). However, as AI sometimes generates factual or inaccurate information, the reliability of information must be assessed.MethodsThis study assessed the AI-generated responses to frequently asked questions on CKD. We entered Japanese prompts with top CKD-related keywords into ChatGPT, Copilot, and Gemini. The Quality Analysis of Medical Artificial Intelligence (QAMAI) tool was used to evaluate the reliability of the information.ResultsWe included 207 AI responses from 23 prompts. The AI tools generated reliable information, with a median QAMAI score of 23 (interquartile range: 7) out of 30. However, information accuracy and resource availability varied (median (IQR): ChatGPT versus Copilot versus Gemini = 18 (2) versus 25 (3) versus 24 (5), p < 0.01). Among AI tools, ChatGPT provided the least accurate information and did not provide any resources.ConclusionThe quality of AI responses on CKD was generally acceptable. While most information provided was reliable and comprehensive, some information lacked accuracy and references.
Related Concept Videos
Drug Dosing in Renal Diseases: Estimation of Glomerular Filtration Rate Based on Serum Creatinine Concentration
Chronic Kidney Disease III: Interprofessional Care
Chronic Kidney Disease IV: Nursing Management
Chronic Kidney Disease I: Introduction
Acute Kidney Injury IV: Diagnostic Studies and Prevention
Acute Kidney Injury III: Clinical Manifestations

