Validating ChatGPT-4-Generated Patient Information Leaflets for Common Endourological Procedures: A Survey of Urology...

Artificial intelligence (AI) is transforming health care, including patient communication. Large language models, like ChatGPT-4, also show great promise for enhancing patient communication and decision-making. This study evaluates ChatGPT-4's ability to produce readable, accurate, evidence-based patient information leaflets (PILs) for three common endourological procedures.

ChatGPT-4 was given a short prompt to create PILs for extracorporeal shockwave lithotripsy, percutaneous nephrolithotomy, and ureteroscopic removal of stones. A 10-question survey was sent to urology teams in the United Kingdom to assess their accuracy, readability, and up-to-date content.

We received 105 responses (35 per procedure). The AI-generated PILs were rated highly across all domains, including: 85.71% found them evidence-based, 92.40% accurate, 99.05% clear and patient-friendly, and 96.19% would share them with patients despite knowing they were AI-generated.

ChatGPT-4 shows promise as a low-input tool for creating high-quality patient materials. It could support broader health care use with tailored, accessible communication. However, ethical and long-term reliability concerns need further study before wider adoption.