Feasibility analysis of generative artificial intelligence tools as a means of medical science popularization on...

Due to the heavy medical workload of medical staff and the complicated procedure of medical science popularization, there are certain difficulties and resistance in medical science popularization. The main objective of this study was to evaluate the feasibility of generative artificial intelligence (AI) models in the medical science popularization of urological diseases.

ChatGPT 4.0 was used to generate relevant content on the pathogenesis, clinical manifestations, diagnosis and treatment of different urological diseases, and the generated content was evaluated and analyzed in multiple dimensions including scientificity, recency, comprehensiveness, understandability, conciseness and interest. The unreasonable contents of ChatGPT 4.0 were revised. Then all the revised contents were evaluated again from the six dimensions and compared with the initial evaluation.

ChatGPT 4.0 generated content scored high in scientificity, recency, and comprehensiveness, while scoring relatively low in understandability, conciseness, and interest. There was no significant difference in the scores of the generated content in different diseases. There was no significant difference in the scores of pathogenesis, clinical manifestations, diagnosis and treatment. Manual revision could significantly improve the comprehensiveness and conciseness of the generated content.

Generative AI tools such as ChatGPT may assist urologists in popularizing knowledge of urological diseases, and the generated content needs to be manually reviewed to ensure the accuracy and readability of the content.