Can artificial intelligence manage malnutrition? A critical look at ChatGPT's performance in geriatric nutrition

Artificial intelligence represents a rapidly advancing innovation in healthcare with the potential to revolutionize the field of clinical nutrition.

The aim of this study was to evaluate ChatGPT's potential to support the clinical decision-making process regarding nutrition in older adults.

Twelve questions and three clinical vignettes addressing fundamental concepts of malnutrition, including general information, diagnosis, follow-up, and treatment, were created and asked to ChatGPT. Three geriatricians independently examined ChatGPT's responses. The quality of the responses was assessed using the Quality Analysis of Medical Artificial Intelligence tool.

The inter-rater reliability among the authors was calculated, and an excellent intraclass correlation coefficient of 0.84 (95%CI 0.77-0.89; p<0.001) was found. The total mean Quality Analysis of Medical Artificial Intelligence score for the ChatGPT-generated responses to questions related to malnutrition was 26.60, indicating very good quality. In evaluating the clinical scenarios, the lowest scores were observed in source use. The total Quality Analysis of Medical Artificial Intelligence, accuracy, relevance, and use of sources scores for the clinical scenario involving the patient with a hip fracture were statistically significantly lower compared to other scenarios.

Our study highlighted that ChatGPT has the potential to generate correct answers related to complex clinical scenarios about malnutrition. ChatGPT can help clinicians make more informed decisions regarding patients' nutritional requirements and management by utilizing more up-to-date medical resources and guidelines.