Related Experiment Video
Updated: Jul 31, 2025

A Computer-Based Platform for Aiding Clinicians in Eating Disorder Analysis and Diagnosis
Published on: May 10, 2022
Can ChatGPT Accurately Answer a PICOT Question? Assessing AI Response to a Clinical Question
Candise Branum1, Martin Schiavenato
1Health Science Librarian and Assistant Professor (Mx Branum), Foley Center Library, and Assistant Professor (Dr Schiavenato), School of Nursing and Human Physiology, Gonzaga University, Spokane, Washington.
Background:
ChatGPT, an artificial intelligence (AI) text generator trained to predict correct words, can provide answers to questions but has shown mixed results in answering medical questions.
Purpose:
To assess the reliability and accuracy of ChatGPT in providing answers to a complex clinical question.
Methods:
A Population, Intervention, Comparison, Outcome, and Time (PICOT) formatted question was queried, along with a request for references. Full-text articles were reviewed to verify the accuracy of the evidence summary provided by the chatbot.
Results:
ChatGPT was unable to provide a certifiable response to a PICOT question. The references cited as evidence included incorrect journal information, and many study details summarized by ChatGPT proved to be patently false, including providing fabricated data.
Conclusions:
ChatGPT provides answers that appear legitimate but may be factually incorrect. The system is not transparent in how it gathers data to answer questions and sometimes fabricates information that looks plausible, making it an unreliable tool for clinical questions.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Clinical Trials
There are four phases in a clinical trial. A phase one...
Nursing Assessment
The nurse collects all aspects of the patient's health in the initial assessment, establishing priorities for ongoing focused assessments...
Patient-centered Care
Critical Thinking II
Critical Thinking I

