Applicability of Online Chat-Based Artificial Intelligence Models to Colorectal Cancer Screening.
Joseph Atarere1,2, Haider Naqvi3, Christopher Haas3
1Department of Medicine, MedStar Health, 201 East University Pkwy, Baltimore, MD, 21218, USA. joseph.o.atarere@medstar.net.
Digestive Diseases and Sciences
|January 24, 2024
Summary
Artificial intelligence (AI) models show promise for colorectal cancer (CRC) screening information, but patients should verify AI-generated recommendations with their physicians due to occasional inaccuracies.
Area of Science:
- Medical Informatics
- Artificial Intelligence in Healthcare
- Public Health
Background:
- Studies indicate potential for ChatGPT in medical fields like cardiology and oncology.
- The use of AI for patient education and communication regarding colorectal cancer (CRC) screening requires critical evaluation.
Purpose of the Study:
- To critically evaluate the application of AI models, including ChatGPT, for patient education and communication on colorectal cancer screening.
Main Methods:
- Three freely available AI models were queried with 15 CRC screening concept questions and 5 patient questions.
- Responses were assessed for appropriateness and reliability against American College of Gastroenterology guidelines.
- Graded responses included reliably appropriate (RA), reliably inappropriate (RI), and unreliable, with inter-rater reliability at 89.2%.
Main Results:
- ChatGPT and YouChat™ provided more RA responses than BingChat.
- Two questions resulted in unreliable responses from more than one AI model.
- Limitations included lack of references (ChatGPT), misinterpretation of sources (BingChat), and outdated screening age recommendations (YouChat™).
Conclusions:
- AI models provide mostly appropriate information on CRC screening.
- Current AI models have limitations in interpreting medical literature and providing up-to-date information.
- Physician consultation is recommended for contextualizing AI-generated CRC screening recommendations.
More Related Videos
Related Concept Videos
02:43Mouse Models of Cancer Study
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
02:43Mouse Models of Cancer Study
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...