Related Experiment Video
Updated: Jun 1, 2025

07:29
Intramucosal Inoculation of Squamous Cell Carcinoma Cells in Mice for Tumor Immune Profiling and Treatment Response Assessment
Published on: April 22, 2019
11.4K
ChatGPT and oral cancer: a study on informational reliability
1Faculty of Dentistry, Department of Dentomaxillofacial Radiology, Tokat Gaziosmanpasa University, Tokat, Turkey. mesude.citir@gop.edu.tr.
BMC Oral Health
|January 20, 2025
Summary
ChatGPT-3.5 provided reliable information on oral cancer questions, with over 97% of responses rated as good or very good. However, many of its references were not scientifically valid.
Area of Science:
- Medical Informatics
- Artificial Intelligence in Healthcare
- Oncology
Background:
- Large language models (LLMs) like ChatGPT offer potential for healthcare information retrieval but raise accuracy and ethical concerns.
- Early diagnosis of oral cancer is critical for patient outcomes.
- This study assesses the reliability of ChatGPT-3.5 for oral cancer information.
Purpose of the Study:
- To evaluate the accuracy of ChatGPT-3.5 responses to common oral cancer questions.
- To assess the authenticity of references provided by ChatGPT-3.5.
Main Methods:
- Twenty questions on oral cancer were posed to ChatGPT-3.5.
- Responses were evaluated for accuracy by medical oncologists and oral/maxillofacial radiologists.
- Reference authenticity was critically examined.
Main Results:
- Over 97% of ChatGPT-3.5 responses were rated as good or very good.
- No significant difference in accuracy ratings was found between the evaluating specialties.
- A significant portion of the provided references were found to be non-scientific or fabricated.
Conclusions:
- ChatGPT-3.5 demonstrates reliability in providing information about oral cancer.
- The AI's information is not consistently supported by verifiable scientific references.
- Caution is advised regarding the source and verification of AI-generated medical information.
Related Concept Videos
Cancer Survival Analysis
328
Cancer survival analysis focuses on quantifying and interpreting the time from a key starting point, such as diagnosis or the initiation of treatment, to a specific endpoint, such as remission or death. This analysis provides critical insights into treatment effectiveness and factors that influence patient outcomes, helping to shape clinical decisions and guide prognostic evaluations. A cornerstone of oncology research, survival analysis tackles the challenges of skewed, non-normally...
328
Comparing the Survival Analysis of Two or More Groups
141
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
141
Serum Laboratory Studies, Stool Test, Breath Test
310
Gastrointestinal (GI) diagnostic studies are pivotal in confirming, ruling out, diagnosing, or staging various diseases, including cancers. Following diagnosis, allocating time for discussions with the patient and providing informational resources is crucial. Diagnostic assessments of the GI tract often occur in outpatient settings like endoscopy suites or GI labs. Preparation for these tests may include dietary restrictions, fasting, liquid bowel preparations, laxatives, enemas, and the...
310

