Related Experiment Video
Updated: Jun 4, 2025
Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training
Published on: August 9, 2024
Artificial Intelligence, the ChatGPT Large Language Model: Assessing the Accuracy of Responses to the Gynaecological
Background:
In 2022, OpenAI launched ChatGPT 3.5, which is now widely used in medical education, training, and research. Despite its valuable use for the generation of information, concerns persist about its authenticity and accuracy. Its undisclosed information source and outdated dataset pose risks of misinformation. Although it is widely used, AI-generated text inaccuracies raise doubts about its reliability. The ethical use of such technologies is crucial to uphold scientific accuracy in research.
Objective:
This study aimed to assess the accuracy of ChatGPT in doing GESEA tests 1 and 2.
Materials And Methods:
The 100 multiple-choice theoretical questions from GESEA certifications 1 and 2 were presented to ChatGPT, requesting the selection of the correct answer along with an explanation. Expert gynaecologists evaluated and graded the explanations for accuracy.
Main Outcome Measures:
ChatGPT showed a 59% accuracy in responses, with 64% providing comprehensive explanations. It performed better in GESEA Level 1 (64% accuracy) than in GESEA Level 2 (54% accuracy) questions.
Conclusions:
ChatGPT is a versatile tool in medicine and research, offering knowledge, information, and promoting evidence-based practice. Despite its widespread use, its accuracy has not been validated yet. This study found a 59% correct response rate, highlighting the need for accuracy validation and ethical use considerations. Future research should investigate ChatGPT's truthfulness in subspecialty fields such as gynaecologic oncology and compare different versions of chatbot for continuous improvement.
What Is New?:
Artificial intelligence (AI) has a great potential in scientific research. However, the validity of outputs remains unverified. This study aims to evaluate the accuracy of responses generated by ChatGPT to enhance the critical use of this tool.
Related Concept Videos
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
01:17Assessment of the Gastrointestinal System I: Subjective Data
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
01:29Endoscopic Procedures I: Esophagogastroduodenoscopy
During an EGD, the endoscope can be used to:
01:25Assessment of the Abdomen I: Inspection and Auscultation
The abdominal examination is a cornerstone of clinical medicine, serving as a critical tool in diagnosing various gastrointestinal (GI) diseases. It involves a systematic approach that includes inspection and auscultation, each with distinct yet complementary roles in assessing the abdomen. This article will delve into these two primary methods healthcare professionals use to examine the abdomen.
Inspection of the Abdomen
The first step in any abdominal examination is inspection....
01:26Endoscopic Procedures V: ERCP
Patient...
01:26Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...