Related Experiment Video
Updated: Jul 21, 2025
13:44
Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
3.6K
ChatGPT Knowledge Evaluation in Basic and Clinical Medical Sciences: Multiple Choice Question Examination-Based
Sultan Ayoub Meo1, Abeer A Al-Masri1, Metib Alotaibi2
1Department of Physiology, College of Medicine, King Saud University, Riyadh 11461, Saudi Arabia.
Healthcare (Basel, Switzerland)
|July 29, 2023
Summary
This study assessed artificial intelligence Chatbot Generative Pre-Trained Transformer (ChatGPT) performance on medical science multiple-choice questions (MCQs). ChatGPT achieved a 72% overall score, indicating satisfactory knowledge for medical education support.
Area of Science:
- Medical Education
- Artificial Intelligence in Healthcare
- Medical Sciences
Background:
- The rapid advancement of artificial intelligence (AI) chatbots like Chatbot Generative Pre-Trained Transformer (ChatGPT) presents new opportunities and challenges in various sectors, including education and healthcare.
- While ChatGPT demonstrates broad knowledge, its specific intellectual capacity and performance within the specialized domain of medical sciences remain underexplored.
- There is a need to evaluate AI's potential in medical education, particularly its grasp of basic and clinical medical sciences.
Purpose of the Study:
- To investigate the knowledge level of ChatGPT in both basic and clinical medical sciences.
- To assess ChatGPT's performance on multiple-choice questions (MCQs) relevant to medical education.
- To determine the potential impact of AI tools like ChatGPT on the medical examination system and education framework.
Main Methods:
- A question bank of 100 scenario-based multiple-choice questions (MCQs) was developed from medical textbooks and university exams, covering basic and clinical medical sciences.
- Each MCQ was reviewed for relevance, and 50 questions from basic and 50 from clinical sciences were randomly selected.
- ChatGPT was tested by manually entering each MCQ in a fresh session to avoid bias, with scoring based on a pre-determined answer key.
Main Results:
- ChatGPT attempted all 100 MCQs, scoring 37/50 (74%) in basic medical sciences and 35/50 (70%) in clinical medical sciences.
- The overall performance of ChatGPT across both domains was 72/100 (72%).
- The AI demonstrated a satisfactory level of understanding and explanation capabilities in its responses.
Conclusions:
- ChatGPT achieved a satisfactory score, indicating a notable level of knowledge in both basic and clinical medical sciences.
- The findings suggest that ChatGPT has the potential to serve as a valuable tool for medical students and faculty.
- ChatGPT represents a potential innovation within the framework of medical sciences and education, warranting further investigation into its applications.
More Related Videos
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
291
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
8.4K
Related Concept Videos
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
141
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
141
01:13Multiple Comparison Tests
3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
01:16Clinical Trials
6.9K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
6.9K
01:28Preclinical Development: Overview
4.5K
Preclinical development consists of a series of tests that ensure the safety and efficacy of a new therapeutic compound before it is tested in humans. There are four main phases to this process. First, safety pharmacology tests are conducted to ensure the drug does not produce any acutely harmful effects. These tests examine parameters such as bronchoconstriction, cardiac dysrhythmias, blood pressure changes, and ataxia. Next, preliminary toxicological testing is performed to determine the...
4.5K
01:11Clinical Trials: Overview
3.0K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
3.0K
01:17Assessment of the Gastrointestinal System I: Subjective Data
225
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
225