Related Experiment Video
Updated: Jul 9, 2025

Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
Evaluation of ChatGPT pathology knowledge using board-style questions
Saroja D Geetha1, Anam Khan1, Atif Khan1
1Department of Pathology and Laboratory Medicine, North Shore University Hospital and Long Island Jewish Medical Center, Donald and Barbara Zucker School of Medicine at Hofstra/Northwell Health, Greenvale, NY, US.
ChatGPT demonstrated 56.98% accuracy on pathology knowledge tests, falling below peer performance. While it excels in clinical pathology and easier questions, caution is advised for its current use in pathology training.
Area of Science:
- Artificial Intelligence in Medicine
- Medical Education Technology
Background:
- Artificial intelligence (AI) chatbots like ChatGPT offer innovative applications in healthcare, including clinical documentation and report simplification.
- The potential of AI in medical education, specifically pathology, requires thorough evaluation.
Purpose of the Study:
- To assess the pathology knowledge of ChatGPT (version 4).
- To determine ChatGPT's suitability and potential role in transforming pathology education.
Main Methods:
- Utilized the American Society for Clinical Pathology Resident Question Bank 2022 for testing.
- Excluded image interpretation questions; focused on text-based knowledge assessment.
- Compared ChatGPT's performance against average peer performance.
Main Results:
- ChatGPT achieved an overall score of 56.98%, below the peer average of 62.81%.
- Performance varied by subspecialty: 60.42% in clinical pathology vs. 54.94% in anatomic pathology.
- Accuracy decreased with question difficulty: 68.47% (easy), 52.88% (intermediate), and 37.21% (difficult).
Conclusions:
- ChatGPT shows potential as a supplementary tool in pathology education.
- Improved performance necessitates training on larger, specialized medical datasets.
- Current limitations require caution for exclusive reliance on ChatGPT for pathology training.
More Related Videos
Related Concept Videos
Assessment of the Gastrointestinal System II: Health Perception Pattern
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Assessment of the Gastrointestinal System I: Subjective Data
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Methods of Documentation III: PIE

