Related Experiment Video
Updated: Jul 20, 2025
Author Spotlight: Self-Assessment Protocol for Predicting Psoriatic Arthritis in Psoriasis Patients
Published on: March 1, 2024
ChatGPT-3.5 and ChatGPT-4 dermatological knowledge level based on the Specialty Certificate Examination in
Miłosz Lewandowski1, Paweł Łukowicz2, Dariusz Świetlik2
1Department of Dermatology, Venereology and Allergology, Faculty of Medicine.
Background:
The global use of artificial intelligence (AI) has the potential to revolutionize the healthcare industry. Despite the fact that AI is becoming more popular, there is still a lack of evidence on its use in dermatology.
Objectives:
To determine the capacity of ChatGPT-3.5 and ChatGPT-4 to support dermatology knowledge and clinical decision-making in medical practice.
Methods:
Three Specialty Certificate Examination in Dermatology tests, in English and Polish, consisting of 120 single-best-answer, multiple-choice questions each, were used to assess the performance of ChatGPT-3.5 and ChatGPT-4.
Results:
ChatGPT-4 exceeded the 60% pass rate in every performed test, with a minimum of 80% and 70% correct answers for the English and Polish versions, respectively. ChatGPT-4 performed significantly better on each exam (P < 0.01), regardless of language, compared with ChatGPT-3.5. Furthermore, ChatGPT-4 answered clinical picture-type questions with an average accuracy of 93.0% and 84.2% for questions in English and Polish, respectively. The difference between the tests in Polish and English were not significant; however, ChatGPT-3.5 and ChatGPT-4 performed better overall in English than in Polish by an average of 8 percentage points for each test. Incorrect ChatGPT answers were highly correlated with a lower difficulty index, denoting questions of higher difficulty in most of the tests (P < 0.05).
Conclusions:
The dermatology knowledge level of ChatGPT was high, and ChatGPT-4 performed significantly better than ChatGPT-3.5. Although the use of ChatGPT will not replace a doctor's final decision, physicians should support the development of AI in dermatology to raise the standards of medical care.
More Related Videos
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
09:32Resolving Water, Proteins, and Lipids from In Vivo Confocal Raman Spectra of Stratum Corneum through a Chemometric Approach
Published on: September 26, 2019
Related Concept Videos
01:23Skin Diseases and Disorders
Gram-positive Staphylococcus spp. and Streptococcus spp. are responsible for many of the most common skin infections. However, many...
01:30Skin Cancer
Basal Cell Carcinoma (BCC): BCC is the most common type of skin cancer, accounting for about 80% of cases. It typically develops in...
01:14Changes in Skin Color: Clinical Perspectives
Albinism
Albinism is a genetic disorder that affects (completely or partially) the coloring of skin, hair, and eyes. The defect is primarily...
01:28Chronic Kidney Disease III: Interprofessional Care
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
01:11Papillary Dermis
The dermis might be considered the "core" of the integumentary system, as distinct from the epidermis and hypodermis. It contains blood and lymph vessels, nerves, and other structures, such as hair follicles and sweat glands. The dermis is made of two layers of connective tissue that comprise an interconnected mesh of elastin and collagenous fibers, produced by fibroblasts.
Papillary Layer
The papillary layer is made of loose, areolar connective tissue, which means the collagen...