Related Experiment Video
Updated: Jul 23, 2025
Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application
Published on: April 14, 2023
Use of ChatGPT on Taiwan's Examination for Medical Doctors
Yung-Shuo Kao1, Wei-Kai Chuang2, Jen Yang3
1Department of Radiation Oncology, Taoyuan General Hospital, Ministry of Health and Welfare, Taoyüan, Taiwan.
Abstract:
The study evaluates the performance of OpenAI's GPT-3 model on answering medical exam questions from Staged Senior Professional and Technical Examinations Regulations for Medical Doctors in the field of internal medicine. The study used the official API to connect the questionnaire with the ChatGPT model, and the results showed that the AI model performed reasonably well, with the highest score of 8/13 in chest medicine. However, the overall performance of the AI model was limited, with only chest medicine scoring more than 60. ChatGPT scored relatively high in Chest medicine, Gastroenterology, and general medicine. One of the limitations of the study is the use of non-English text, which may affect the model's performance as the model is primarily trained on English text.
More Related Videos
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
08:07Traditional Trail Making Test Modified into Brand-new Assessment Tools: Digital and Walking Trail Making Test
Published on: November 23, 2019