An exploratory assessment of GPT-4o and GPT-4 performance on the Japanese National Dental Examination
View abstract on PubMed
Summary
This summary is machine-generated.The new GPT-4o model significantly improves accuracy on Japanese National Dental Examination questions compared to GPT-4. This advancement highlights large language models
Area Of Science
- Artificial Intelligence in Education
- Dental Education Technology
- Large Language Models
Background
- Large language models (LLMs) like GPT-4 show promise for medical and dental education.
- OpenAI released GPT-4o on May 13, 2024, offering significant improvements over GPT-4.
Purpose Of The Study
- To evaluate the accuracy of GPT-4 and GPT-4o on the Japanese National Dental Examination (JNDE).
- To assess the potential of these LLMs as dental education tools.
Main Methods
- 202 questions from the 117th JNDE (January 2024) were selected after excluding image-based and inappropriate items.
- GPT-4 and GPT-4o generated responses using standardized prompts.
- Data analysis involved Qlik Sense® and GraphPad Prism, with Fisher's exact test for significance.
Main Results
- GPT-4o achieved a significantly higher overall correct response rate (73.8%) than GPT-4 (63.3%).
- In the compulsory section, GPT-4o's accuracy (88.6%) was significantly higher than GPT-4's (74.3%).
- GPT-4o also showed improved, though not statistically significant, accuracy in the general section (66.4% vs. 58.0%).
Conclusions
- GPT-4o demonstrates superior accuracy over GPT-4 for JNDE questions, indicating enhanced potential for dental education.
- Further research is required to explore GPT-4o's performance with visual materials and varied question types.
Related Concept Videos
A thorough mouth assessment, including inspection and palpation of the lips, gums, tongue, tonsils, uvula, and pharynx, is crucial in detecting potential health issues. Diseases ranging from oral cancer to systemic conditions like diabetes could be identified early through careful oral examination. This article provides a detailed guide on conducting a comprehensive mouth assessment.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
...
The nursing assessment of the genitourinary (GU) system involves a systematic inspection and palpation to identify abnormalities in the kidneys, bladder, and surrounding structures.InspectionMouth: Inspect for signs of kidney dysfunction, such as stomatitis (inflammation of the mouth) and ammonia breath, which may occur in advanced kidney disease due to the buildup of urea, breaking down into ammonia.Skin: Check for pallor, which could indicate anemia caused by kidney disease. Look for...
The physical assessment examines the patient for objective data that defines the patient's condition, and aids in formulating the nursing care plan. The purpose of physical assessment is a health status appraisal, which includes identifying health problems, and establishing a database for nursing intervention.
The principles to begin the physical assessment include conducting a comprehensive or problem-related history in a quiet, well-lit room, emphasizing privacy and comfort for the...

