Trends in the Japanese National Medical Licensing Examination: Cross-Sectional Study

Area of Science:

• Medical Education Research
• Assessment and Evaluation
• Public Health Policy

Background:

• The Japanese National Medical Licensing Examination (NMLE) is a critical summative assessment for medical graduates in Japan.
• Despite regular revisions to its content guidelines, objective analyses of the NMLE's evolution are lacking.
• The NMLE significantly influences Japanese medical education due to cultural emphasis on high-stakes testing.

Purpose of the Study:

• To analyze the temporal evolution of the Japanese National Medical Licensing Examination (NMLE) from 2001 to 2024.
• To identify trends in examination content, difficulty, and cognitive skills assessed.
• To uncover latent topics within the NMLE using natural language processing and topic modeling.

Main Methods:

• A mixed-methods approach combining rule-based classification and data-driven topic modeling was employed.
• Manual classification of 2880 NMLE items (2001-2024) across level, content, and taxonomy.
• Topic modeling of 11,540 NMLE items using a transformer-based framework to identify temporal topic trends.

Main Results:

• Increased focus on common/emergent diseases (60% to 76%) and practical emergency care knowledge (21% to 29%).
• Decreased emphasis on pathophysiology knowledge (52% to 33%) and simple recall (51% to 30%).
• Significant rise in assessment of advanced analytical skills (4% to 19%) and prominence of topics like patient rights and infection control.

Conclusions:

• The Japanese NMLE has shifted towards evaluating practical problem-solving skills over rote memorization.
• These changes indicate an evolution in Japanese undergraduate medical education.
• Emerging topics in the NMLE may reflect evolving societal needs and public health priorities.