Assessing the Difficulty and Long-Term Retention of Factual and Conceptual Knowledge Through Multiple-Choice...

Area of Science:

• Medical Education
• Cognitive Science
• Assessment

Background:

• Multiple choice questions (MCQs) are standard in medical assessments.
• Traditional MCQs often test factual recall, with limited assessment of higher cognitive functions.
• Evaluating the long-term retention of factual versus conceptual knowledge is crucial for effective medical education.

Purpose of the Study:

• To compare the difficulty and long-term retention of factual recall versus conceptual understanding using MCQs.
• To test the hypothesis that recall questions yield higher scores than conceptual questions.
• To determine if factual knowledge or conceptual understanding shows greater memory decay over time.

Main Methods:

• MCQs were classified into recall/verbatim and conceptual/inferential types.
• Pre-clinical medical students took MCQs in 2020 (benchmark).
• The same MCQs were re-administered to the same cohort after two years.

Main Results:

• Recall/verbatim questions were answered more frequently correctly (82.0% vs 60.9%).
• Both question types showed performance decline after two years.
• Recall/verbatim questions exhibited a significantly larger performance loss than concept/inference questions.

Conclusions:

• Conceptual/inferential thinking is more complex but yields more durable knowledge.
• Longitudinal retention is enhanced for conceptual understanding, particularly when reinforced in clinical settings.
• MCQ design impacts assessment of cognitive skills and knowledge durability.