Differences in knowledge development exposed by multi-curricular progress test data

Area of Science:

• Medical Education
• Educational Assessment
• Curriculum Development

Background:

• Progress testing offers insights into student knowledge growth across medical curricula.
• Annual progress tests administered since 2001 by three medical schools provide extensive data.
• Previous single-point measurements were found to be unreliable for comparative analysis.

Purpose of the Study:

• To develop and validate a method for comparing medical school performance using cumulative progress test data.
• To identify strengths and weaknesses in knowledge development within medical curricula.
• To illustrate the utility of the cumulative deviation method with real-world data.

Main Methods:

• A cumulative deviation method was devised, calculating schools' score deviations from the cross-institutional average.
• Trend analysis was applied to subdomains of medical knowledge.
• Data from 16 progress tests administered to 4,300 students across three medical schools (2001-2005) were analyzed.

Main Results:

• The cumulative deviation method, combined with trend analysis, proved feasible for detecting curriculum-specific strengths and weaknesses.
• The study successfully applied the method to a substantial dataset, demonstrating its practical application.
• Analysis revealed patterns in knowledge development across different subdomains and schools.

Conclusions:

• The cumulative deviation method offers a reliable approach to evaluating and comparing medical school curricula.
• This method enhances the understanding of student knowledge progression over time.
• The findings support the use of progress testing data for continuous improvement in medical education.